-- Logs begin at Tue 2022-06-07 13:37:07 UTC, end at Tue 2022-06-07 15:01:56 UTC. -- Jun 07 14:19:31.564564 dv-cinder-844974-1-smb systemd[1]: Starting Devstack devstack@keystone.service... Jun 07 14:19:31.575779 dv-cinder-844974-1-smb devstack@keystone.service[80405]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 07 14:19:31.575779 dv-cinder-844974-1-smb devstack@keystone.service[80405]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jun 7 14:19:31 2022] *** Jun 07 14:19:31.575779 dv-cinder-844974-1-smb devstack@keystone.service[80405]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 07 14:19:31.575779 dv-cinder-844974-1-smb devstack@keystone.service[80405]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 07 14:19:31.575779 dv-cinder-844974-1-smb devstack@keystone.service[80405]: nodename: dv-cinder-844974-1-smb Jun 07 14:19:31.575779 dv-cinder-844974-1-smb devstack@keystone.service[80405]: machine: x86_64 Jun 07 14:19:31.575779 dv-cinder-844974-1-smb devstack@keystone.service[80405]: clock source: unix Jun 07 14:19:31.575779 dv-cinder-844974-1-smb devstack@keystone.service[80405]: pcre jit disabled Jun 07 14:19:31.575779 dv-cinder-844974-1-smb devstack@keystone.service[80405]: detected number of CPU cores: 4 Jun 07 14:19:31.575779 dv-cinder-844974-1-smb devstack@keystone.service[80405]: current working directory: / Jun 07 14:19:31.575779 dv-cinder-844974-1-smb devstack@keystone.service[80405]: detected binary path: /usr/bin/uwsgi-core Jun 07 14:19:31.575779 dv-cinder-844974-1-smb devstack@keystone.service[80405]: your processes number limit is 47680 Jun 07 14:19:31.575779 dv-cinder-844974-1-smb devstack@keystone.service[80405]: your memory page size is 4096 bytes Jun 07 14:19:31.575779 dv-cinder-844974-1-smb devstack@keystone.service[80405]: detected max file descriptor number: 2048 Jun 07 14:19:31.575779 dv-cinder-844974-1-smb devstack@keystone.service[80405]: lock engine: pthread robust mutexes Jun 07 14:19:31.575779 dv-cinder-844974-1-smb devstack@keystone.service[80405]: thunder lock: enabled Jun 07 14:19:31.575779 dv-cinder-844974-1-smb devstack@keystone.service[80405]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 07 14:19:31.575779 dv-cinder-844974-1-smb devstack@keystone.service[80405]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 07 14:19:31.620156 dv-cinder-844974-1-smb devstack@keystone.service[80405]: Python main interpreter initialized at 0x55779019d9c0 Jun 07 14:19:31.620156 dv-cinder-844974-1-smb devstack@keystone.service[80405]: python threads support enabled Jun 07 14:19:31.620156 dv-cinder-844974-1-smb devstack@keystone.service[80405]: your server socket listen backlog is limited to 100 connections Jun 07 14:19:31.620156 dv-cinder-844974-1-smb devstack@keystone.service[80405]: your mercy for graceful operations on workers is 90 seconds Jun 07 14:19:31.620507 dv-cinder-844974-1-smb devstack@keystone.service[80405]: mapped 403077 bytes (393 KB) for 2 cores Jun 07 14:19:31.620585 dv-cinder-844974-1-smb devstack@keystone.service[80405]: *** Operational MODE: preforking *** Jun 07 14:19:31.620851 dv-cinder-844974-1-smb devstack@keystone.service[80405]: *** uWSGI is running in multiple interpreter mode *** Jun 07 14:19:31.620851 dv-cinder-844974-1-smb devstack@keystone.service[80405]: spawned uWSGI master process (pid: 80405) Jun 07 14:19:31.621056 dv-cinder-844974-1-smb systemd[1]: Started Devstack devstack@keystone.service. Jun 07 14:19:31.621627 dv-cinder-844974-1-smb devstack@keystone.service[80405]: spawned uWSGI worker 1 (pid: 80418, cores: 1) Jun 07 14:19:31.621964 dv-cinder-844974-1-smb devstack@keystone.service[80405]: spawned uWSGI worker 2 (pid: 80419, cores: 1) Jun 07 14:19:31.622117 dv-cinder-844974-1-smb devstack@keystone.service[80405]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 07 14:19:37.350627 dv-cinder-844974-1-smb devstack@keystone.service[80419]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 07 14:19:37.350627 dv-cinder-844974-1-smb devstack@keystone.service[80419]: from cryptography.utils import int_from_bytes Jun 07 14:19:37.351353 dv-cinder-844974-1-smb devstack@keystone.service[80418]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 07 14:19:37.351353 dv-cinder-844974-1-smb devstack@keystone.service[80418]: from cryptography.utils import int_from_bytes Jun 07 14:19:37.351794 dv-cinder-844974-1-smb devstack@keystone.service[80419]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 07 14:19:37.351794 dv-cinder-844974-1-smb devstack@keystone.service[80419]: from cryptography.utils import int_from_bytes Jun 07 14:19:37.351913 dv-cinder-844974-1-smb devstack@keystone.service[80418]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 07 14:19:37.351913 dv-cinder-844974-1-smb devstack@keystone.service[80418]: from cryptography.utils import int_from_bytes Jun 07 14:19:37.400949 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 07 14:19:37.401104 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 07 14:19:37.401188 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 07 14:19:37.401274 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 07 14:19:37.401352 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] command line args: [] {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 07 14:19:37.401428 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] command line args: [] {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 07 14:19:37.401593 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 07 14:19:37.401684 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 07 14:19:37.401795 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ================================================================================ {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 07 14:19:37.401878 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] ================================================================================ {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 07 14:19:37.402052 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] admin_token = **** {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:19:37.402135 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] admin_token = **** {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:19:37.402294 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] config_dir = [] {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:19:37.402377 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] config_dir = [] {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:19:37.402482 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:19:37.402569 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:19:37.402646 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] config_source = [] {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:19:37.402720 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] config_source = [] {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:19:37.402823 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] debug = True {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:19:37.402913 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] debug = True {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:19:37.403027 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:19:37.403828 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:19:37.403963 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:19:37.404069 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:19:37.404170 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:19:37.404271 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:19:37.404371 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:19:37.404473 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:19:37.404582 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:19:37.404688 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:19:37.404789 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] list_limit = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:19:37.404889 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] list_limit = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:19:37.404989 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] log_config_append = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:19:37.405096 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] log_config_append = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:19:37.405197 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:19:37.405314 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:19:37.405399 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] log_dir = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:19:37.405516 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] log_dir = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:19:37.405596 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] log_file = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:19:37.405716 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] log_file = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:19:37.405801 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:19:37.405872 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:19:37.405937 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:19:37.406051 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:19:37.406160 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:19:37.406239 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:19:37.406362 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:19:37.406445 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:19:37.406567 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:19:37.406643 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:19:37.406762 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:19:37.406837 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:19:37.407018 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:19:37.407102 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:19:37.407215 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:19:37.407296 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:19:37.407414 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:19:37.407497 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:19:37.407611 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:19:37.407684 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:19:37.407820 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:19:37.407908 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:19:37.407979 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:19:37.408103 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:19:37.408190 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:19:37.408308 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:19:37.408878 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:19:37.408999 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:19:37.409072 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:19:37.409197 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:19:37.409331 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.86/identity {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:19:37.409471 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.86/identity {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:19:37.409578 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] publish_errors = False {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:19:37.409663 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] publish_errors = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:19:37.409742 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:19:37.409817 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:19:37.409957 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:19:37.410071 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:19:37.410139 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:19:37.410197 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:19:37.410355 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:19:37.410545 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:19:37.410631 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:19:37.410705 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:19:37.410813 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] standard_threads = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:19:37.410917 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] standard_threads = False {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:19:37.411042 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:19:37.411131 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:19:37.411281 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:19:37.411363 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:19:37.411485 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:19:37.411608 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:19:37.411608 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] use_journal = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:19:37.411820 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] use_journal = False {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:19:37.411903 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] use_json = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:19:37.412018 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] use_json = False {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:19:37.412097 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] use_stderr = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:19:37.412174 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] use_stderr = False {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:19:37.412249 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] use_syslog = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:19:37.412371 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] use_syslog = False {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:19:37.412445 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:19:37.412519 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:19:37.412594 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.412664 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.412822 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.412912 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.413085 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.413167 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.413321 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.413396 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.413569 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.413655 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.413803 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.413884 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.414049 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.414125 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.414286 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.414377 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.414536 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.414683 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.414785 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.414938 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.415038 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.415243 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.415327 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.415486 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.415562 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.415732 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.415828 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.415994 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.416073 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.416240 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.416316 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.416479 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.416562 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.416712 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.416842 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.416967 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.417050 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.417214 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.417299 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.417454 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.417539 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.417686 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.417761 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.417937 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.418020 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.418196 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.418273 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.418443 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.418786 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.418943 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.419028 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.419172 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.419253 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.419403 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.419477 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.419629 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.419711 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.419887 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.419975 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.420136 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.420213 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.420372 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.420455 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.420602 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.420683 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.420832 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.420908 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.421084 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.421192 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.421323 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.421407 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.421563 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.421638 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.421795 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.421906 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.422033 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.422144 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.422253 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.422353 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.422594 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.422735 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.422823 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.422939 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.422939 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.423128 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.423211 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.423320 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.423412 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.423488 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.423602 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.423734 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.423877 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.423956 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.424117 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.424199 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.424352 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.424435 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.424577 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.424689 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.424810 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.424908 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.425056 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.425155 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.425288 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.425376 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.425520 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.425599 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.425754 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.425833 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.425988 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.426082 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.426223 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.426310 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.426458 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.426544 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.426687 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.426768 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.426917 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.427003 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.427164 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.427242 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.427402 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.427501 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.427632 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.427721 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.427919 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.427993 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.428148 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.428242 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.428382 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.428474 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.428613 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.428692 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.428849 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.428928 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.429082 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.429167 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.429343 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.429427 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.429579 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.429669 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.429826 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.429905 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.430066 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.430145 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.430301 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.430387 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.430535 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.430614 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.430772 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.430869 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.431012 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.431090 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.431246 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.431329 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.431483 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.431568 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.431718 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.431826 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.431980 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.432059 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.432216 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.432293 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.432451 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.432528 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.432685 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.432763 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.432927 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.433063 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.433177 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.433254 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.433419 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.433496 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.433658 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.433737 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.433892 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.433968 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.434131 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.434212 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.434365 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.434442 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.434598 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.434675 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.434833 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.434911 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.435060 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.435168 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.435289 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.435366 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.435516 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.435591 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.435746 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.435867 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.435998 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.436074 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.436234 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.436331 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.436467 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.436544 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.436714 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.436796 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.436950 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.437034 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.437205 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.437283 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.437453 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.437536 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.437693 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.437777 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] auth.external = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.437925 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] auth.external = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.438003 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.438155 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.438233 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.438450 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.438536 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.438682 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.438766 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] auth.password = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.438911 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] auth.password = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.438990 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] auth.token = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.439140 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] auth.token = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.439218 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.439376 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.439461 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.439635 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.439719 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.439897 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.439977 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.440124 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.440209 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.440368 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.440446 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.440602 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.440679 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.440829 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.440977 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] credential.caching = True {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.441052 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] credential.caching = True {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.441122 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.441296 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.441375 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.441541 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.441627 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.441777 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.441854 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.442008 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.442090 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.442248 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.442333 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.442480 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.442557 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.442745 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.442823 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.442987 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.443073 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.443225 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.443303 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.443477 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.443561 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.443790 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.443883 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.444016 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.444094 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.444265 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.444343 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.444504 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.444591 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.444748 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] federation.caching = True {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.444826 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.444983 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] federation.caching = True {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.445060 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.445220 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.445308 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.445464 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.445548 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.445697 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.445775 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.445934 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.446019 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.446168 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.446245 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.446406 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.446483 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.446646 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.446732 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.446884 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.446961 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.447127 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.447203 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.447362 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.447851 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.447851 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] identity.caching = True {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.447851 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.448119 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.448190 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.448275 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] identity.caching = True {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.448348 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.448419 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.448555 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.448660 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.448901 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.449139 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.450302 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.450566 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.450828 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.450904 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.451099 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.451185 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.451367 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.451451 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.451617 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.451696 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.451887 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.451979 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.452132 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.452208 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.452375 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.452453 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.452616 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.452703 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.452869 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.452946 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.453119 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.453195 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.453372 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.453458 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.453632 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.453711 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.453882 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.453958 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.454125 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.454212 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.454363 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.454441 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.454604 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.454681 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.454836 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.454921 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.455074 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.455687 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.455868 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.455948 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.456109 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.456232 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.456392 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.456472 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.456628 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.456705 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.456876 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.456962 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.457109 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.457188 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.457352 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.457429 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.457596 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.457684 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.457834 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.457913 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.458066 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.458143 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.458305 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.458392 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.458532 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.458609 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.458769 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.458847 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.459000 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.459086 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.459238 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.459322 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.459475 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.459552 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.459714 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.459850 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.459974 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.460052 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.460212 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.460290 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.460445 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.460530 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.460679 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.460758 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.460914 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.460991 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.461145 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.461227 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.461393 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.461471 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.461628 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.461705 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.461865 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.461943 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.462098 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.user = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.462175 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.462332 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.462408 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.462563 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.user = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.462649 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.462803 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.462881 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.463049 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.463126 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.463285 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.463363 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.463531 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.463608 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.463794 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.463914 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.464009 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.464083 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.464249 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.464328 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.464479 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.464556 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.464715 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.464793 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.464948 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.465026 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.465182 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.465258 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.465413 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.465492 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.465659 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.465737 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.465902 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.465985 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.466134 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.466208 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.466369 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.466446 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.466611 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.466688 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.466844 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.466923 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.467080 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.467157 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.467314 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.467391 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.467549 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.467634 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.467800 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.467879 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.468039 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.468117 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.468285 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.468365 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.468532 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.468611 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.468760 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.468837 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.469009 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.469101 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.469236 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.469320 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.469473 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.469549 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.469708 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.469785 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.469944 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.470023 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.470181 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.470259 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.470411 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.470489 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.470648 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.470759 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.471453 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.471525 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] resource.caching = True {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.471683 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.471814 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.471953 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] resource.caching = True {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.472032 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.472198 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.472275 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.472443 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.472521 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.472678 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.472756 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.472918 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.472995 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.473166 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.473245 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.473401 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.473477 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.473639 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.473716 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.473873 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.473950 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] role.caching = True {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.474112 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.474190 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] role.driver = sql {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.474341 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.474419 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] role.caching = True {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.474585 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] role.driver = sql {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.474663 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.474814 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.474892 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.475062 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.475149 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.475307 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.475385 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.475554 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.475631 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.475819 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.475912 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.476067 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.476145 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.476313 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.476390 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.476547 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.476634 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.476792 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.476869 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.477025 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.477103 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.477271 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.477393 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.477518 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.477605 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.477759 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.477919 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.478001 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.478157 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.478388 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.478468 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.478624 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.478705 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.478875 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.478971 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.479121 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.479200 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.479398 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.479487 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.479602 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.479691 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.479862 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.479944 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.480116 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.480197 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.480350 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.480432 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.480587 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.480674 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.480818 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.480903 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.481052 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.481134 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.481284 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.481364 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.481535 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.481615 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.481771 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.481852 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.482010 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.482091 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.482242 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.482322 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.482475 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.482555 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] token.caching = True {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.482711 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.482789 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.482952 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] token.caching = True {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.483030 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.483188 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.483269 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.483433 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.483512 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.483669 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.483749 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.483938 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.484020 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.484184 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.484265 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.484419 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.484497 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.484661 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.484742 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.484897 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.484976 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.485139 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.485219 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.485371 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.485451 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.485608 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.485690 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.485843 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.485923 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.486076 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.486162 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.486339 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.486435 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.486583 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.486662 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.486826 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.486907 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] database.connection = **** {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.487120 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.487210 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.487367 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.487447 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] database.connection = **** {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.487606 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.487701 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.487877 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.487970 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.488115 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.488195 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.488353 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.488433 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.488588 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.488676 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.488821 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.488901 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.489057 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.489138 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.489292 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.489384 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.489532 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.489612 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.489767 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.489846 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.490006 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.490094 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.490241 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.490320 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.490487 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.490567 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.490718 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.490808 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.490958 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.491037 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.491187 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.491268 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.491340 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 07 14:19:37.491421 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.491645 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:19:37.491836 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 07 14:19:37.521718 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 14:19:37.521947 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 14:19:37.522172 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 14:19:37.524440 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 14:19:37.524674 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 14:19:37.524899 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 14:19:37.530572 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 14:19:37.533185 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 14:19:37.558905 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 14:19:37.559139 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 14:19:37.559283 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 14:19:37.559525 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 14:19:37.613383 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 14:19:37.613670 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 14:19:37.662712 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 14:19:37.662942 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 14:19:37.663201 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 14:19:37.663441 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 14:19:37.730155 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 14:19:37.730285 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 14:19:37.730359 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 14:19:37.730483 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 14:19:37.730568 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 14:19:37.730708 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 14:19:37.730791 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 14:19:37.730926 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 14:19:37.731009 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 14:19:37.731141 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 14:19:37.731306 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 14:19:37.731393 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 14:19:37.762699 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 14:19:37.762936 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 14:19:37.763098 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 14:19:37.763182 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 14:19:37.763283 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 14:19:37.763361 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 14:19:37.763434 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 14:19:37.763571 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 14:19:37.763669 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 14:19:37.763804 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 14:19:37.763890 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 14:19:37.764021 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 14:19:37.764101 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 14:19:37.764233 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 14:19:37.775544 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 14:19:37.776732 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 14:19:37.788298 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 14:19:37.788527 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 14:19:37.788611 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 14:19:37.788754 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 14:19:37.788855 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 14:19:37.788977 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 14:19:37.789060 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 14:19:37.789191 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 14:19:37.789274 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 14:19:37.789402 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 14:19:37.789485 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 14:19:37.789611 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 14:19:37.789693 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 14:19:37.789823 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 14:19:37.807269 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:37.807483 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 07 14:19:37.807802 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:37.807901 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:37.808020 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 07 14:19:37.808104 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 07 14:19:37.808304 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:37.808386 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:37.808541 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 07 14:19:37.808676 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:37.808807 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:37.808890 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:37.809069 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:37.809179 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:37.809323 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:37.809577 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:37.820742 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:37.821023 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:37.821295 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:37.821377 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:37.821587 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:37.821732 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:37.821855 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:37.822289 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:37.829898 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80418) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 14:19:37.831099 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80419) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 14:19:37.833832 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80418) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 14:19:37.834117 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:37.834402 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:37.834484 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80419) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 14:19:37.834680 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:37.834761 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:37.834961 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:37.835051 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:37.835221 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:37.835304 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:37.835490 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:37.835572 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:37.835769 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:37.835853 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:37.836045 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:37.836126 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:37.836315 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:37.836406 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:37.836581 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:37.836666 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:37.836848 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:37.837114 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:37.863143 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:37.864153 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:37.864806 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80418) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 14:19:37.865091 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:37.865754 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80419) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 14:19:37.866090 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:37.870492 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80418) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 14:19:37.870774 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:37.871053 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:37.871517 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80419) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 14:19:37.871817 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:37.872098 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:37.878938 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80418) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 14:19:37.879232 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:37.880066 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80419) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 14:19:37.880351 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:37.883723 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80418) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 14:19:37.884033 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:37.884316 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:37.884597 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:37.884874 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:37.884958 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80419) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 14:19:37.885154 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:37.885239 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:37.885462 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:37.885543 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:37.885739 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:37.885830 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:37.886010 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:37.886279 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:37.886658 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:37.886931 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:37.905242 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:37.905535 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:37.906191 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:37.906476 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:37.910215 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80418) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 14:19:37.911256 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80419) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 14:19:37.913999 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:37.914298 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:37.915062 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:37.915363 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:37.919637 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80418) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 14:19:37.920677 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80419) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 14:19:37.923282 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80418) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 14:19:37.924832 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80419) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 14:19:37.927469 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:37.927790 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:37.928073 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:37.928358 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:37.928567 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:37.928652 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:37.928861 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:37.928946 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:37.929139 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:37.929429 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:37.929704 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:37.929994 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:37.948551 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80418) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 14:19:37.948836 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:37.949105 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:37.949365 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:37.949593 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80419) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 14:19:37.949876 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:37.950140 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:37.950401 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:37.957365 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:37.958318 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:37.960610 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:37.960910 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:37.961493 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:37.961766 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:37.964039 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80418) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 14:19:37.964327 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:37.964611 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:37.964895 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:37.964979 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80419) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 14:19:37.965190 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:37.965275 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:37.965474 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:37.965753 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:37.966038 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:37.978679 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80418) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 14:19:37.978970 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:37.979252 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:37.979530 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:37.979614 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80419) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 14:19:37.979834 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:37.979921 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:37.980112 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:37.980243 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:37.980388 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:37.980473 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:37.980671 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:37.980943 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:37.981224 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:37.998861 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80418) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 14:19:37.999596 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80419) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 14:19:38.002745 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80418) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 14:19:38.003423 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80419) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 14:19:38.006317 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:38.006879 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:38.007971 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:38.008519 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:38.009629 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80418) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 14:19:38.009909 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:38.010189 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:38.010282 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80419) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 14:19:38.010506 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:38.010808 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:38.017696 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:38.018232 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:38.019325 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80418) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 14:19:38.019872 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80419) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 14:19:38.022699 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:38.022990 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:38.023205 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:38.023290 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:38.023491 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:38.023575 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:38.023792 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:38.024085 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:38.032712 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80418) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 14:19:38.032997 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:38.033209 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80419) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 14:19:38.033307 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:38.033497 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:38.033775 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:38.041336 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80418) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 14:19:38.041617 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:38.041792 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80419) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 14:19:38.041890 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:38.042069 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:38.042154 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:38.042344 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:38.042428 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:38.042618 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:38.042712 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:38.042883 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:38.042968 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:38.043157 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:38.043250 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:38.043427 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:38.043789 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:38.043979 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:38.044067 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:38.044245 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:38.044409 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:38.044495 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:38.044571 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:38.044775 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:38.044858 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:38.045035 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:38.045119 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:38.045300 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:38.045564 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:19:38.084205 dv-cinder-844974-1-smb devstack@keystone.service[80418]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55779019d9c0 pid: 80418 (default app) Jun 07 14:19:38.084520 dv-cinder-844974-1-smb devstack@keystone.service[80419]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55779019d9c0 pid: 80419 (default app) Jun 07 14:19:38.087589 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72534dd9-81e6-4792-8df9-daf442ba634c None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:19:38.087911 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72534dd9-81e6-4792-8df9-daf442ba634c None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:19:38.088197 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72534dd9-81e6-4792-8df9-daf442ba634c None None] PATH_INFO: `/v3` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:19:38.092392 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1/1] 10.222.0.86 () {50 vars in 791 bytes} [Tue Jun 7 14:19:38 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:19:47.338397 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41aa991-6c94-40ff-86d7-20467718d534 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:19:47.338890 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41aa991-6c94-40ff-86d7-20467718d534 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:19:47.338970 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41aa991-6c94-40ff-86d7-20467718d534 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:19:47.343250 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1/2] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:19:47 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 07 14:19:47.349041 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f28996f-2361-4613-9f28-7e92f4ffb466 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:19:47.349440 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f28996f-2361-4613-9f28-7e92f4ffb466 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:19:47.349591 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f28996f-2361-4613-9f28-7e92f4ffb466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:19:47.417209 dv-cinder-844974-1-smb devstack@keystone.service[80418]: INFO dbcounter [None req-9f28996f-2361-4613-9f28-7e92f4ffb466 None None] Registered counter for database keystone Jun 07 14:19:47.438819 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG oslo_db.sqlalchemy.engines [None req-9f28996f-2361-4613-9f28-7e92f4ffb466 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80418) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 14:19:47.445757 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writer thread running {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 14:19:47.721925 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG passlib.handlers.bcrypt [None req-9f28996f-2361-4613-9f28-7e92f4ffb466 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80418) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 07 14:19:47.722339 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG passlib.handlers.bcrypt [None req-9f28996f-2361-4613-9f28-7e92f4ffb466 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80418) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 07 14:19:47.776579 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-9f28996f-2361-4613-9f28-7e92f4ffb466 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:19:47.778147 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-9f28996f-2361-4613-9f28-7e92f4ffb466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:19:47.902039 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 2/3] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:19:47 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 554 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 07 14:19:48.064084 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41aa991-6c94-40ff-86d7-20467718d534 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:19:48.134106 dv-cinder-844974-1-smb devstack@keystone.service[80419]: INFO dbcounter [None req-e41aa991-6c94-40ff-86d7-20467718d534 None None] Registered counter for database keystone Jun 07 14:19:48.153824 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG oslo_db.sqlalchemy.engines [None req-e41aa991-6c94-40ff-86d7-20467718d534 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80419) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 14:19:48.160234 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writer thread running {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 14:19:48.384144 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41aa991-6c94-40ff-86d7-20467718d534 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:19:48.388404 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af03a17b-2af3-488a-bb0f-2f027dff10a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:19:48.389097 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af03a17b-2af3-488a-bb0f-2f027dff10a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:19:48.389389 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af03a17b-2af3-488a-bb0f-2f027dff10a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:19:48.389673 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af03a17b-2af3-488a-bb0f-2f027dff10a4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:19:48.397777 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af03a17b-2af3-488a-bb0f-2f027dff10a4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:19:48.449959 dv-cinder-844974-1-smb devstack@keystone.service[80419]: WARNING keystone.common.rbac_enforcer.enforcer [None req-af03a17b-2af3-488a-bb0f-2f027dff10a4 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 07 14:19:48.450307 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af03a17b-2af3-488a-bb0f-2f027dff10a4 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:19:48.459703 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 2/4] 10.222.0.86 () {58 vars in 1324 bytes} [Tue Jun 7 14:19:48 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 07 14:19:48.465730 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f28996f-2361-4613-9f28-7e92f4ffb466 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:19:48.480123 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f28996f-2361-4613-9f28-7e92f4ffb466 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:19:48.484568 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93e428f-8595-4c89-a75e-ea2d98670b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:19:48.485692 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93e428f-8595-4c89-a75e-ea2d98670b83 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:19:48.485981 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93e428f-8595-4c89-a75e-ea2d98670b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:19:48.486259 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93e428f-8595-4c89-a75e-ea2d98670b83 admin admin] PATH_INFO: `/v3/projects/7ce15f4da81a4a5c8d99aabf417988bf` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:19:48.488375 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93e428f-8595-4c89-a75e-ea2d98670b83 admin admin] RBAC: Authorizing `identity:get_project(project_id=7ce15f4da81a4a5c8d99aabf417988bf)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:19:48.538326 dv-cinder-844974-1-smb devstack@keystone.service[80418]: WARNING keystone.common.rbac_enforcer.enforcer [None req-b93e428f-8595-4c89-a75e-ea2d98670b83 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 07 14:19:48.538668 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93e428f-8595-4c89-a75e-ea2d98670b83 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:19:48.544800 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 3/5] 10.222.0.86 () {56 vars in 1207 bytes} [Tue Jun 7 14:19:48 2022] GET /identity/v3/projects/7ce15f4da81a4a5c8d99aabf417988bf => generated 344 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:19:50.756133 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743aac71-41eb-4245-899b-7539cb31b268 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:19:50.756666 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743aac71-41eb-4245-899b-7539cb31b268 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:19:50.756748 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743aac71-41eb-4245-899b-7539cb31b268 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:19:50.761344 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 3/6] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:19:50 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 07 14:19:50.766767 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40d89c4-6503-45d9-9c64-c1e4a7d19d21 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:19:50.767166 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40d89c4-6503-45d9-9c64-c1e4a7d19d21 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:19:50.767313 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40d89c4-6503-45d9-9c64-c1e4a7d19d21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:19:50.785584 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-b40d89c4-6503-45d9-9c64-c1e4a7d19d21 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:19:50.787090 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-b40d89c4-6503-45d9-9c64-c1e4a7d19d21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:19:50.795039 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 4/7] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:19:50 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jun 07 14:19:50.817806 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743aac71-41eb-4245-899b-7539cb31b268 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:19:50.829988 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743aac71-41eb-4245-899b-7539cb31b268 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:19:50.834247 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774f8ed4-fdc8-4173-a000-52f2176832c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:19:50.834872 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774f8ed4-fdc8-4173-a000-52f2176832c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:19:50.835162 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774f8ed4-fdc8-4173-a000-52f2176832c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:19:50.835445 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774f8ed4-fdc8-4173-a000-52f2176832c3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:19:50.843247 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774f8ed4-fdc8-4173-a000-52f2176832c3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:19:50.845046 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774f8ed4-fdc8-4173-a000-52f2176832c3 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:19:50.853815 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 4/8] 10.222.0.86 () {58 vars in 1324 bytes} [Tue Jun 7 14:19:50 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 07 14:19:50.859163 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40d89c4-6503-45d9-9c64-c1e4a7d19d21 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:19:50.868371 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40d89c4-6503-45d9-9c64-c1e4a7d19d21 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:19:50.872687 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6600d9-31fe-4857-ad61-2576922a5e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:19:50.873539 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6600d9-31fe-4857-ad61-2576922a5e07 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:19:50.873824 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6600d9-31fe-4857-ad61-2576922a5e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:19:50.874099 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6600d9-31fe-4857-ad61-2576922a5e07 admin admin] PATH_INFO: `/v3/users/5e52b7dc1f3e460b87cf6e04ac06baf2` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:19:50.875464 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6600d9-31fe-4857-ad61-2576922a5e07 admin admin] RBAC: Authorizing `identity:get_user(user_id=5e52b7dc1f3e460b87cf6e04ac06baf2)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:19:50.877937 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6600d9-31fe-4857-ad61-2576922a5e07 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:19:50.879476 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 5/9] 10.222.0.86 () {56 vars in 1198 bytes} [Tue Jun 7 14:19:50 2022] GET /identity/v3/users/5e52b7dc1f3e460b87cf6e04ac06baf2 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:19:53.188859 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7a70b1-6b36-4a0c-a2ab-bd46faaef423 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:19:53.189377 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7a70b1-6b36-4a0c-a2ab-bd46faaef423 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:19:53.189458 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7a70b1-6b36-4a0c-a2ab-bd46faaef423 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:19:53.190774 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 5/10] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:19:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:19:53.196040 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18c761c-4703-4a54-9224-c8241653467c None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:19:53.196533 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18c761c-4703-4a54-9224-c8241653467c None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:19:53.196623 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18c761c-4703-4a54-9224-c8241653467c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:19:53.213726 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ebc4c0-d752-4300-a682-a480f4895cd6 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:19:53.214012 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ebc4c0-d752-4300-a682-a480f4895cd6 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:19:53.214121 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-c18c761c-4703-4a54-9224-c8241653467c None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:19:53.214292 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ebc4c0-d752-4300-a682-a480f4895cd6 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:19:53.215301 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-c18c761c-4703-4a54-9224-c8241653467c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:19:53.215632 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 6/11] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:19:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 07 14:19:53.220791 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc2340c-da25-4fc5-ac51-f4ca6395f6ef None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:19:53.221642 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc2340c-da25-4fc5-ac51-f4ca6395f6ef None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:19:53.221923 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc2340c-da25-4fc5-ac51-f4ca6395f6ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:19:53.261368 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG passlib.handlers.bcrypt [None req-9fc2340c-da25-4fc5-ac51-f4ca6395f6ef None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80419) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 07 14:19:53.261804 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG passlib.handlers.bcrypt [None req-9fc2340c-da25-4fc5-ac51-f4ca6395f6ef None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80419) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 07 14:19:53.294591 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 6/12] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:19:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 14:19:53.308404 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-9fc2340c-da25-4fc5-ac51-f4ca6395f6ef None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:19:53.309983 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-9fc2340c-da25-4fc5-ac51-f4ca6395f6ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:19:53.318715 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18c761c-4703-4a54-9224-c8241653467c None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:19:53.341900 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:19:53.411811 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 7/13] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:19:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 07 14:19:53.421466 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18c761c-4703-4a54-9224-c8241653467c None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:19:53.433874 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc2340c-da25-4fc5-ac51-f4ca6395f6ef None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:19:53.454640 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af536d66-2d7d-4c43-8a20-f767024ebfe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:19:53.455934 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af536d66-2d7d-4c43-8a20-f767024ebfe8 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:19:53.456219 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af536d66-2d7d-4c43-8a20-f767024ebfe8 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:19:53.456495 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af536d66-2d7d-4c43-8a20-f767024ebfe8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:19:53.467821 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af536d66-2d7d-4c43-8a20-f767024ebfe8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:19:53.479216 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-af536d66-2d7d-4c43-8a20-f767024ebfe8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 14:19:53.479216 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:19:53.479216 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:19:53.479216 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:19:53.479216 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:19:53.479216 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:19:53.479216 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:19:53.479216 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:19:53.479216 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:19:53.479216 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:19:53.479216 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:19:53.479216 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:19:53.479216 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:19:53.479216 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:19:53.479216 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:19:53.479216 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:19:53.480262 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:19:53.480262 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:19:53.480262 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:19:53.480262 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:19:53.480262 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:19:53.480262 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:19:53.480262 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:19:53.480262 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:19:53.480262 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:19:53.480262 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:19:53.480262 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:19:53.480262 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jun 07 14:19:53.480262 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:19:53.480262 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:19:53.480262 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:19:53.480262 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:19:53.481271 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:19:53.481271 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:19:53.481271 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:19:53.481271 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:19:53.481271 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:19:53.481271 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:19:53.481271 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:19:53.481271 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:19:53.481271 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:19:53.481271 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:19:53.481271 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 14:19:53.481271 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:19:53.481271 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 7/14] 10.222.0.86 () {56 vars in 1096 bytes} [Tue Jun 7 14:19:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 14:19:53.486110 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af536d66-2d7d-4c43-8a20-f767024ebfe8 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:19:53.535997 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc2340c-da25-4fc5-ac51-f4ca6395f6ef None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:19:53.538361 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:19:53.566834 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:19:53.573245 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61e23ff-28fb-4732-a302-0284aa17d364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:19:53.574193 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61e23ff-28fb-4732-a302-0284aa17d364 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:19:53.574476 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61e23ff-28fb-4732-a302-0284aa17d364 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:19:53.574749 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61e23ff-28fb-4732-a302-0284aa17d364 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:19:53.584695 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af536d66-2d7d-4c43-8a20-f767024ebfe8 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:19:53.617640 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6310ce9-f248-4117-b178-930f0fc27ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:19:53.618295 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6310ce9-f248-4117-b178-930f0fc27ceb None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:19:53.618579 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6310ce9-f248-4117-b178-930f0fc27ceb None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:19:53.618855 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6310ce9-f248-4117-b178-930f0fc27ceb None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:19:53.619595 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6310ce9-f248-4117-b178-930f0fc27ceb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:19:53.619937 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6310ce9-f248-4117-b178-930f0fc27ceb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:19:53.621311 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6310ce9-f248-4117-b178-930f0fc27ceb None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:19:53.634011 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 8/15] 10.222.0.86 () {56 vars in 1099 bytes} [Tue Jun 7 14:19:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:19:53.639520 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6310ce9-f248-4117-b178-930f0fc27ceb None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:19:53.644412 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61e23ff-28fb-4732-a302-0284aa17d364 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:19:53.646003 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61e23ff-28fb-4732-a302-0284aa17d364 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:19:53.736966 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6310ce9-f248-4117-b178-930f0fc27ceb None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:19:53.743138 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 8/16] 10.222.0.86 () {58 vars in 1282 bytes} [Tue Jun 7 14:19:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 07 14:19:53.748625 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61e23ff-28fb-4732-a302-0284aa17d364 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:19:53.751242 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:19:53.770303 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66cae26-6791-41e9-a2c4-087d69438253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:19:53.771166 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66cae26-6791-41e9-a2c4-087d69438253 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:19:53.771452 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66cae26-6791-41e9-a2c4-087d69438253 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:19:53.771718 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66cae26-6791-41e9-a2c4-087d69438253 None admin] PATH_INFO: `/v3/users/5e52b7dc1f3e460b87cf6e04ac06baf2` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:19:53.772933 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66cae26-6791-41e9-a2c4-087d69438253 None admin] RBAC: Authorizing `identity:get_user(user_id=5e52b7dc1f3e460b87cf6e04ac06baf2)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:19:53.774430 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66cae26-6791-41e9-a2c4-087d69438253 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:19:53.776052 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 9/17] 10.222.0.86 () {56 vars in 1177 bytes} [Tue Jun 7 14:19:53 2022] GET /identity/v3/users/5e52b7dc1f3e460b87cf6e04ac06baf2 => generated 247 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:19:53.781334 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66cae26-6791-41e9-a2c4-087d69438253 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:19:53.795868 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:19:53.846980 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61e23ff-28fb-4732-a302-0284aa17d364 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:19:53.878820 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66cae26-6791-41e9-a2c4-087d69438253 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:19:53.880120 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d2561c-f8bd-4378-9b11-776a30b271ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:19:53.880911 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d2561c-f8bd-4378-9b11-776a30b271ad None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:19:53.881200 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d2561c-f8bd-4378-9b11-776a30b271ad None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:19:53.881472 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d2561c-f8bd-4378-9b11-776a30b271ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:19:53.899262 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d2561c-f8bd-4378-9b11-776a30b271ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:19:53.900758 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d2561c-f8bd-4378-9b11-776a30b271ad None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:19:53.911185 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ab489e-e535-407d-87d6-02f909330f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:19:53.912000 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ab489e-e535-407d-87d6-02f909330f87 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:19:53.912343 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ab489e-e535-407d-87d6-02f909330f87 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:19:53.912619 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ab489e-e535-407d-87d6-02f909330f87 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:19:53.913803 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ab489e-e535-407d-87d6-02f909330f87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:19:53.915270 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ab489e-e535-407d-87d6-02f909330f87 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:19:53.916894 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 10/18] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jun 7 14:19:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:19:53.921609 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-58d2561c-f8bd-4378-9b11-776a30b271ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:19:53.921609 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:19:53.921609 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:19:53.921609 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:19:53.921609 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:19:53.921609 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:19:53.921609 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:19:53.921609 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:19:53.921609 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:19:53.921609 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:19:53.921609 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:19:53.921609 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:19:53.921609 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:19:53.921609 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:19:53.921609 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:19:53.922389 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:19:53.922389 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:19:53.922389 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:19:53.922389 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:19:53.922389 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:19:53.922389 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:19:53.922389 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:19:53.922389 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:19:53.922389 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jun 07 14:19:53.922389 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:19:53.922389 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:19:53.922389 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:19:53.922389 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:19:53.922389 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:19:53.922389 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:19:53.922389 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:19:53.922389 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:19:53.923161 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:19:53.923161 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:19:53.923161 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:19:53.923161 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:19:53.923356 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ab489e-e535-407d-87d6-02f909330f87 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:19:53.923419 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 9/19] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jun 7 14:19:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 14:19:53.928957 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d2561c-f8bd-4378-9b11-776a30b271ad None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:19:53.983814 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:19:54.001122 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:19:54.019838 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ab489e-e535-407d-87d6-02f909330f87 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:19:54.026616 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d2561c-f8bd-4378-9b11-776a30b271ad None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:19:54.053357 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74d50fc-0853-46e7-a76f-ebc1f08e6cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:19:54.054011 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74d50fc-0853-46e7-a76f-ebc1f08e6cd7 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:19:54.054298 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74d50fc-0853-46e7-a76f-ebc1f08e6cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:19:54.054579 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74d50fc-0853-46e7-a76f-ebc1f08e6cd7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:19:54.055408 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74d50fc-0853-46e7-a76f-ebc1f08e6cd7 None admin] RBAC: Adding query filter params (role.id=e3bf6239f5bf477b965704b086786f11, scope.domain.id=default, user.id=5e52b7dc1f3e460b87cf6e04ac06baf2) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:19:54.055721 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74d50fc-0853-46e7-a76f-ebc1f08e6cd7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:19:54.057197 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74d50fc-0853-46e7-a76f-ebc1f08e6cd7 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:19:54.060423 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9adf60-34f3-4814-89f3-edc85f785fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:19:54.061082 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9adf60-34f3-4814-89f3-edc85f785fae None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:19:54.061506 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9adf60-34f3-4814-89f3-edc85f785fae None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:19:54.061646 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9adf60-34f3-4814-89f3-edc85f785fae None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:19:54.062356 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9adf60-34f3-4814-89f3-edc85f785fae None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:19:54.062661 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9adf60-34f3-4814-89f3-edc85f785fae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:19:54.064079 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9adf60-34f3-4814-89f3-edc85f785fae None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:19:54.064554 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 11/20] 10.222.0.86 () {56 vars in 1322 bytes} [Tue Jun 7 14:19:53 2022] GET /identity/v3/role_assignments?user.id=5e52b7dc1f3e460b87cf6e04ac06baf2&scope.domain.id=default&role.id=e3bf6239f5bf477b965704b086786f11 => generated 233 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:19:54.082904 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 10/21] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jun 7 14:19:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:19:56.667524 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd773163-db88-444f-9c0a-2e0834539848 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:19:56.668353 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd773163-db88-444f-9c0a-2e0834539848 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:19:56.668353 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd773163-db88-444f-9c0a-2e0834539848 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:19:56.669720 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 12/22] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:19:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:19:56.675651 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40446a3f-c35c-429c-87a9-a84197b31060 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:19:56.676074 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40446a3f-c35c-429c-87a9-a84197b31060 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:19:56.676241 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40446a3f-c35c-429c-87a9-a84197b31060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:19:56.701521 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-40446a3f-c35c-429c-87a9-a84197b31060 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:19:56.702735 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-40446a3f-c35c-429c-87a9-a84197b31060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:19:56.793321 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 11/23] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:19:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 14:19:56.811196 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cadb787-62d6-4cbb-ae40-9c71ae14d480 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:19:56.811485 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cadb787-62d6-4cbb-ae40-9c71ae14d480 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:19:56.811789 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cadb787-62d6-4cbb-ae40-9c71ae14d480 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:19:56.813149 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 13/24] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:19:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:19:56.819251 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc93d13-7bcb-4293-874f-e07379d8d3c0 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:19:56.819551 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc93d13-7bcb-4293-874f-e07379d8d3c0 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:19:56.819878 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc93d13-7bcb-4293-874f-e07379d8d3c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:19:56.827974 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cadb787-62d6-4cbb-ae40-9c71ae14d480 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:19:56.872755 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-7cc93d13-7bcb-4293-874f-e07379d8d3c0 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:19:56.874112 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-7cc93d13-7bcb-4293-874f-e07379d8d3c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:19:56.974996 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:19:57.031368 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 12/25] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:19:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 14:19:57.050952 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cadb787-62d6-4cbb-ae40-9c71ae14d480 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:19:57.061809 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc93d13-7bcb-4293-874f-e07379d8d3c0 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:19:57.102133 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9fa0eb-7040-4ab7-acca-033b77c6003c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:19:57.103379 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9fa0eb-7040-4ab7-acca-033b77c6003c None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:19:57.103673 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9fa0eb-7040-4ab7-acca-033b77c6003c None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:19:57.103974 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9fa0eb-7040-4ab7-acca-033b77c6003c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:19:57.124131 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9fa0eb-7040-4ab7-acca-033b77c6003c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:19:57.142386 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-bb9fa0eb-7040-4ab7-acca-033b77c6003c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 14:19:57.142386 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:19:57.142386 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:19:57.142386 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:19:57.142386 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:19:57.142386 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:19:57.142386 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:19:57.142386 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:19:57.142386 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:19:57.142386 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:19:57.142386 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:19:57.142386 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:19:57.142386 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:19:57.142386 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:19:57.142386 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:19:57.142386 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:19:57.144068 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:19:57.144068 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:19:57.144068 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:19:57.144068 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:19:57.144068 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:19:57.144068 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:19:57.144068 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:19:57.144068 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:19:57.144068 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:19:57.144068 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:19:57.144068 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:19:57.144068 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jun 07 14:19:57.144068 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:19:57.144068 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:19:57.144068 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:19:57.144068 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:19:57.145002 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:19:57.145002 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:19:57.145002 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:19:57.145002 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:19:57.145002 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:19:57.145002 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:19:57.145002 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:19:57.145002 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:19:57.145002 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:19:57.145002 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:19:57.145002 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 14:19:57.145002 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:19:57.149936 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 14/26] 10.222.0.86 () {56 vars in 1096 bytes} [Tue Jun 7 14:19:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:19:57.155544 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9fa0eb-7040-4ab7-acca-033b77c6003c None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:19:57.177719 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:19:57.265919 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc93d13-7bcb-4293-874f-e07379d8d3c0 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:19:57.304970 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a0cdbd-e2e4-408f-ae1b-a3d419ac6980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:19:57.305931 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a0cdbd-e2e4-408f-ae1b-a3d419ac6980 None admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:19:57.306220 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a0cdbd-e2e4-408f-ae1b-a3d419ac6980 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:19:57.306503 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a0cdbd-e2e4-408f-ae1b-a3d419ac6980 None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:19:57.307276 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a0cdbd-e2e4-408f-ae1b-a3d419ac6980 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:19:57.311459 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a0cdbd-e2e4-408f-ae1b-a3d419ac6980 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:19:57.330671 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9fa0eb-7040-4ab7-acca-033b77c6003c None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:19:57.369027 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44705fe5-9b14-40b7-86fc-a4e2a91ff3d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:19:57.369794 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44705fe5-9b14-40b7-86fc-a4e2a91ff3d5 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:19:57.370089 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44705fe5-9b14-40b7-86fc-a4e2a91ff3d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:19:57.370374 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44705fe5-9b14-40b7-86fc-a4e2a91ff3d5 None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:19:57.371153 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44705fe5-9b14-40b7-86fc-a4e2a91ff3d5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:19:57.371469 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44705fe5-9b14-40b7-86fc-a4e2a91ff3d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:19:57.373057 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44705fe5-9b14-40b7-86fc-a4e2a91ff3d5 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:19:57.384222 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 15/27] 10.222.0.86 () {56 vars in 1099 bytes} [Tue Jun 7 14:19:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:19:57.385380 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f380dd-234c-4237-b529-dad4a7a8194c None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:19:57.385773 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f380dd-234c-4237-b529-dad4a7a8194c None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:19:57.386063 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f380dd-234c-4237-b529-dad4a7a8194c None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:19:57.387503 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 16/28] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:19:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:19:57.392178 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f380dd-234c-4237-b529-dad4a7a8194c None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:19:57.490816 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:19:57.529857 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f380dd-234c-4237-b529-dad4a7a8194c None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:19:57.571004 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 13/29] 10.222.0.86 () {60 vars in 1131 bytes} [Tue Jun 7 14:19:57 2022] POST /identity/v3/roles => generated 219 bytes in 510 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 14:19:57.572562 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e257d1f4-324b-4197-ad4e-edb10b36ecec None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:19:57.572855 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e257d1f4-324b-4197-ad4e-edb10b36ecec None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:19:57.573133 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e257d1f4-324b-4197-ad4e-edb10b36ecec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:19:57.582238 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3334d89-6cc4-445b-bc2f-ce88a43b85b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:19:57.583161 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3334d89-6cc4-445b-bc2f-ce88a43b85b1 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:19:57.583445 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3334d89-6cc4-445b-bc2f-ce88a43b85b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:19:57.583720 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3334d89-6cc4-445b-bc2f-ce88a43b85b1 None admin] PATH_INFO: `/v3/users/5e52b7dc1f3e460b87cf6e04ac06baf2` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:19:57.585467 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3334d89-6cc4-445b-bc2f-ce88a43b85b1 None admin] RBAC: Authorizing `identity:get_user(user_id=5e52b7dc1f3e460b87cf6e04ac06baf2)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:19:57.586983 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3334d89-6cc4-445b-bc2f-ce88a43b85b1 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:19:57.588775 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 17/30] 10.222.0.86 () {56 vars in 1177 bytes} [Tue Jun 7 14:19:57 2022] GET /identity/v3/users/5e52b7dc1f3e460b87cf6e04ac06baf2 => generated 247 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:19:57.596682 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3334d89-6cc4-445b-bc2f-ce88a43b85b1 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:19:57.628296 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-e257d1f4-324b-4197-ad4e-edb10b36ecec None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:19:57.629881 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-e257d1f4-324b-4197-ad4e-edb10b36ecec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:19:57.711307 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:19:57.790418 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3334d89-6cc4-445b-bc2f-ce88a43b85b1 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:19:57.803428 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 14/31] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:19:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 14:19:57.806934 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6849f368-36f0-4ab3-a614-0849267c5b1a None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:19:57.806934 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6849f368-36f0-4ab3-a614-0849267c5b1a None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:19:57.806934 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6849f368-36f0-4ab3-a614-0849267c5b1a None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:19:57.807177 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 15/32] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:19:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:19:57.812572 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04dc600-f9e6-4bf9-ba0b-ba5c9a6a780f None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:19:57.813182 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04dc600-f9e6-4bf9-ba0b-ba5c9a6a780f None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:19:57.813625 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04dc600-f9e6-4bf9-ba0b-ba5c9a6a780f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:19:57.841544 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-e04dc600-f9e6-4bf9-ba0b-ba5c9a6a780f None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:19:57.842773 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-e04dc600-f9e6-4bf9-ba0b-ba5c9a6a780f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:19:57.851400 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ad5931-acee-40b6-b68c-e4521d698dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:19:57.852467 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ad5931-acee-40b6-b68c-e4521d698dcc None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:19:57.852890 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ad5931-acee-40b6-b68c-e4521d698dcc None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:19:57.853304 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ad5931-acee-40b6-b68c-e4521d698dcc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:19:57.855036 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ad5931-acee-40b6-b68c-e4521d698dcc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:19:57.857885 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ad5931-acee-40b6-b68c-e4521d698dcc None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:19:57.863959 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 18/33] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jun 7 14:19:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:19:57.865042 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ad5931-acee-40b6-b68c-e4521d698dcc None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:19:57.868259 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:19:57.932784 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 16/34] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:19:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 07 14:19:57.933920 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04dc600-f9e6-4bf9-ba0b-ba5c9a6a780f None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:19:57.998196 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ad5931-acee-40b6-b68c-e4521d698dcc None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:19:58.040533 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8035b7c8-017b-481b-9be0-3ff9532f0e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:19:58.041870 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8035b7c8-017b-481b-9be0-3ff9532f0e31 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:19:58.042362 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8035b7c8-017b-481b-9be0-3ff9532f0e31 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:19:58.043182 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8035b7c8-017b-481b-9be0-3ff9532f0e31 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:19:58.058897 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8035b7c8-017b-481b-9be0-3ff9532f0e31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:19:58.060864 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8035b7c8-017b-481b-9be0-3ff9532f0e31 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:19:58.063027 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:19:58.070894 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04dc600-f9e6-4bf9-ba0b-ba5c9a6a780f None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:19:58.084663 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-8035b7c8-017b-481b-9be0-3ff9532f0e31 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:19:58.084663 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:19:58.084663 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:19:58.084663 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:19:58.084663 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:19:58.084663 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:19:58.084663 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:19:58.084663 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:19:58.084663 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:19:58.084663 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:19:58.084663 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:19:58.084663 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:19:58.084663 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:19:58.084663 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:19:58.084663 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:19:58.085496 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:19:58.085496 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:19:58.085496 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:19:58.085496 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:19:58.085496 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:19:58.085496 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:19:58.085496 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:19:58.085496 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:19:58.085496 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jun 07 14:19:58.085496 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:19:58.085496 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:19:58.085496 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:19:58.085496 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:19:58.085496 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:19:58.085496 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:19:58.085496 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:19:58.085496 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:19:58.086300 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:19:58.086300 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:19:58.086300 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:19:58.086300 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:19:58.088466 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 19/35] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jun 7 14:19:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:19:58.090574 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8035b7c8-017b-481b-9be0-3ff9532f0e31 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:19:58.113751 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0813fb-eebe-491b-bdc8-2a61912533d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:19:58.114659 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0813fb-eebe-491b-bdc8-2a61912533d3 None admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:19:58.114950 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0813fb-eebe-491b-bdc8-2a61912533d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:19:58.115235 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0813fb-eebe-491b-bdc8-2a61912533d3 None admin] PATH_INFO: `/v3/domains/default/users/5e52b7dc1f3e460b87cf6e04ac06baf2/roles/e3bf6239f5bf477b965704b086786f11` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:19:58.118379 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0813fb-eebe-491b-bdc8-2a61912533d3 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=5e52b7dc1f3e460b87cf6e04ac06baf2, role_id=e3bf6239f5bf477b965704b086786f11)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:19:58.120008 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0813fb-eebe-491b-bdc8-2a61912533d3 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:19:58.156421 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:19:58.198668 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8035b7c8-017b-481b-9be0-3ff9532f0e31 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:19:58.221396 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 17/36] 10.222.0.86 () {58 vars in 1361 bytes} [Tue Jun 7 14:19:57 2022] PUT /identity/v3/domains/default/users/5e52b7dc1f3e460b87cf6e04ac06baf2/roles/e3bf6239f5bf477b965704b086786f11 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:19:58.232222 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0813fb-eebe-491b-bdc8-2a61912533d3 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:19:58.239955 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee20a019-ec02-429a-830a-fec8934790dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:19:58.240658 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee20a019-ec02-429a-830a-fec8934790dc None admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:19:58.240945 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee20a019-ec02-429a-830a-fec8934790dc None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:19:58.241262 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee20a019-ec02-429a-830a-fec8934790dc None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:19:58.242089 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee20a019-ec02-429a-830a-fec8934790dc None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:19:58.243673 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee20a019-ec02-429a-830a-fec8934790dc None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:19:58.358976 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0813fb-eebe-491b-bdc8-2a61912533d3 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:19:58.398048 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade74b0f-f79b-4fc6-b7c5-5496faac0138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:19:58.398730 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade74b0f-f79b-4fc6-b7c5-5496faac0138 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:19:58.399117 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade74b0f-f79b-4fc6-b7c5-5496faac0138 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:19:58.399404 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade74b0f-f79b-4fc6-b7c5-5496faac0138 None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:19:58.400180 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade74b0f-f79b-4fc6-b7c5-5496faac0138 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:19:58.400494 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade74b0f-f79b-4fc6-b7c5-5496faac0138 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:19:58.401899 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade74b0f-f79b-4fc6-b7c5-5496faac0138 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:19:58.419867 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 18/37] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jun 7 14:19:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:19:58.419867 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2a3c81-8129-4c9a-b03d-413331d03f4b None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:19:58.419867 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2a3c81-8129-4c9a-b03d-413331d03f4b None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:19:58.419867 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2a3c81-8129-4c9a-b03d-413331d03f4b None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:19:58.419867 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 19/38] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:19:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:19:58.420645 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd496b9-21dd-4d14-bf2e-60cd243dabee None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:19:58.422848 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd496b9-21dd-4d14-bf2e-60cd243dabee None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:19:58.422848 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd496b9-21dd-4d14-bf2e-60cd243dabee None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:19:58.423402 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 20/39] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:19:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:19:58.424964 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd496b9-21dd-4d14-bf2e-60cd243dabee None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:19:58.448537 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:19:58.449107 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 20/40] 10.222.0.86 () {60 vars in 1131 bytes} [Tue Jun 7 14:19:58 2022] POST /identity/v3/roles => generated 225 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:19:58.450455 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f372da-be31-4b02-a97d-0a9314177558 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:19:58.450748 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f372da-be31-4b02-a97d-0a9314177558 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:19:58.451031 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f372da-be31-4b02-a97d-0a9314177558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:19:58.470407 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-a7f372da-be31-4b02-a97d-0a9314177558 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:19:58.472079 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-a7f372da-be31-4b02-a97d-0a9314177558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:19:58.550901 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd496b9-21dd-4d14-bf2e-60cd243dabee None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:19:58.583204 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 21/41] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:19:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 14:19:58.585165 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288f704e-5552-4ca8-843d-7d35da489104 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:19:58.585465 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288f704e-5552-4ca8-843d-7d35da489104 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:19:58.585748 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288f704e-5552-4ca8-843d-7d35da489104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:19:58.596649 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ad8a7b-352e-4f79-a85d-3770514a6a89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:19:58.597113 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ad8a7b-352e-4f79-a85d-3770514a6a89 None admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:19:58.597398 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ad8a7b-352e-4f79-a85d-3770514a6a89 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:19:58.597676 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ad8a7b-352e-4f79-a85d-3770514a6a89 None admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:19:58.598424 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ad8a7b-352e-4f79-a85d-3770514a6a89 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:19:58.600024 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ad8a7b-352e-4f79-a85d-3770514a6a89 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:19:58.615199 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-288f704e-5552-4ca8-843d-7d35da489104 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:19:58.616395 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-288f704e-5552-4ca8-843d-7d35da489104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:19:58.669040 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:19:58.693454 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 22/42] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:19:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 14:19:58.694173 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288f704e-5552-4ca8-843d-7d35da489104 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:19:58.725394 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 21/43] 10.222.0.86 () {60 vars in 1141 bytes} [Tue Jun 7 14:19:58 2022] POST /identity/v3/projects => generated 301 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:19:58.726849 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ad8a7b-352e-4f79-a85d-3770514a6a89 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:19:58.819290 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288f704e-5552-4ca8-843d-7d35da489104 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:19:58.824641 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:19:58.863941 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4e1111-2bbf-4c4b-8a6b-587592685f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:19:58.865027 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4e1111-2bbf-4c4b-8a6b-587592685f55 None admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:19:58.865511 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4e1111-2bbf-4c4b-8a6b-587592685f55 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:19:58.866283 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4e1111-2bbf-4c4b-8a6b-587592685f55 None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:19:58.867486 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4e1111-2bbf-4c4b-8a6b-587592685f55 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:19:58.869962 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4e1111-2bbf-4c4b-8a6b-587592685f55 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:19:58.873234 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ad8a7b-352e-4f79-a85d-3770514a6a89 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:19:58.913564 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d5661f-f9ac-4595-89aa-5828d89ff282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:19:58.914504 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d5661f-f9ac-4595-89aa-5828d89ff282 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:19:58.914797 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d5661f-f9ac-4595-89aa-5828d89ff282 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:19:58.915076 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d5661f-f9ac-4595-89aa-5828d89ff282 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:19:58.916417 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d5661f-f9ac-4595-89aa-5828d89ff282 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:19:58.918295 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d5661f-f9ac-4595-89aa-5828d89ff282 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:19:58.920424 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 22/44] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jun 7 14:19:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:19:58.926339 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d5661f-f9ac-4595-89aa-5828d89ff282 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:19:58.995654 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 23/45] 10.222.0.86 () {60 vars in 1131 bytes} [Tue Jun 7 14:19:58 2022] POST /identity/v3/roles => generated 223 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:19:59.048609 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d5661f-f9ac-4595-89aa-5828d89ff282 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:19:59.086524 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4ac036-6053-4774-a675-a078e32ab210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:19:59.087207 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4ac036-6053-4774-a675-a078e32ab210 None admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:19:59.087494 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4ac036-6053-4774-a675-a078e32ab210 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:19:59.087797 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4ac036-6053-4774-a675-a078e32ab210 None admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:19:59.088535 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4ac036-6053-4774-a675-a078e32ab210 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:19:59.090083 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4ac036-6053-4774-a675-a078e32ab210 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:19:59.095321 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:19:59.199428 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 23/46] 10.222.0.86 () {60 vars in 1141 bytes} [Tue Jun 7 14:19:58 2022] POST /identity/v3/projects => generated 312 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:20:00.531880 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74123988-bf5e-4174-851d-3046eecb89f1 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:00.532403 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74123988-bf5e-4174-851d-3046eecb89f1 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:00.532484 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74123988-bf5e-4174-851d-3046eecb89f1 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:00.534495 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 24/47] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:20:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:20:00.539889 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08583431-c46b-42e5-8b73-a68fdf118fc0 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:00.540298 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08583431-c46b-42e5-8b73-a68fdf118fc0 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:00.540448 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08583431-c46b-42e5-8b73-a68fdf118fc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:00.556814 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-08583431-c46b-42e5-8b73-a68fdf118fc0 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:20:00.557985 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-08583431-c46b-42e5-8b73-a68fdf118fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:20:00.621070 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 24/48] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:20:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 14:20:00.644662 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74123988-bf5e-4174-851d-3046eecb89f1 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:00.681070 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:00.745605 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74123988-bf5e-4174-851d-3046eecb89f1 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:00.778370 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0635a0-7890-48d3-a117-6e828d4b476f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:00.779176 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0635a0-7890-48d3-a117-6e828d4b476f None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:00.779481 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0635a0-7890-48d3-a117-6e828d4b476f None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:00.780036 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0635a0-7890-48d3-a117-6e828d4b476f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:00.790724 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0635a0-7890-48d3-a117-6e828d4b476f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:20:00.798685 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-fc0635a0-7890-48d3-a117-6e828d4b476f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 14:20:00.798685 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:20:00.798685 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:20:00.798685 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:20:00.798685 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:20:00.798685 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:20:00.798685 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:20:00.798685 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:20:00.798685 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:20:00.798685 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:20:00.798685 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:20:00.798685 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:20:00.798685 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:20:00.798685 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:20:00.798685 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:20:00.798685 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:20:00.799545 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:20:00.799545 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:20:00.799545 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:20:00.799545 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:20:00.799545 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:20:00.799545 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:20:00.799545 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:20:00.799545 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:20:00.799545 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:20:00.799545 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:20:00.799545 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:20:00.799545 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jun 07 14:20:00.799545 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:20:00.799545 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:20:00.799545 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:20:00.799545 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:20:00.800502 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:20:00.800502 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:20:00.800502 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:20:00.800502 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:20:00.800502 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:20:00.800502 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:20:00.800502 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:20:00.800502 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:20:00.800502 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:20:00.800502 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:20:00.800502 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 14:20:00.800502 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:20:00.800502 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 25/49] 10.222.0.86 () {56 vars in 1096 bytes} [Tue Jun 7 14:20:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:20:00.805657 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08583431-c46b-42e5-8b73-a68fdf118fc0 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:00.902860 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08583431-c46b-42e5-8b73-a68fdf118fc0 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:00.920384 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:00.936998 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af96e915-9f09-47bc-8932-52faec0761f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:00.937668 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af96e915-9f09-47bc-8932-52faec0761f9 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:00.937952 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af96e915-9f09-47bc-8932-52faec0761f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:00.938226 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af96e915-9f09-47bc-8932-52faec0761f9 None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:00.938970 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af96e915-9f09-47bc-8932-52faec0761f9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:20:00.939274 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af96e915-9f09-47bc-8932-52faec0761f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:00.940680 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af96e915-9f09-47bc-8932-52faec0761f9 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:00.952463 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 25/50] 10.222.0.86 () {56 vars in 1099 bytes} [Tue Jun 7 14:20:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:00.957750 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0635a0-7890-48d3-a117-6e828d4b476f None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:01.050602 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:01.057168 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0635a0-7890-48d3-a117-6e828d4b476f None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:01.089223 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632e9606-c195-4000-912b-21eb547b4a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:01.090099 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632e9606-c195-4000-912b-21eb547b4a83 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:01.090390 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632e9606-c195-4000-912b-21eb547b4a83 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:01.090666 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632e9606-c195-4000-912b-21eb547b4a83 None admin] PATH_INFO: `/v3/users/5e52b7dc1f3e460b87cf6e04ac06baf2` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:01.091884 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632e9606-c195-4000-912b-21eb547b4a83 None admin] RBAC: Authorizing `identity:get_user(user_id=5e52b7dc1f3e460b87cf6e04ac06baf2)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:01.093341 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632e9606-c195-4000-912b-21eb547b4a83 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:01.094988 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 26/51] 10.222.0.86 () {56 vars in 1177 bytes} [Tue Jun 7 14:20:00 2022] GET /identity/v3/users/5e52b7dc1f3e460b87cf6e04ac06baf2 => generated 247 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:01.101088 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af96e915-9f09-47bc-8932-52faec0761f9 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:01.201175 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af96e915-9f09-47bc-8932-52faec0761f9 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:01.235431 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e83da70-40e2-4f41-891c-d190bbeb4a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:01.236263 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e83da70-40e2-4f41-891c-d190bbeb4a62 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:01.236548 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e83da70-40e2-4f41-891c-d190bbeb4a62 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:01.236854 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e83da70-40e2-4f41-891c-d190bbeb4a62 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:01.238030 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e83da70-40e2-4f41-891c-d190bbeb4a62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:01.239538 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e83da70-40e2-4f41-891c-d190bbeb4a62 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:01.241329 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 26/52] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jun 7 14:20:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:01.246830 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632e9606-c195-4000-912b-21eb547b4a83 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:01.343701 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632e9606-c195-4000-912b-21eb547b4a83 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:01.375384 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93547c87-bfa8-43e6-baa0-95eb41b65a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:01.376067 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93547c87-bfa8-43e6-baa0-95eb41b65a3e None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:01.376355 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93547c87-bfa8-43e6-baa0-95eb41b65a3e None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:01.377269 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93547c87-bfa8-43e6-baa0-95eb41b65a3e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:01.378086 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93547c87-bfa8-43e6-baa0-95eb41b65a3e None admin] RBAC: Adding query filter params (role.id=e3bf6239f5bf477b965704b086786f11, scope.domain.id=default, user.id=5e52b7dc1f3e460b87cf6e04ac06baf2) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:20:01.378395 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93547c87-bfa8-43e6-baa0-95eb41b65a3e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:01.379868 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93547c87-bfa8-43e6-baa0-95eb41b65a3e None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:01.385599 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 27/53] 10.222.0.86 () {56 vars in 1322 bytes} [Tue Jun 7 14:20:01 2022] GET /identity/v3/role_assignments?user.id=5e52b7dc1f3e460b87cf6e04ac06baf2&scope.domain.id=default&role.id=e3bf6239f5bf477b965704b086786f11 => generated 530 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:01.441781 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd20890b-4fc3-48cd-b35d-ae2cd03d7b71 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:01.442186 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd20890b-4fc3-48cd-b35d-ae2cd03d7b71 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:01.442537 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd20890b-4fc3-48cd-b35d-ae2cd03d7b71 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:01.444082 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 27/54] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:20:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:20:01.450040 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dc4591-baec-4fc8-9a19-7eb128a3ed8d None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:01.450338 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dc4591-baec-4fc8-9a19-7eb128a3ed8d None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:01.450618 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dc4591-baec-4fc8-9a19-7eb128a3ed8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:01.468564 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-70dc4591-baec-4fc8-9a19-7eb128a3ed8d None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:20:01.469799 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-70dc4591-baec-4fc8-9a19-7eb128a3ed8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:20:01.492199 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:01.540434 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 28/55] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:20:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 14:20:01.564511 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd20890b-4fc3-48cd-b35d-ae2cd03d7b71 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:01.616870 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:01.668342 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd20890b-4fc3-48cd-b35d-ae2cd03d7b71 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:01.701176 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab9b3c1-1b64-40ef-8fbc-e74775d84621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:01.701967 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab9b3c1-1b64-40ef-8fbc-e74775d84621 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:01.702257 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab9b3c1-1b64-40ef-8fbc-e74775d84621 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:01.702539 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab9b3c1-1b64-40ef-8fbc-e74775d84621 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:01.703731 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab9b3c1-1b64-40ef-8fbc-e74775d84621 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:01.705212 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab9b3c1-1b64-40ef-8fbc-e74775d84621 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:01.706828 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 28/56] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jun 7 14:20:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:01.712469 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dc4591-baec-4fc8-9a19-7eb128a3ed8d None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:01.807682 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dc4591-baec-4fc8-9a19-7eb128a3ed8d None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:01.839540 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30377bd7-1a88-4c47-9c0d-804c38d40ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:01.840217 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30377bd7-1a88-4c47-9c0d-804c38d40ac8 None admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:01.840506 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30377bd7-1a88-4c47-9c0d-804c38d40ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:01.840786 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30377bd7-1a88-4c47-9c0d-804c38d40ac8 None admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:01.841497 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30377bd7-1a88-4c47-9c0d-804c38d40ac8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:01.842944 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30377bd7-1a88-4c47-9c0d-804c38d40ac8 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:01.963543 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 29/57] 10.222.0.86 () {60 vars in 1140 bytes} [Tue Jun 7 14:20:01 2022] POST /identity/v3/projects => generated 298 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:20:04.171124 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eba1ea-edbe-4c94-8cd0-0e056ed81944 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:04.171640 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eba1ea-edbe-4c94-8cd0-0e056ed81944 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:04.171840 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eba1ea-edbe-4c94-8cd0-0e056ed81944 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:04.173242 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 29/58] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:20:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:20:04.178442 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4767528e-f0ed-4f29-9054-8dfa3905c3d4 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:04.178825 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4767528e-f0ed-4f29-9054-8dfa3905c3d4 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:04.179010 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4767528e-f0ed-4f29-9054-8dfa3905c3d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:04.195251 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-4767528e-f0ed-4f29-9054-8dfa3905c3d4 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:20:04.196467 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-4767528e-f0ed-4f29-9054-8dfa3905c3d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:20:04.198408 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:04.262255 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 30/59] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:20:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 14:20:04.287688 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eba1ea-edbe-4c94-8cd0-0e056ed81944 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:04.386709 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eba1ea-edbe-4c94-8cd0-0e056ed81944 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:04.402923 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:04.420660 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a30a690-9057-448b-a22b-d3a90dc9ff43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:04.421487 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a30a690-9057-448b-a22b-d3a90dc9ff43 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:04.421728 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a30a690-9057-448b-a22b-d3a90dc9ff43 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:04.422009 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a30a690-9057-448b-a22b-d3a90dc9ff43 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:04.423282 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a30a690-9057-448b-a22b-d3a90dc9ff43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:04.424800 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a30a690-9057-448b-a22b-d3a90dc9ff43 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:04.426397 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 30/60] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jun 7 14:20:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:04.431648 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4767528e-f0ed-4f29-9054-8dfa3905c3d4 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:04.525986 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4767528e-f0ed-4f29-9054-8dfa3905c3d4 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:04.557911 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97abd42e-cb19-4948-8bf8-7e58a0ae93d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:04.558565 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97abd42e-cb19-4948-8bf8-7e58a0ae93d7 None admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:04.558852 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97abd42e-cb19-4948-8bf8-7e58a0ae93d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:04.559135 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97abd42e-cb19-4948-8bf8-7e58a0ae93d7 None admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:04.559876 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97abd42e-cb19-4948-8bf8-7e58a0ae93d7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:04.561309 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97abd42e-cb19-4948-8bf8-7e58a0ae93d7 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:04.574130 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:04.688415 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 31/61] 10.222.0.86 () {60 vars in 1132 bytes} [Tue Jun 7 14:20:04 2022] POST /identity/v3/users => generated 275 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:20:08.195085 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a561e5-f201-4a0b-ab4c-4b6252b1b853 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:08.196260 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a561e5-f201-4a0b-ab4c-4b6252b1b853 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:08.196763 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a561e5-f201-4a0b-ab4c-4b6252b1b853 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:08.198505 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 31/62] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:20:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:20:08.208570 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaf763c-a789-4b37-8c0b-59097c166557 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:08.209587 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaf763c-a789-4b37-8c0b-59097c166557 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:08.210077 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaf763c-a789-4b37-8c0b-59097c166557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:08.232874 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-5eaf763c-a789-4b37-8c0b-59097c166557 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:20:08.234167 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-5eaf763c-a789-4b37-8c0b-59097c166557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:20:08.249469 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83510ded-c80e-4fd6-9e46-37f458da753e None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:08.249766 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83510ded-c80e-4fd6-9e46-37f458da753e None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:08.250053 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83510ded-c80e-4fd6-9e46-37f458da753e None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:08.253842 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 32/63] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:20:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:20:08.258990 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b52dc0-8ef1-460a-a7b8-b7ca7b4332a7 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:08.259284 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b52dc0-8ef1-460a-a7b8-b7ca7b4332a7 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:08.259570 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b52dc0-8ef1-460a-a7b8-b7ca7b4332a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:08.290922 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-92b52dc0-8ef1-460a-a7b8-b7ca7b4332a7 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:20:08.292199 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-92b52dc0-8ef1-460a-a7b8-b7ca7b4332a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:20:08.348255 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 32/64] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:20:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 14:20:08.372295 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaf763c-a789-4b37-8c0b-59097c166557 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:08.427868 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 33/65] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:20:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 14:20:08.429276 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff488a4e-d1a1-464c-b5d7-f8421fa4c628 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:08.429571 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff488a4e-d1a1-464c-b5d7-f8421fa4c628 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:08.429857 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff488a4e-d1a1-464c-b5d7-f8421fa4c628 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:08.431463 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 34/66] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:20:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:20:08.450565 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1774fcf8-d8de-481f-bc9d-7326681ba1c2 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:08.450783 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1774fcf8-d8de-481f-bc9d-7326681ba1c2 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:08.451071 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1774fcf8-d8de-481f-bc9d-7326681ba1c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:08.473077 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-1774fcf8-d8de-481f-bc9d-7326681ba1c2 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:20:08.474521 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-1774fcf8-d8de-481f-bc9d-7326681ba1c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:20:08.481382 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaf763c-a789-4b37-8c0b-59097c166557 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:08.507410 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:08.519365 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b59277-2e0c-4772-a9c3-aa6be7751e9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:08.523654 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b59277-2e0c-4772-a9c3-aa6be7751e9f None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:08.523654 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b59277-2e0c-4772-a9c3-aa6be7751e9f None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:08.523654 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b59277-2e0c-4772-a9c3-aa6be7751e9f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:08.533358 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b59277-2e0c-4772-a9c3-aa6be7751e9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:20:08.541456 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-07b59277-2e0c-4772-a9c3-aa6be7751e9f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 14:20:08.541456 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:20:08.541456 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:20:08.541456 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:20:08.541456 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:20:08.541456 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:20:08.541456 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:20:08.541456 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:20:08.541456 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:20:08.541456 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:20:08.541456 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:20:08.541456 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:20:08.541456 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:20:08.541456 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:20:08.541456 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:20:08.541456 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:20:08.542319 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:20:08.542319 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:20:08.542319 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:20:08.542319 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:20:08.542319 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:20:08.542319 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:20:08.542319 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:20:08.542319 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:20:08.542319 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:20:08.542319 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:20:08.542319 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:20:08.542319 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jun 07 14:20:08.542319 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:20:08.542319 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:20:08.542319 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:20:08.542319 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:20:08.543366 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:20:08.543366 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:20:08.543366 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:20:08.543366 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:20:08.543366 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:20:08.543366 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:20:08.543366 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:20:08.543366 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:20:08.543366 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:20:08.543366 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:20:08.543366 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 14:20:08.543366 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:20:08.547928 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 33/67] 10.222.0.86 () {56 vars in 1096 bytes} [Tue Jun 7 14:20:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 14:20:08.557990 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b59277-2e0c-4772-a9c3-aa6be7751e9f None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:08.558136 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 35/68] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:20:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 14:20:08.558136 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaa13e6-8385-47ce-a48c-4ed33efb5bcd None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:08.558136 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaa13e6-8385-47ce-a48c-4ed33efb5bcd None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:08.558557 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaa13e6-8385-47ce-a48c-4ed33efb5bcd None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:08.560059 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 36/69] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:20:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:20:08.560908 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaa13e6-8385-47ce-a48c-4ed33efb5bcd None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:08.613411 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:08.671265 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaa13e6-8385-47ce-a48c-4ed33efb5bcd None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:08.676317 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b59277-2e0c-4772-a9c3-aa6be7751e9f None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:08.705642 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6b5018-a632-42b6-ba50-e0fdf6bb4903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:08.706243 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b5018-a632-42b6-ba50-e0fdf6bb4903 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:08.706540 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b5018-a632-42b6-ba50-e0fdf6bb4903 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:08.706821 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b5018-a632-42b6-ba50-e0fdf6bb4903 None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:08.707573 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6b5018-a632-42b6-ba50-e0fdf6bb4903 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:20:08.707945 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6b5018-a632-42b6-ba50-e0fdf6bb4903 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:08.708859 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7581f0b-8305-4525-a4e2-39c647bfb790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:08.709334 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6b5018-a632-42b6-ba50-e0fdf6bb4903 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:08.709651 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7581f0b-8305-4525-a4e2-39c647bfb790 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:08.709937 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7581f0b-8305-4525-a4e2-39c647bfb790 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:08.710209 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7581f0b-8305-4525-a4e2-39c647bfb790 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:08.717204 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 37/70] 10.222.0.86 () {56 vars in 1099 bytes} [Tue Jun 7 14:20:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:08.718385 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f038e14-bc6d-451b-b4c4-8837cba38f34 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:08.718678 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f038e14-bc6d-451b-b4c4-8837cba38f34 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:08.718965 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f038e14-bc6d-451b-b4c4-8837cba38f34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:08.720697 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7581f0b-8305-4525-a4e2-39c647bfb790 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:20:08.728377 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-a7581f0b-8305-4525-a4e2-39c647bfb790 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 07 14:20:08.728377 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:20:08.728377 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:20:08.728377 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:20:08.728377 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:20:08.728377 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:20:08.728377 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:20:08.728377 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:20:08.728377 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:20:08.728377 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:20:08.728377 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:20:08.728377 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:20:08.728377 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:20:08.728377 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:20:08.728377 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:20:08.728377 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:20:08.729414 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:20:08.729414 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:20:08.729414 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:20:08.729414 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:20:08.729414 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:20:08.729414 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:20:08.729414 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:20:08.729414 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:20:08.729414 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:20:08.729414 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:20:08.729414 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:20:08.729414 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jun 07 14:20:08.729414 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:20:08.729414 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:20:08.729414 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:20:08.729414 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:20:08.730358 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:20:08.730358 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:20:08.730358 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:20:08.730358 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:20:08.730358 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:20:08.730358 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:20:08.730358 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:20:08.730358 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:20:08.730358 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:20:08.730358 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:20:08.730358 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 07 14:20:08.730358 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:20:08.730358 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 34/71] 10.222.0.86 () {56 vars in 1099 bytes} [Tue Jun 7 14:20:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:20:08.730358 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7581f0b-8305-4525-a4e2-39c647bfb790 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:08.736890 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-9f038e14-bc6d-451b-b4c4-8837cba38f34 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:20:08.738088 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-9f038e14-bc6d-451b-b4c4-8837cba38f34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:20:08.774463 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:08.804812 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 38/72] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:20:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 14:20:08.806134 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66559afa-74cd-485f-a10c-5bbf9187de8a None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:08.806431 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66559afa-74cd-485f-a10c-5bbf9187de8a None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:08.806715 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66559afa-74cd-485f-a10c-5bbf9187de8a None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:08.808047 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 39/73] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:20:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:20:08.811887 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66559afa-74cd-485f-a10c-5bbf9187de8a None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:08.839276 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7581f0b-8305-4525-a4e2-39c647bfb790 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:08.849724 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:08.872817 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ae3889-8b1f-4617-b7eb-d67c6bab117a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:08.873631 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ae3889-8b1f-4617-b7eb-d67c6bab117a None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:08.873923 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ae3889-8b1f-4617-b7eb-d67c6bab117a None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:08.874204 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ae3889-8b1f-4617-b7eb-d67c6bab117a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:08.884946 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ae3889-8b1f-4617-b7eb-d67c6bab117a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:20:08.893134 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-29ae3889-8b1f-4617-b7eb-d67c6bab117a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 07 14:20:08.893134 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:20:08.893134 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:20:08.893134 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:20:08.893134 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:20:08.893134 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:20:08.893134 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:20:08.893134 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:20:08.893134 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:20:08.893134 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:20:08.893134 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:20:08.893134 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:20:08.893134 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:20:08.893134 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:20:08.893134 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:20:08.893134 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:20:08.894069 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:20:08.894069 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:20:08.894069 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:20:08.894069 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:20:08.894069 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:20:08.894069 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:20:08.894069 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:20:08.894069 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:20:08.894069 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:20:08.894069 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:20:08.894069 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:20:08.894069 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jun 07 14:20:08.894069 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:20:08.894069 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:20:08.894069 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:20:08.894069 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:20:08.895096 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:20:08.895096 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:20:08.895096 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:20:08.895096 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:20:08.895096 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:20:08.895096 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:20:08.895096 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:20:08.895096 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:20:08.895096 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:20:08.895096 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:20:08.895096 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 07 14:20:08.895096 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:20:08.895096 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 35/74] 10.222.0.86 () {56 vars in 1114 bytes} [Tue Jun 7 14:20:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:20:08.895096 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ae3889-8b1f-4617-b7eb-d67c6bab117a None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:08.919633 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66559afa-74cd-485f-a10c-5bbf9187de8a None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:08.953251 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cd12ae-d730-4caf-89cb-57f1b1a9b2ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:08.954117 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cd12ae-d730-4caf-89cb-57f1b1a9b2ec None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:08.954425 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cd12ae-d730-4caf-89cb-57f1b1a9b2ec None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:08.954701 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cd12ae-d730-4caf-89cb-57f1b1a9b2ec None admin] PATH_INFO: `/v3/users/5e52b7dc1f3e460b87cf6e04ac06baf2` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:08.955974 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cd12ae-d730-4caf-89cb-57f1b1a9b2ec None admin] RBAC: Authorizing `identity:get_user(user_id=5e52b7dc1f3e460b87cf6e04ac06baf2)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:08.957344 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cd12ae-d730-4caf-89cb-57f1b1a9b2ec None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:08.959166 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 40/75] 10.222.0.86 () {56 vars in 1177 bytes} [Tue Jun 7 14:20:08 2022] GET /identity/v3/users/5e52b7dc1f3e460b87cf6e04ac06baf2 => generated 247 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:08.960094 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ea7ee3-16be-4fbe-a10f-851053613ffe None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:08.960380 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ea7ee3-16be-4fbe-a10f-851053613ffe None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:08.960654 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ea7ee3-16be-4fbe-a10f-851053613ffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:08.976009 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-35ea7ee3-16be-4fbe-a10f-851053613ffe None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:20:08.977179 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-35ea7ee3-16be-4fbe-a10f-851053613ffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:20:08.994299 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ae3889-8b1f-4617-b7eb-d67c6bab117a None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:08.996601 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:09.027283 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec20969-d9c0-49b4-b07d-23dbc99f22b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:09.027985 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec20969-d9c0-49b4-b07d-23dbc99f22b4 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:09.028286 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec20969-d9c0-49b4-b07d-23dbc99f22b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:09.028573 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec20969-d9c0-49b4-b07d-23dbc99f22b4 None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:09.029326 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec20969-d9c0-49b4-b07d-23dbc99f22b4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:20:09.029641 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec20969-d9c0-49b4-b07d-23dbc99f22b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:09.031073 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec20969-d9c0-49b4-b07d-23dbc99f22b4 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:09.040527 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 36/76] 10.222.0.86 () {56 vars in 1101 bytes} [Tue Jun 7 14:20:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:09.041354 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec20969-d9c0-49b4-b07d-23dbc99f22b4 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:09.041497 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 41/77] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:20:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 14:20:09.049194 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ea7ee3-16be-4fbe-a10f-851053613ffe None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:09.084453 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:09.139973 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec20969-d9c0-49b4-b07d-23dbc99f22b4 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:09.150237 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ea7ee3-16be-4fbe-a10f-851053613ffe None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:09.172771 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8ff101-2643-4333-a052-97a4feff90fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:09.173584 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8ff101-2643-4333-a052-97a4feff90fc None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:09.173869 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8ff101-2643-4333-a052-97a4feff90fc None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:09.174146 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8ff101-2643-4333-a052-97a4feff90fc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:09.175318 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8ff101-2643-4333-a052-97a4feff90fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:09.176794 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8ff101-2643-4333-a052-97a4feff90fc None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:09.178411 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 37/78] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jun 7 14:20:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:09.179168 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8ff101-2643-4333-a052-97a4feff90fc None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:09.183580 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c87667-35e4-422e-8665-939ca049f9d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:09.184286 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c87667-35e4-422e-8665-939ca049f9d9 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:09.184574 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c87667-35e4-422e-8665-939ca049f9d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:09.184856 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c87667-35e4-422e-8665-939ca049f9d9 None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:09.185607 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c87667-35e4-422e-8665-939ca049f9d9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:20:09.185921 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c87667-35e4-422e-8665-939ca049f9d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:09.187291 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c87667-35e4-422e-8665-939ca049f9d9 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:09.196125 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 42/79] 10.222.0.86 () {56 vars in 1111 bytes} [Tue Jun 7 14:20:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:09.196824 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c87667-35e4-422e-8665-939ca049f9d9 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:09.216711 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:09.280880 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8ff101-2643-4333-a052-97a4feff90fc None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:09.290245 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:09.296580 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c87667-35e4-422e-8665-939ca049f9d9 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:09.314349 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83df1805-8f39-4e4c-8091-f63234126166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:09.315007 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83df1805-8f39-4e4c-8091-f63234126166 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:09.315301 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83df1805-8f39-4e4c-8091-f63234126166 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:09.315580 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83df1805-8f39-4e4c-8091-f63234126166 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:09.330179 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac961c04-ce66-4d8c-b3d1-68e983a2bbda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:09.331049 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac961c04-ce66-4d8c-b3d1-68e983a2bbda None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:09.331339 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac961c04-ce66-4d8c-b3d1-68e983a2bbda None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:09.331622 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac961c04-ce66-4d8c-b3d1-68e983a2bbda None admin] PATH_INFO: `/v3/users/a453037a2b4a425fa2238ee5e0d74396` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:09.346140 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac961c04-ce66-4d8c-b3d1-68e983a2bbda None admin] RBAC: Authorizing `identity:get_user(user_id=a453037a2b4a425fa2238ee5e0d74396)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:09.347604 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac961c04-ce66-4d8c-b3d1-68e983a2bbda None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:09.349316 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 43/80] 10.222.0.86 () {56 vars in 1177 bytes} [Tue Jun 7 14:20:09 2022] GET /identity/v3/users/a453037a2b4a425fa2238ee5e0d74396 => generated 275 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:09.350111 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac961c04-ce66-4d8c-b3d1-68e983a2bbda None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:09.385378 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83df1805-8f39-4e4c-8091-f63234126166 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:09.386849 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83df1805-8f39-4e4c-8091-f63234126166 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:09.417326 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:09.448638 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac961c04-ce66-4d8c-b3d1-68e983a2bbda None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:09.481690 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 38/81] 10.222.0.86 () {58 vars in 1282 bytes} [Tue Jun 7 14:20:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 07 14:20:09.482044 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6071b2b6-1731-427b-b7a8-4e45bb21a7ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:09.482437 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83df1805-8f39-4e4c-8091-f63234126166 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:09.482859 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6071b2b6-1731-427b-b7a8-4e45bb21a7ed None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:09.483149 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6071b2b6-1731-427b-b7a8-4e45bb21a7ed None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:09.483430 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6071b2b6-1731-427b-b7a8-4e45bb21a7ed None admin] PATH_INFO: `/v3/roles/member` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:09.496065 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6071b2b6-1731-427b-b7a8-4e45bb21a7ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:20:09.505738 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-6071b2b6-1731-427b-b7a8-4e45bb21a7ed None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 07 14:20:09.505738 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:20:09.505738 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:20:09.505738 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:20:09.505738 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:20:09.505738 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:20:09.505738 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:20:09.505738 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:20:09.505738 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:20:09.505738 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:20:09.505738 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:20:09.505738 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:20:09.505738 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:20:09.505738 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:20:09.505738 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:20:09.505738 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:20:09.506748 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:20:09.506748 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:20:09.506748 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:20:09.506748 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:20:09.506748 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:20:09.506748 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:20:09.506748 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:20:09.506748 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:20:09.506748 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:20:09.506748 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:20:09.506748 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:20:09.506748 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jun 07 14:20:09.506748 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:20:09.506748 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:20:09.506748 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:20:09.506748 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:20:09.507706 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:20:09.507706 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:20:09.507706 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:20:09.507706 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:20:09.507706 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:20:09.507706 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:20:09.507706 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:20:09.507706 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:20:09.507706 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:20:09.507706 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:20:09.507706 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 07 14:20:09.507706 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:20:09.507706 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 44/82] 10.222.0.86 () {56 vars in 1099 bytes} [Tue Jun 7 14:20:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:20:09.507706 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6071b2b6-1731-427b-b7a8-4e45bb21a7ed None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:09.524222 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:09.583580 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83df1805-8f39-4e4c-8091-f63234126166 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:09.608085 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6071b2b6-1731-427b-b7a8-4e45bb21a7ed None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:09.616683 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6c85a9-2f6c-4dbe-abe2-04150270b4b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:09.617354 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6c85a9-2f6c-4dbe-abe2-04150270b4b7 None admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:09.617645 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6c85a9-2f6c-4dbe-abe2-04150270b4b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:09.617929 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6c85a9-2f6c-4dbe-abe2-04150270b4b7 None admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:09.618645 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6c85a9-2f6c-4dbe-abe2-04150270b4b7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:09.620121 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6c85a9-2f6c-4dbe-abe2-04150270b4b7 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:09.626640 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:09.643720 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06e0265-d76e-4da8-a18f-1fae1a46f0d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:09.644620 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06e0265-d76e-4da8-a18f-1fae1a46f0d4 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:09.644909 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06e0265-d76e-4da8-a18f-1fae1a46f0d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:09.645195 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06e0265-d76e-4da8-a18f-1fae1a46f0d4 None admin] PATH_INFO: `/v3/users/a453037a2b4a425fa2238ee5e0d74396` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:09.646394 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06e0265-d76e-4da8-a18f-1fae1a46f0d4 None admin] RBAC: Authorizing `identity:get_user(user_id=a453037a2b4a425fa2238ee5e0d74396)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:09.647892 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06e0265-d76e-4da8-a18f-1fae1a46f0d4 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:09.649525 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 45/83] 10.222.0.86 () {56 vars in 1177 bytes} [Tue Jun 7 14:20:09 2022] GET /identity/v3/users/a453037a2b4a425fa2238ee5e0d74396 => generated 275 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:09.650337 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06e0265-d76e-4da8-a18f-1fae1a46f0d4 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:09.682904 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 39/84] 10.222.0.86 () {60 vars in 1132 bytes} [Tue Jun 7 14:20:09 2022] POST /identity/v3/users => generated 289 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:20:09.683745 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6c85a9-2f6c-4dbe-abe2-04150270b4b7 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:09.750397 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:09.771379 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06e0265-d76e-4da8-a18f-1fae1a46f0d4 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:09.797852 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6c85a9-2f6c-4dbe-abe2-04150270b4b7 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:09.809868 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0297bc-07ca-456e-beab-3f5fac1e18ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:09.810542 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0297bc-07ca-456e-beab-3f5fac1e18ec None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:09.810889 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0297bc-07ca-456e-beab-3f5fac1e18ec None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:09.811200 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0297bc-07ca-456e-beab-3f5fac1e18ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:09.837644 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdfa72d-23a3-49dc-91d3-37a58618e564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:09.838519 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdfa72d-23a3-49dc-91d3-37a58618e564 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:09.838806 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdfa72d-23a3-49dc-91d3-37a58618e564 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:09.839085 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdfa72d-23a3-49dc-91d3-37a58618e564 None admin] PATH_INFO: `/v3/projects/3cd4810e72844bb58991b6fc44dacec5` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:09.840430 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdfa72d-23a3-49dc-91d3-37a58618e564 None admin] RBAC: Authorizing `identity:get_project(project_id=3cd4810e72844bb58991b6fc44dacec5)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:09.841926 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdfa72d-23a3-49dc-91d3-37a58618e564 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:09.843807 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 40/85] 10.222.0.86 () {56 vars in 1186 bytes} [Tue Jun 7 14:20:09 2022] GET /identity/v3/projects/3cd4810e72844bb58991b6fc44dacec5 => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:09.849927 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdfa72d-23a3-49dc-91d3-37a58618e564 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:09.923459 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0297bc-07ca-456e-beab-3f5fac1e18ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:09.925008 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0297bc-07ca-456e-beab-3f5fac1e18ec None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:09.949183 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:10.007726 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdfa72d-23a3-49dc-91d3-37a58618e564 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:10.037302 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:10.049698 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a0212c-b961-400c-9557-b6caa638cad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:10.050455 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a0212c-b961-400c-9557-b6caa638cad8 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:10.050707 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a0212c-b961-400c-9557-b6caa638cad8 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:10.051173 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a0212c-b961-400c-9557-b6caa638cad8 None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:10.051877 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a0212c-b961-400c-9557-b6caa638cad8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:20:10.052139 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a0212c-b961-400c-9557-b6caa638cad8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:10.053499 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a0212c-b961-400c-9557-b6caa638cad8 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:10.060567 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 46/86] 10.222.0.86 () {58 vars in 1282 bytes} [Tue Jun 7 14:20:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 07 14:20:10.061351 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0297bc-07ca-456e-beab-3f5fac1e18ec None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:10.064313 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 41/87] 10.222.0.86 () {56 vars in 1101 bytes} [Tue Jun 7 14:20:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:10.065151 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a0212c-b961-400c-9557-b6caa638cad8 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:10.174594 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0297bc-07ca-456e-beab-3f5fac1e18ec None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:10.180118 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a0212c-b961-400c-9557-b6caa638cad8 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:10.205025 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:10.214679 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b16134e-90b6-4245-9811-5a861eefc7b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:10.215354 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b16134e-90b6-4245-9811-5a861eefc7b7 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:10.216077 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b16134e-90b6-4245-9811-5a861eefc7b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:10.216077 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b16134e-90b6-4245-9811-5a861eefc7b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:10.222950 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9541af58-6254-45aa-bcb9-81dd61c0121d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:10.224335 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9541af58-6254-45aa-bcb9-81dd61c0121d None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:10.224798 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9541af58-6254-45aa-bcb9-81dd61c0121d None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:10.225855 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9541af58-6254-45aa-bcb9-81dd61c0121d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:10.226868 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9541af58-6254-45aa-bcb9-81dd61c0121d None admin] RBAC: Adding query filter params (role.id=e3bf6239f5bf477b965704b086786f11, scope.project.id=3cd4810e72844bb58991b6fc44dacec5, user.id=5e52b7dc1f3e460b87cf6e04ac06baf2) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:20:10.227358 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9541af58-6254-45aa-bcb9-81dd61c0121d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:10.231491 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9541af58-6254-45aa-bcb9-81dd61c0121d None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:10.239111 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 42/88] 10.222.0.86 () {56 vars in 1374 bytes} [Tue Jun 7 14:20:10 2022] GET /identity/v3/role_assignments?user.id=5e52b7dc1f3e460b87cf6e04ac06baf2&scope.project.id=3cd4810e72844bb58991b6fc44dacec5&role.id=e3bf6239f5bf477b965704b086786f11 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:10.240227 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9541af58-6254-45aa-bcb9-81dd61c0121d None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:10.323098 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:10.345863 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b16134e-90b6-4245-9811-5a861eefc7b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:10.347888 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b16134e-90b6-4245-9811-5a861eefc7b7 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:10.370298 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9541af58-6254-45aa-bcb9-81dd61c0121d None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:10.412570 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17447c36-d7d2-4f75-b734-ef99fda14c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:10.413947 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17447c36-d7d2-4f75-b734-ef99fda14c91 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:10.414245 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17447c36-d7d2-4f75-b734-ef99fda14c91 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:10.414557 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17447c36-d7d2-4f75-b734-ef99fda14c91 None admin] PATH_INFO: `/v3/users/a453037a2b4a425fa2238ee5e0d74396` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:10.415903 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17447c36-d7d2-4f75-b734-ef99fda14c91 None admin] RBAC: Authorizing `identity:get_user(user_id=a453037a2b4a425fa2238ee5e0d74396)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:10.417765 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17447c36-d7d2-4f75-b734-ef99fda14c91 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:10.421320 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 43/89] 10.222.0.86 () {56 vars in 1177 bytes} [Tue Jun 7 14:20:10 2022] GET /identity/v3/users/a453037a2b4a425fa2238ee5e0d74396 => generated 275 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:10.421320 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17447c36-d7d2-4f75-b734-ef99fda14c91 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:10.484488 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:10.536933 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17447c36-d7d2-4f75-b734-ef99fda14c91 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:10.576293 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 47/90] 10.222.0.86 () {58 vars in 1282 bytes} [Tue Jun 7 14:20:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 515 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 07 14:20:10.576953 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b16134e-90b6-4245-9811-5a861eefc7b7 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:10.595712 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142f01d5-18e3-45c0-a7c2-d8a3dc14791f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:10.596637 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142f01d5-18e3-45c0-a7c2-d8a3dc14791f None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:10.596931 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142f01d5-18e3-45c0-a7c2-d8a3dc14791f None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:10.597214 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142f01d5-18e3-45c0-a7c2-d8a3dc14791f None admin] PATH_INFO: `/v3/projects/3cd4810e72844bb58991b6fc44dacec5` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:10.599051 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142f01d5-18e3-45c0-a7c2-d8a3dc14791f None admin] RBAC: Authorizing `identity:get_project(project_id=3cd4810e72844bb58991b6fc44dacec5)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:10.600879 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142f01d5-18e3-45c0-a7c2-d8a3dc14791f None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:10.604095 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 44/91] 10.222.0.86 () {56 vars in 1186 bytes} [Tue Jun 7 14:20:10 2022] GET /identity/v3/projects/3cd4810e72844bb58991b6fc44dacec5 => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:10.604878 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142f01d5-18e3-45c0-a7c2-d8a3dc14791f None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:10.718960 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:10.754406 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b16134e-90b6-4245-9811-5a861eefc7b7 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:10.792222 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142f01d5-18e3-45c0-a7c2-d8a3dc14791f None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:10.819769 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07de010-a5f3-46cc-8d5f-7f892861bddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:10.820434 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07de010-a5f3-46cc-8d5f-7f892861bddf None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:10.820725 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07de010-a5f3-46cc-8d5f-7f892861bddf None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:10.821007 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07de010-a5f3-46cc-8d5f-7f892861bddf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:10.830617 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:10.862846 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f606a1-76c5-4bd3-81a0-16fc496deb48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:10.863722 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f606a1-76c5-4bd3-81a0-16fc496deb48 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:10.864035 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f606a1-76c5-4bd3-81a0-16fc496deb48 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:10.864316 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f606a1-76c5-4bd3-81a0-16fc496deb48 None admin] PATH_INFO: `/v3/projects/3cd4810e72844bb58991b6fc44dacec5` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:10.865747 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f606a1-76c5-4bd3-81a0-16fc496deb48 None admin] RBAC: Authorizing `identity:get_project(project_id=3cd4810e72844bb58991b6fc44dacec5)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:10.868802 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f606a1-76c5-4bd3-81a0-16fc496deb48 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:10.870998 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 45/92] 10.222.0.86 () {56 vars in 1186 bytes} [Tue Jun 7 14:20:10 2022] GET /identity/v3/projects/3cd4810e72844bb58991b6fc44dacec5 => generated 298 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:10.872045 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f606a1-76c5-4bd3-81a0-16fc496deb48 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:10.923403 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07de010-a5f3-46cc-8d5f-7f892861bddf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:10.924912 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07de010-a5f3-46cc-8d5f-7f892861bddf None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:10.989675 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f606a1-76c5-4bd3-81a0-16fc496deb48 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:11.050516 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c5732e-2072-45e8-b7d0-433d0d58e779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:11.051196 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c5732e-2072-45e8-b7d0-433d0d58e779 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:11.051484 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c5732e-2072-45e8-b7d0-433d0d58e779 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:11.051780 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c5732e-2072-45e8-b7d0-433d0d58e779 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:11.052629 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c5732e-2072-45e8-b7d0-433d0d58e779 None admin] RBAC: Adding query filter params (role.id=c17acc2a8bb348f59ba7edd22fcf0c47, scope.project.id=3cd4810e72844bb58991b6fc44dacec5, user.id=a453037a2b4a425fa2238ee5e0d74396) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:20:11.052949 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c5732e-2072-45e8-b7d0-433d0d58e779 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:11.054390 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c5732e-2072-45e8-b7d0-433d0d58e779 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:11.070368 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 46/93] 10.222.0.86 () {56 vars in 1374 bytes} [Tue Jun 7 14:20:10 2022] GET /identity/v3/role_assignments?user.id=a453037a2b4a425fa2238ee5e0d74396&scope.project.id=3cd4810e72844bb58991b6fc44dacec5&role.id=c17acc2a8bb348f59ba7edd22fcf0c47 => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:11.073310 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c5732e-2072-45e8-b7d0-433d0d58e779 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:11.089979 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:11.134280 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 48/94] 10.222.0.86 () {58 vars in 1282 bytes} [Tue Jun 7 14:20:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 557 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 07 14:20:11.139652 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07de010-a5f3-46cc-8d5f-7f892861bddf None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:11.174685 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:11.230667 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c5732e-2072-45e8-b7d0-433d0d58e779 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:11.280119 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9624db-7695-4598-9d54-cccfafc23560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:11.280901 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9624db-7695-4598-9d54-cccfafc23560 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:11.281199 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9624db-7695-4598-9d54-cccfafc23560 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:11.281486 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9624db-7695-4598-9d54-cccfafc23560 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:11.282873 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9624db-7695-4598-9d54-cccfafc23560 None admin] RBAC: Adding query filter params (role.id=a2755a2b621b4e969fd366f0035d672b, scope.project.id=3cd4810e72844bb58991b6fc44dacec5, user.id=a453037a2b4a425fa2238ee5e0d74396) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:20:11.283195 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9624db-7695-4598-9d54-cccfafc23560 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:11.284800 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9624db-7695-4598-9d54-cccfafc23560 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:11.291422 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 47/95] 10.222.0.86 () {56 vars in 1374 bytes} [Tue Jun 7 14:20:11 2022] GET /identity/v3/role_assignments?user.id=a453037a2b4a425fa2238ee5e0d74396&scope.project.id=3cd4810e72844bb58991b6fc44dacec5&role.id=a2755a2b621b4e969fd366f0035d672b => generated 259 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:11.297042 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07de010-a5f3-46cc-8d5f-7f892861bddf None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:11.339337 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a19be0-a5a5-4d5f-b723-dd823a603feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:11.340478 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a19be0-a5a5-4d5f-b723-dd823a603feb None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:11.340713 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a19be0-a5a5-4d5f-b723-dd823a603feb None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:11.340994 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a19be0-a5a5-4d5f-b723-dd823a603feb None admin] PATH_INFO: `/v3/projects/dd1d9739ff9648cfaa8cc32f1b6552e3` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:11.342306 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a19be0-a5a5-4d5f-b723-dd823a603feb None admin] RBAC: Authorizing `identity:get_project(project_id=dd1d9739ff9648cfaa8cc32f1b6552e3)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:11.343830 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a19be0-a5a5-4d5f-b723-dd823a603feb None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:11.345855 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 49/96] 10.222.0.86 () {56 vars in 1186 bytes} [Tue Jun 7 14:20:11 2022] GET /identity/v3/projects/dd1d9739ff9648cfaa8cc32f1b6552e3 => generated 312 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:11.352004 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9624db-7695-4598-9d54-cccfafc23560 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:11.486439 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9624db-7695-4598-9d54-cccfafc23560 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:11.504907 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:11.527293 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e3f971-43cd-4e97-b3b9-1c47ff4aff0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:11.528350 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e3f971-43cd-4e97-b3b9-1c47ff4aff0b None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:11.528818 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e3f971-43cd-4e97-b3b9-1c47ff4aff0b None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:11.529297 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e3f971-43cd-4e97-b3b9-1c47ff4aff0b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:11.530328 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e3f971-43cd-4e97-b3b9-1c47ff4aff0b None admin] RBAC: Adding query filter params (role.id=c17acc2a8bb348f59ba7edd22fcf0c47, scope.project.id=dd1d9739ff9648cfaa8cc32f1b6552e3, user.id=a453037a2b4a425fa2238ee5e0d74396) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:20:11.530833 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e3f971-43cd-4e97-b3b9-1c47ff4aff0b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:11.536258 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e3f971-43cd-4e97-b3b9-1c47ff4aff0b None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:11.544316 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 48/97] 10.222.0.86 () {56 vars in 1374 bytes} [Tue Jun 7 14:20:11 2022] GET /identity/v3/role_assignments?user.id=a453037a2b4a425fa2238ee5e0d74396&scope.project.id=dd1d9739ff9648cfaa8cc32f1b6552e3&role.id=c17acc2a8bb348f59ba7edd22fcf0c47 => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:12.629711 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b94846f-6d01-4029-83b0-a7b2bba5186f None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:12.630256 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b94846f-6d01-4029-83b0-a7b2bba5186f None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:12.630331 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b94846f-6d01-4029-83b0-a7b2bba5186f None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:12.632073 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 50/98] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:20:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:20:12.649729 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1725880f-9601-4f20-bc28-e4511263fe15 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:12.650725 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1725880f-9601-4f20-bc28-e4511263fe15 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:12.651215 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1725880f-9601-4f20-bc28-e4511263fe15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:12.676748 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-1725880f-9601-4f20-bc28-e4511263fe15 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:20:12.678239 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-1725880f-9601-4f20-bc28-e4511263fe15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:20:12.772632 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 49/99] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:20:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 14:20:12.813110 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b94846f-6d01-4029-83b0-a7b2bba5186f None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:12.909627 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:12.932781 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1b37f7-2841-4f90-b8e1-283cb1e8ad9a None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:12.933537 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1b37f7-2841-4f90-b8e1-283cb1e8ad9a None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:12.934176 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1b37f7-2841-4f90-b8e1-283cb1e8ad9a None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:12.937067 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 50/100] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:20:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:20:12.950444 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaf6d28-1e5a-4e34-91ef-9eaced06f05b None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:12.951021 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaf6d28-1e5a-4e34-91ef-9eaced06f05b None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:12.951520 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaf6d28-1e5a-4e34-91ef-9eaced06f05b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:12.996353 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-fcaf6d28-1e5a-4e34-91ef-9eaced06f05b None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:20:12.998229 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-fcaf6d28-1e5a-4e34-91ef-9eaced06f05b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:20:13.034797 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b94846f-6d01-4029-83b0-a7b2bba5186f None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:13.103952 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdeab5d-2a36-44d5-8332-f1a55146553f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:13.105092 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdeab5d-2a36-44d5-8332-f1a55146553f None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:13.105599 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdeab5d-2a36-44d5-8332-f1a55146553f None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:13.106085 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdeab5d-2a36-44d5-8332-f1a55146553f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:13.108254 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdeab5d-2a36-44d5-8332-f1a55146553f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:13.112075 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdeab5d-2a36-44d5-8332-f1a55146553f None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:13.122371 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 51/101] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jun 7 14:20:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:13.140398 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdeab5d-2a36-44d5-8332-f1a55146553f None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:13.146128 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 51/102] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:20:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 07 14:20:13.192917 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c7cef1-f680-44b4-a22b-98cd94ae3e47 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:13.193186 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c7cef1-f680-44b4-a22b-98cd94ae3e47 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:13.193478 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c7cef1-f680-44b4-a22b-98cd94ae3e47 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:13.195059 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 52/103] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:20:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 07 14:20:13.202566 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c7cef1-f680-44b4-a22b-98cd94ae3e47 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:13.282549 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdeab5d-2a36-44d5-8332-f1a55146553f None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:13.293999 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:13.303630 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:13.327472 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe6668d-e8a0-4013-a01a-41f47f0ff034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:13.329297 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe6668d-e8a0-4013-a01a-41f47f0ff034 None admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:13.329590 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe6668d-e8a0-4013-a01a-41f47f0ff034 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:13.329873 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe6668d-e8a0-4013-a01a-41f47f0ff034 None admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:13.330592 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe6668d-e8a0-4013-a01a-41f47f0ff034 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:13.333816 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe6668d-e8a0-4013-a01a-41f47f0ff034 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:13.388779 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c7cef1-f680-44b4-a22b-98cd94ae3e47 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:13.423632 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2f0a43-9197-4ba4-8450-39fa786ecadf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:13.424558 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2f0a43-9197-4ba4-8450-39fa786ecadf None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:13.427052 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2f0a43-9197-4ba4-8450-39fa786ecadf None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:13.433416 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 52/104] 10.222.0.86 () {60 vars in 1141 bytes} [Tue Jun 7 14:20:13 2022] POST /identity/v3/projects => generated 302 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 14:20:13.434832 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8e0e33-2e54-4d05-98bc-7eb20bafc146 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:13.435133 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8e0e33-2e54-4d05-98bc-7eb20bafc146 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:13.435464 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8e0e33-2e54-4d05-98bc-7eb20bafc146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:13.435865 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2f0a43-9197-4ba4-8450-39fa786ecadf None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:13.462683 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2f0a43-9197-4ba4-8450-39fa786ecadf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:20:13.470980 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-1b8e0e33-2e54-4d05-98bc-7eb20bafc146 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:20:13.472239 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-1b8e0e33-2e54-4d05-98bc-7eb20bafc146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:20:13.479356 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-cd2f0a43-9197-4ba4-8450-39fa786ecadf None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 07 14:20:13.479356 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:20:13.479356 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:20:13.479356 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:20:13.479356 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:20:13.479356 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:20:13.479356 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:20:13.479356 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:20:13.479356 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:20:13.479356 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:20:13.479356 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:20:13.479356 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:20:13.479356 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:20:13.479356 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:20:13.479356 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:20:13.479356 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:20:13.480393 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:20:13.480393 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:20:13.480393 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:20:13.480393 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:20:13.480393 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:20:13.480393 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:20:13.480393 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:20:13.480393 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:20:13.480393 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:20:13.480393 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:20:13.480393 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:20:13.480393 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jun 07 14:20:13.480393 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:20:13.480393 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:20:13.480393 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:20:13.480393 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:20:13.481384 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:20:13.481384 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:20:13.481384 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:20:13.481384 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:20:13.481384 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:20:13.481384 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:20:13.481384 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:20:13.481384 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:20:13.481384 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:20:13.481384 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:20:13.481384 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 07 14:20:13.481384 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:20:13.481384 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 53/105] 10.222.0.86 () {56 vars in 1099 bytes} [Tue Jun 7 14:20:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 14:20:13.490398 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2f0a43-9197-4ba4-8450-39fa786ecadf None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:13.632252 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:13.637309 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2f0a43-9197-4ba4-8450-39fa786ecadf None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:13.653229 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 53/106] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:20:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 14:20:13.691554 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bef9032-ccdf-4a1a-bec0-1a57343302bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:13.692274 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bef9032-ccdf-4a1a-bec0-1a57343302bc None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:13.692953 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bef9032-ccdf-4a1a-bec0-1a57343302bc None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:13.693310 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bef9032-ccdf-4a1a-bec0-1a57343302bc None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:13.694156 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bef9032-ccdf-4a1a-bec0-1a57343302bc None admin] RBAC: Adding query filter params (name=reader) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:20:13.694483 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bef9032-ccdf-4a1a-bec0-1a57343302bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:13.696020 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bef9032-ccdf-4a1a-bec0-1a57343302bc None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:13.706073 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 54/107] 10.222.0.86 () {56 vars in 1101 bytes} [Tue Jun 7 14:20:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:13.711733 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8e0e33-2e54-4d05-98bc-7eb20bafc146 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:13.733389 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bef9032-ccdf-4a1a-bec0-1a57343302bc None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:13.880089 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:13.884141 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8e0e33-2e54-4d05-98bc-7eb20bafc146 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:13.923143 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d387671-04b4-4372-9dd9-eb3100492212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:13.924092 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d387671-04b4-4372-9dd9-eb3100492212 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:13.924378 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d387671-04b4-4372-9dd9-eb3100492212 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:13.924663 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d387671-04b4-4372-9dd9-eb3100492212 None admin] PATH_INFO: `/v3/users/35094e5446044635bb90baf80fccdf18` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:13.929318 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bef9032-ccdf-4a1a-bec0-1a57343302bc None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:13.940569 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d387671-04b4-4372-9dd9-eb3100492212 None admin] RBAC: Authorizing `identity:get_user(user_id=35094e5446044635bb90baf80fccdf18)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:13.941930 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d387671-04b4-4372-9dd9-eb3100492212 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:13.944150 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 54/108] 10.222.0.86 () {56 vars in 1177 bytes} [Tue Jun 7 14:20:13 2022] GET /identity/v3/users/35094e5446044635bb90baf80fccdf18 => generated 289 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:13.949740 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d387671-04b4-4372-9dd9-eb3100492212 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:13.979592 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfd17f1-ddcc-4b07-84e2-7032e7ab50d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:13.980859 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfd17f1-ddcc-4b07-84e2-7032e7ab50d8 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:13.981361 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfd17f1-ddcc-4b07-84e2-7032e7ab50d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:13.981850 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfd17f1-ddcc-4b07-84e2-7032e7ab50d8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:13.997611 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfd17f1-ddcc-4b07-84e2-7032e7ab50d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:20:14.009966 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-7bfd17f1-ddcc-4b07-84e2-7032e7ab50d8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 14:20:14.009966 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:20:14.009966 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:20:14.009966 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:20:14.009966 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:20:14.009966 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:20:14.009966 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:20:14.009966 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:20:14.009966 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:20:14.009966 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:20:14.009966 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:20:14.009966 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:20:14.009966 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:20:14.009966 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:20:14.009966 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:20:14.009966 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:20:14.010921 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:20:14.010921 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:20:14.010921 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:20:14.010921 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:20:14.010921 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:20:14.010921 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:20:14.010921 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:20:14.010921 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:20:14.010921 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:20:14.010921 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:20:14.010921 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:20:14.010921 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jun 07 14:20:14.010921 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:20:14.010921 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:20:14.010921 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:20:14.010921 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:20:14.011670 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:20:14.011670 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:20:14.011670 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:20:14.011670 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:20:14.011670 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:20:14.011670 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:20:14.011670 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:20:14.011670 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:20:14.011670 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:20:14.011670 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:20:14.011670 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 14:20:14.011670 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:20:14.014078 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 55/109] 10.222.0.86 () {56 vars in 1096 bytes} [Tue Jun 7 14:20:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:20:14.021864 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfd17f1-ddcc-4b07-84e2-7032e7ab50d8 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:14.053866 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:14.072031 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d387671-04b4-4372-9dd9-eb3100492212 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:14.111562 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053d67d8-214e-40b1-b009-b434c6eb0cba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:14.112574 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053d67d8-214e-40b1-b009-b434c6eb0cba None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:14.113008 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053d67d8-214e-40b1-b009-b434c6eb0cba None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:14.113469 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053d67d8-214e-40b1-b009-b434c6eb0cba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:14.145621 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:14.160624 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfd17f1-ddcc-4b07-84e2-7032e7ab50d8 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:14.214108 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053d67d8-214e-40b1-b009-b434c6eb0cba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:14.215942 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33773be5-20e3-42da-867c-0ef89275f1d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:14.216077 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053d67d8-214e-40b1-b009-b434c6eb0cba None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:14.216824 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33773be5-20e3-42da-867c-0ef89275f1d1 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:14.217214 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33773be5-20e3-42da-867c-0ef89275f1d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:14.217593 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33773be5-20e3-42da-867c-0ef89275f1d1 None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:14.218463 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33773be5-20e3-42da-867c-0ef89275f1d1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:20:14.218953 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33773be5-20e3-42da-867c-0ef89275f1d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:14.224665 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33773be5-20e3-42da-867c-0ef89275f1d1 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:14.244518 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 56/110] 10.222.0.86 () {56 vars in 1099 bytes} [Tue Jun 7 14:20:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:14.245679 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33773be5-20e3-42da-867c-0ef89275f1d1 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:14.361573 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:14.380117 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33773be5-20e3-42da-867c-0ef89275f1d1 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:14.418443 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 55/111] 10.222.0.86 () {58 vars in 1282 bytes} [Tue Jun 7 14:20:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 07 14:20:14.424287 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053d67d8-214e-40b1-b009-b434c6eb0cba None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:14.442355 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdf484b-fc58-409f-aecf-08736703319a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:14.443257 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdf484b-fc58-409f-aecf-08736703319a None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:14.443547 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdf484b-fc58-409f-aecf-08736703319a None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:14.443863 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdf484b-fc58-409f-aecf-08736703319a None admin] PATH_INFO: `/v3/users/5e52b7dc1f3e460b87cf6e04ac06baf2` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:14.446353 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdf484b-fc58-409f-aecf-08736703319a None admin] RBAC: Authorizing `identity:get_user(user_id=5e52b7dc1f3e460b87cf6e04ac06baf2)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:14.451316 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdf484b-fc58-409f-aecf-08736703319a None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:14.453193 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 57/112] 10.222.0.86 () {56 vars in 1177 bytes} [Tue Jun 7 14:20:14 2022] GET /identity/v3/users/5e52b7dc1f3e460b87cf6e04ac06baf2 => generated 247 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:14.455059 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c834a585-ff94-4dcf-8059-f2262a3d6384 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:14.455356 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c834a585-ff94-4dcf-8059-f2262a3d6384 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:14.455641 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c834a585-ff94-4dcf-8059-f2262a3d6384 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:14.459664 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 58/113] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:20:14 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:20:14.460446 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c834a585-ff94-4dcf-8059-f2262a3d6384 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:14.544683 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:14.616516 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053d67d8-214e-40b1-b009-b434c6eb0cba None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:14.653005 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c834a585-ff94-4dcf-8059-f2262a3d6384 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:14.674822 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bb80ed-1e5f-4292-9811-a47b811720ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:14.675850 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bb80ed-1e5f-4292-9811-a47b811720ba None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:14.676144 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bb80ed-1e5f-4292-9811-a47b811720ba None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:14.676422 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bb80ed-1e5f-4292-9811-a47b811720ba None admin] PATH_INFO: `/v3/projects/3cd4810e72844bb58991b6fc44dacec5` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:14.677674 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bb80ed-1e5f-4292-9811-a47b811720ba None admin] RBAC: Authorizing `identity:get_project(project_id=3cd4810e72844bb58991b6fc44dacec5)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:14.679521 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bb80ed-1e5f-4292-9811-a47b811720ba None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:14.681307 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 56/114] 10.222.0.86 () {56 vars in 1186 bytes} [Tue Jun 7 14:20:14 2022] GET /identity/v3/projects/3cd4810e72844bb58991b6fc44dacec5 => generated 298 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:14.682807 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddb3945-56f7-461f-ae79-2d993e75a4c3 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:14.683096 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddb3945-56f7-461f-ae79-2d993e75a4c3 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:14.683376 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddb3945-56f7-461f-ae79-2d993e75a4c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:14.697261 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a618086-cb66-4892-ab2b-adc9d8a92493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:14.698140 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a618086-cb66-4892-ab2b-adc9d8a92493 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:14.698431 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a618086-cb66-4892-ab2b-adc9d8a92493 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:14.698713 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a618086-cb66-4892-ab2b-adc9d8a92493 None admin] PATH_INFO: `/v3/projects/3cd4810e72844bb58991b6fc44dacec5` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:14.699976 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a618086-cb66-4892-ab2b-adc9d8a92493 None admin] RBAC: Authorizing `identity:get_project(project_id=3cd4810e72844bb58991b6fc44dacec5)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:14.701446 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a618086-cb66-4892-ab2b-adc9d8a92493 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:14.702686 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-1ddb3945-56f7-461f-ae79-2d993e75a4c3 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:20:14.703237 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 59/115] 10.222.0.86 () {56 vars in 1186 bytes} [Tue Jun 7 14:20:14 2022] GET /identity/v3/projects/3cd4810e72844bb58991b6fc44dacec5 => generated 298 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:14.705028 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-1ddb3945-56f7-461f-ae79-2d993e75a4c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:20:14.705137 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a548e2fd-1087-41d1-9b7a-4c61176b354b None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:14.705417 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a548e2fd-1087-41d1-9b7a-4c61176b354b None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:14.705716 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a548e2fd-1087-41d1-9b7a-4c61176b354b None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:14.706982 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 60/116] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:20:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:20:14.707692 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a548e2fd-1087-41d1-9b7a-4c61176b354b None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:14.737666 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:14.796923 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 57/117] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:20:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 14:20:14.797560 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddb3945-56f7-461f-ae79-2d993e75a4c3 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:14.846613 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a548e2fd-1087-41d1-9b7a-4c61176b354b None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:14.872003 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:14.883593 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c116a51-4bfe-4bf1-9185-0c289b968206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:14.884358 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c116a51-4bfe-4bf1-9185-0c289b968206 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:14.884649 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c116a51-4bfe-4bf1-9185-0c289b968206 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:14.889930 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c116a51-4bfe-4bf1-9185-0c289b968206 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:14.889930 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c116a51-4bfe-4bf1-9185-0c289b968206 None admin] RBAC: Adding query filter params (role.id=bce2bd9e8c164e7ca92ba5e110848be0, scope.project.id=3cd4810e72844bb58991b6fc44dacec5, user.id=35094e5446044635bb90baf80fccdf18) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:20:14.889930 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c116a51-4bfe-4bf1-9185-0c289b968206 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:14.889930 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c116a51-4bfe-4bf1-9185-0c289b968206 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:14.894351 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 61/118] 10.222.0.86 () {56 vars in 1374 bytes} [Tue Jun 7 14:20:14 2022] GET /identity/v3/role_assignments?user.id=35094e5446044635bb90baf80fccdf18&scope.project.id=3cd4810e72844bb58991b6fc44dacec5&role.id=bce2bd9e8c164e7ca92ba5e110848be0 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:14.895388 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bd0c70-7e76-4e23-bb17-d12550d97c57 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:14.895684 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bd0c70-7e76-4e23-bb17-d12550d97c57 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:14.896030 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bd0c70-7e76-4e23-bb17-d12550d97c57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:14.929956 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-b3bd0c70-7e76-4e23-bb17-d12550d97c57 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:20:14.932585 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-b3bd0c70-7e76-4e23-bb17-d12550d97c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:20:14.955927 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddb3945-56f7-461f-ae79-2d993e75a4c3 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:15.035158 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e5a934-edf5-4ed1-a3ba-0c39e8563f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:15.036198 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e5a934-edf5-4ed1-a3ba-0c39e8563f92 None admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:15.036539 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e5a934-edf5-4ed1-a3ba-0c39e8563f92 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:15.036826 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e5a934-edf5-4ed1-a3ba-0c39e8563f92 None admin] PATH_INFO: `/v3/projects/3cd4810e72844bb58991b6fc44dacec5/users/5e52b7dc1f3e460b87cf6e04ac06baf2/roles/e3bf6239f5bf477b965704b086786f11` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:15.040565 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e5a934-edf5-4ed1-a3ba-0c39e8563f92 None admin] RBAC: Authorizing `identity:create_grant(project_id=3cd4810e72844bb58991b6fc44dacec5, user_id=5e52b7dc1f3e460b87cf6e04ac06baf2, role_id=e3bf6239f5bf477b965704b086786f11)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:15.042561 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e5a934-edf5-4ed1-a3ba-0c39e8563f92 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:15.059351 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 62/119] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:20:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 14:20:15.065464 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bd0c70-7e76-4e23-bb17-d12550d97c57 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:15.087194 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:15.133868 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 58/120] 10.222.0.86 () {58 vars in 1439 bytes} [Tue Jun 7 14:20:14 2022] PUT /identity/v3/projects/3cd4810e72844bb58991b6fc44dacec5/users/5e52b7dc1f3e460b87cf6e04ac06baf2/roles/e3bf6239f5bf477b965704b086786f11 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:20:15.135051 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60344754-e7b0-4431-91c6-3b18398ae9bb None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:15.140262 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60344754-e7b0-4431-91c6-3b18398ae9bb None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:15.148600 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60344754-e7b0-4431-91c6-3b18398ae9bb None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:15.148600 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 59/121] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:20:15 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:20:15.148600 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60344754-e7b0-4431-91c6-3b18398ae9bb None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:15.197831 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bd0c70-7e76-4e23-bb17-d12550d97c57 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:15.240667 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52638843-a3e2-4469-916c-0ce268592f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:15.241505 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52638843-a3e2-4469-916c-0ce268592f10 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:15.241795 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52638843-a3e2-4469-916c-0ce268592f10 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:15.242075 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52638843-a3e2-4469-916c-0ce268592f10 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:15.261015 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52638843-a3e2-4469-916c-0ce268592f10 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:20:15.270064 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-52638843-a3e2-4469-916c-0ce268592f10 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 07 14:20:15.270064 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:20:15.270064 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:20:15.270064 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:20:15.270064 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:20:15.270064 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:20:15.270064 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:20:15.270064 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:20:15.270064 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:20:15.270064 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:20:15.270064 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:20:15.270064 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:20:15.270064 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:20:15.270064 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:20:15.270064 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:20:15.270064 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:20:15.270984 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:20:15.270984 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:20:15.270984 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:20:15.270984 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:20:15.270984 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:20:15.270984 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:20:15.270984 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:20:15.270984 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:20:15.270984 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:20:15.270984 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:20:15.270984 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:20:15.270984 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jun 07 14:20:15.270984 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:20:15.270984 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:20:15.270984 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:20:15.270984 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:20:15.271720 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:20:15.271720 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:20:15.271720 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:20:15.271720 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:20:15.271720 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:20:15.271720 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:20:15.271720 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:20:15.271720 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:20:15.271720 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:20:15.271720 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:20:15.271720 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 07 14:20:15.271720 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:20:15.271720 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 63/122] 10.222.0.86 () {56 vars in 1099 bytes} [Tue Jun 7 14:20:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:20:15.273174 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3687862-00ad-4850-bb75-e1f4553a3994 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:15.273281 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3687862-00ad-4850-bb75-e1f4553a3994 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:15.273522 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3687862-00ad-4850-bb75-e1f4553a3994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:15.293244 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-a3687862-00ad-4850-bb75-e1f4553a3994 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:20:15.294590 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-a3687862-00ad-4850-bb75-e1f4553a3994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:20:15.356020 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60344754-e7b0-4431-91c6-3b18398ae9bb None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:15.373505 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 64/123] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:20:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 14:20:15.374294 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3687862-00ad-4850-bb75-e1f4553a3994 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:15.378400 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:15.397214 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:15.452616 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2a27fe-845e-4508-9b0d-348c4c61ea84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:15.453499 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2a27fe-845e-4508-9b0d-348c4c61ea84 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:15.453826 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2a27fe-845e-4508-9b0d-348c4c61ea84 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:15.454730 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2a27fe-845e-4508-9b0d-348c4c61ea84 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:15.474419 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2a27fe-845e-4508-9b0d-348c4c61ea84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:20:15.483701 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-9c2a27fe-845e-4508-9b0d-348c4c61ea84 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 07 14:20:15.483701 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:20:15.483701 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:20:15.483701 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:20:15.483701 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:20:15.483701 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:20:15.483701 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:20:15.483701 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:20:15.483701 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:20:15.483701 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:20:15.483701 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:20:15.483701 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:20:15.483701 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:20:15.483701 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:20:15.483701 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:20:15.483701 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:20:15.484674 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:20:15.484674 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:20:15.484674 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:20:15.484674 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:20:15.484674 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:20:15.484674 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:20:15.484674 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:20:15.484674 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:20:15.484674 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:20:15.484674 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:20:15.484674 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:20:15.484674 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jun 07 14:20:15.484674 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:20:15.484674 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:20:15.484674 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:20:15.484674 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:20:15.486503 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:20:15.486503 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:20:15.486503 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:20:15.486503 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:20:15.486503 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:20:15.486503 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:20:15.486503 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:20:15.486503 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:20:15.486503 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:20:15.486503 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:20:15.486503 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 07 14:20:15.486503 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:20:15.486503 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 60/124] 10.222.0.86 () {56 vars in 1114 bytes} [Tue Jun 7 14:20:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:20:15.486503 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2a27fe-845e-4508-9b0d-348c4c61ea84 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:15.520904 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3687862-00ad-4850-bb75-e1f4553a3994 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:15.561235 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b016bc-312b-4c4f-99a2-11aa29d3655b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:15.562018 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b016bc-312b-4c4f-99a2-11aa29d3655b None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:15.562310 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b016bc-312b-4c4f-99a2-11aa29d3655b None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:15.562591 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b016bc-312b-4c4f-99a2-11aa29d3655b None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:15.563398 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b016bc-312b-4c4f-99a2-11aa29d3655b None admin] RBAC: Adding query filter params (name=member) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:20:15.564232 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b016bc-312b-4c4f-99a2-11aa29d3655b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:15.565832 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b016bc-312b-4c4f-99a2-11aa29d3655b None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:15.574722 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 65/125] 10.222.0.86 () {56 vars in 1101 bytes} [Tue Jun 7 14:20:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:15.575657 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b016bc-312b-4c4f-99a2-11aa29d3655b None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:15.630377 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2a27fe-845e-4508-9b0d-348c4c61ea84 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:15.645445 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:15.670399 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dda9a9-131a-4230-ba73-b01ae843f764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:15.671427 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dda9a9-131a-4230-ba73-b01ae843f764 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:15.671726 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dda9a9-131a-4230-ba73-b01ae843f764 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:15.672107 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dda9a9-131a-4230-ba73-b01ae843f764 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:15.682303 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b016bc-312b-4c4f-99a2-11aa29d3655b None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:15.686615 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dda9a9-131a-4230-ba73-b01ae843f764 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:20:15.696650 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-b6dda9a9-131a-4230-ba73-b01ae843f764 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 07 14:20:15.696650 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:20:15.696650 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:20:15.696650 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:20:15.696650 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:20:15.696650 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:20:15.696650 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:20:15.696650 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:20:15.696650 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:20:15.696650 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:20:15.696650 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:20:15.696650 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:20:15.696650 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:20:15.696650 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:20:15.696650 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:20:15.696650 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:20:15.697501 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:20:15.697501 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:20:15.697501 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:20:15.697501 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:20:15.697501 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:20:15.697501 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:20:15.697501 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:20:15.697501 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:20:15.697501 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:20:15.697501 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:20:15.697501 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:20:15.697501 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jun 07 14:20:15.697501 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:20:15.697501 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:20:15.697501 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:20:15.697501 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:20:15.698259 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:20:15.698259 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:20:15.698259 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:20:15.698259 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:20:15.698259 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:20:15.698259 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:20:15.698259 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:20:15.698259 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:20:15.698259 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:20:15.698259 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:20:15.698259 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 07 14:20:15.698259 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:20:15.700044 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 61/126] 10.222.0.86 () {56 vars in 1099 bytes} [Tue Jun 7 14:20:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:20:15.700044 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dda9a9-131a-4230-ba73-b01ae843f764 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:15.734363 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3614cfb0-3f81-4215-be3a-bed551641043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:15.735039 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3614cfb0-3f81-4215-be3a-bed551641043 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:15.736925 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3614cfb0-3f81-4215-be3a-bed551641043 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:15.736925 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3614cfb0-3f81-4215-be3a-bed551641043 None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:15.736925 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3614cfb0-3f81-4215-be3a-bed551641043 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:20:15.737252 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3614cfb0-3f81-4215-be3a-bed551641043 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:15.738568 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3614cfb0-3f81-4215-be3a-bed551641043 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:15.756617 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 66/127] 10.222.0.86 () {56 vars in 1111 bytes} [Tue Jun 7 14:20:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:15.759570 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3614cfb0-3f81-4215-be3a-bed551641043 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:15.760954 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:15.861487 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dda9a9-131a-4230-ba73-b01ae843f764 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:15.901438 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94b96c1-82e8-4113-b85a-fdf64c4b7935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:15.902330 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94b96c1-82e8-4113-b85a-fdf64c4b7935 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:15.902619 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94b96c1-82e8-4113-b85a-fdf64c4b7935 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:15.902901 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94b96c1-82e8-4113-b85a-fdf64c4b7935 None admin] PATH_INFO: `/v3/users/a453037a2b4a425fa2238ee5e0d74396` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:15.905107 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94b96c1-82e8-4113-b85a-fdf64c4b7935 None admin] RBAC: Authorizing `identity:get_user(user_id=a453037a2b4a425fa2238ee5e0d74396)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:15.906571 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94b96c1-82e8-4113-b85a-fdf64c4b7935 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:15.908767 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 62/128] 10.222.0.86 () {56 vars in 1177 bytes} [Tue Jun 7 14:20:15 2022] GET /identity/v3/users/a453037a2b4a425fa2238ee5e0d74396 => generated 275 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:15.909548 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94b96c1-82e8-4113-b85a-fdf64c4b7935 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:15.967975 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3614cfb0-3f81-4215-be3a-bed551641043 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:16.019369 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:16.036015 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0615ac-9971-4e77-b4fe-554d322fa643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:16.036703 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0615ac-9971-4e77-b4fe-554d322fa643 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:16.036990 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0615ac-9971-4e77-b4fe-554d322fa643 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:16.037271 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0615ac-9971-4e77-b4fe-554d322fa643 None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:16.038038 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0615ac-9971-4e77-b4fe-554d322fa643 None admin] RBAC: Adding query filter params (name=member) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:20:16.038351 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0615ac-9971-4e77-b4fe-554d322fa643 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:16.039737 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0615ac-9971-4e77-b4fe-554d322fa643 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:16.054306 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 67/129] 10.222.0.86 () {56 vars in 1101 bytes} [Tue Jun 7 14:20:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:16.054908 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0615ac-9971-4e77-b4fe-554d322fa643 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:16.112355 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94b96c1-82e8-4113-b85a-fdf64c4b7935 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:16.114782 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:16.156012 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295c8419-bad0-4c30-aa04-1258e8a9fe63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:16.157889 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295c8419-bad0-4c30-aa04-1258e8a9fe63 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:16.158393 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295c8419-bad0-4c30-aa04-1258e8a9fe63 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:16.158837 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295c8419-bad0-4c30-aa04-1258e8a9fe63 None admin] PATH_INFO: `/v3/users/a453037a2b4a425fa2238ee5e0d74396` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:16.164739 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295c8419-bad0-4c30-aa04-1258e8a9fe63 None admin] RBAC: Authorizing `identity:get_user(user_id=a453037a2b4a425fa2238ee5e0d74396)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:16.166269 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295c8419-bad0-4c30-aa04-1258e8a9fe63 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:16.171803 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 63/130] 10.222.0.86 () {56 vars in 1177 bytes} [Tue Jun 7 14:20:15 2022] GET /identity/v3/users/a453037a2b4a425fa2238ee5e0d74396 => generated 275 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:16.171803 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295c8419-bad0-4c30-aa04-1258e8a9fe63 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:16.253717 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0615ac-9971-4e77-b4fe-554d322fa643 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:16.320305 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec29f5e2-069b-4cbe-9e49-cc699d89c53e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:16.321191 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec29f5e2-069b-4cbe-9e49-cc699d89c53e None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:16.321476 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec29f5e2-069b-4cbe-9e49-cc699d89c53e None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:16.321782 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec29f5e2-069b-4cbe-9e49-cc699d89c53e None admin] PATH_INFO: `/v3/projects/3cd4810e72844bb58991b6fc44dacec5` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:16.323013 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec29f5e2-069b-4cbe-9e49-cc699d89c53e None admin] RBAC: Authorizing `identity:get_project(project_id=3cd4810e72844bb58991b6fc44dacec5)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:16.324744 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec29f5e2-069b-4cbe-9e49-cc699d89c53e None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:16.326456 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 68/131] 10.222.0.86 () {56 vars in 1186 bytes} [Tue Jun 7 14:20:16 2022] GET /identity/v3/projects/3cd4810e72844bb58991b6fc44dacec5 => generated 298 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:16.327245 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec29f5e2-069b-4cbe-9e49-cc699d89c53e None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:16.348348 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295c8419-bad0-4c30-aa04-1258e8a9fe63 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:16.414038 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9ceb22-471a-41c4-8d02-b4eacf77facd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:16.414931 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9ceb22-471a-41c4-8d02-b4eacf77facd None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:16.415220 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9ceb22-471a-41c4-8d02-b4eacf77facd None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:16.415502 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9ceb22-471a-41c4-8d02-b4eacf77facd None admin] PATH_INFO: `/v3/users/a453037a2b4a425fa2238ee5e0d74396` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:16.419795 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9ceb22-471a-41c4-8d02-b4eacf77facd None admin] RBAC: Authorizing `identity:get_user(user_id=a453037a2b4a425fa2238ee5e0d74396)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:16.420071 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9ceb22-471a-41c4-8d02-b4eacf77facd None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:16.423936 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 64/132] 10.222.0.86 () {56 vars in 1177 bytes} [Tue Jun 7 14:20:16 2022] GET /identity/v3/users/a453037a2b4a425fa2238ee5e0d74396 => generated 275 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:16.424775 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9ceb22-471a-41c4-8d02-b4eacf77facd None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:16.436236 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:16.477792 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec29f5e2-069b-4cbe-9e49-cc699d89c53e None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:16.516207 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:16.521782 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cc6c50-11c6-4d40-b24d-816a01787fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:16.522673 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cc6c50-11c6-4d40-b24d-816a01787fb4 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:16.522958 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cc6c50-11c6-4d40-b24d-816a01787fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:16.523231 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cc6c50-11c6-4d40-b24d-816a01787fb4 None admin] PATH_INFO: `/v3/projects/3cd4810e72844bb58991b6fc44dacec5` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:16.526374 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cc6c50-11c6-4d40-b24d-816a01787fb4 None admin] RBAC: Authorizing `identity:get_project(project_id=3cd4810e72844bb58991b6fc44dacec5)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:16.527871 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cc6c50-11c6-4d40-b24d-816a01787fb4 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:16.529795 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 69/133] 10.222.0.86 () {56 vars in 1186 bytes} [Tue Jun 7 14:20:16 2022] GET /identity/v3/projects/3cd4810e72844bb58991b6fc44dacec5 => generated 298 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:16.530344 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cc6c50-11c6-4d40-b24d-816a01787fb4 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:16.576033 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9ceb22-471a-41c4-8d02-b4eacf77facd None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:16.611724 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a518c4-6cb4-4aae-ac60-252d692d0158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:16.612657 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a518c4-6cb4-4aae-ac60-252d692d0158 None admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:16.612950 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a518c4-6cb4-4aae-ac60-252d692d0158 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:16.613229 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a518c4-6cb4-4aae-ac60-252d692d0158 None admin] PATH_INFO: `/v3/projects/3cd4810e72844bb58991b6fc44dacec5/users/a453037a2b4a425fa2238ee5e0d74396/roles/c17acc2a8bb348f59ba7edd22fcf0c47` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:16.615239 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a518c4-6cb4-4aae-ac60-252d692d0158 None admin] RBAC: Authorizing `identity:create_grant(project_id=3cd4810e72844bb58991b6fc44dacec5, user_id=a453037a2b4a425fa2238ee5e0d74396, role_id=c17acc2a8bb348f59ba7edd22fcf0c47)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:16.616756 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a518c4-6cb4-4aae-ac60-252d692d0158 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:16.661826 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cc6c50-11c6-4d40-b24d-816a01787fb4 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:16.688534 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:16.697005 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a600ce5-c1d4-42ab-aa37-71562f04c28c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:16.697859 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a600ce5-c1d4-42ab-aa37-71562f04c28c None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:16.698142 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a600ce5-c1d4-42ab-aa37-71562f04c28c None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:16.698416 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a600ce5-c1d4-42ab-aa37-71562f04c28c None admin] PATH_INFO: `/v3/projects/dd1d9739ff9648cfaa8cc32f1b6552e3` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:16.699631 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a600ce5-c1d4-42ab-aa37-71562f04c28c None admin] RBAC: Authorizing `identity:get_project(project_id=dd1d9739ff9648cfaa8cc32f1b6552e3)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:16.701094 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a600ce5-c1d4-42ab-aa37-71562f04c28c None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:16.702960 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 70/134] 10.222.0.86 () {56 vars in 1186 bytes} [Tue Jun 7 14:20:16 2022] GET /identity/v3/projects/dd1d9739ff9648cfaa8cc32f1b6552e3 => generated 312 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:16.703533 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a600ce5-c1d4-42ab-aa37-71562f04c28c None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:16.759847 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 65/135] 10.222.0.86 () {58 vars in 1439 bytes} [Tue Jun 7 14:20:16 2022] PUT /identity/v3/projects/3cd4810e72844bb58991b6fc44dacec5/users/a453037a2b4a425fa2238ee5e0d74396/roles/c17acc2a8bb348f59ba7edd22fcf0c47 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:20:16.759847 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8191b281-8eba-40c3-8d74-75ec46e45d80 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:16.759847 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8191b281-8eba-40c3-8d74-75ec46e45d80 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:16.759847 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8191b281-8eba-40c3-8d74-75ec46e45d80 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:16.766026 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 66/136] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:20:16 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:20:16.770194 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8191b281-8eba-40c3-8d74-75ec46e45d80 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:16.878049 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a600ce5-c1d4-42ab-aa37-71562f04c28c None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:16.928984 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:16.934138 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8191b281-8eba-40c3-8d74-75ec46e45d80 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:16.977704 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2943bb23-c30a-43df-bd53-f22cb4cf8d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:16.979064 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2943bb23-c30a-43df-bd53-f22cb4cf8d51 None admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:16.979554 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2943bb23-c30a-43df-bd53-f22cb4cf8d51 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:16.980269 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2943bb23-c30a-43df-bd53-f22cb4cf8d51 None admin] PATH_INFO: `/v3/projects/dd1d9739ff9648cfaa8cc32f1b6552e3/users/a453037a2b4a425fa2238ee5e0d74396/roles/c17acc2a8bb348f59ba7edd22fcf0c47` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:16.983025 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2943bb23-c30a-43df-bd53-f22cb4cf8d51 None admin] RBAC: Authorizing `identity:create_grant(project_id=dd1d9739ff9648cfaa8cc32f1b6552e3, user_id=a453037a2b4a425fa2238ee5e0d74396, role_id=c17acc2a8bb348f59ba7edd22fcf0c47)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:16.985087 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2943bb23-c30a-43df-bd53-f22cb4cf8d51 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:16.992952 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11403980-80b3-4197-9bde-d6be889b7d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:16.994328 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11403980-80b3-4197-9bde-d6be889b7d3e None admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:16.994819 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11403980-80b3-4197-9bde-d6be889b7d3e None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:16.995294 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11403980-80b3-4197-9bde-d6be889b7d3e None admin] PATH_INFO: `/v3/projects/3cd4810e72844bb58991b6fc44dacec5/users/a453037a2b4a425fa2238ee5e0d74396/roles/a2755a2b621b4e969fd366f0035d672b` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:16.998197 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11403980-80b3-4197-9bde-d6be889b7d3e None admin] RBAC: Authorizing `identity:create_grant(project_id=3cd4810e72844bb58991b6fc44dacec5, user_id=a453037a2b4a425fa2238ee5e0d74396, role_id=a2755a2b621b4e969fd366f0035d672b)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:17.000034 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11403980-80b3-4197-9bde-d6be889b7d3e None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:17.082022 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 67/137] 10.222.0.86 () {58 vars in 1439 bytes} [Tue Jun 7 14:20:16 2022] PUT /identity/v3/projects/dd1d9739ff9648cfaa8cc32f1b6552e3/users/a453037a2b4a425fa2238ee5e0d74396/roles/c17acc2a8bb348f59ba7edd22fcf0c47 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:20:17.083879 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e45b4c1-c411-41a3-a5e6-5fa9b0831daf None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:17.084387 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e45b4c1-c411-41a3-a5e6-5fa9b0831daf None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:17.085012 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e45b4c1-c411-41a3-a5e6-5fa9b0831daf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:17.110792 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 71/138] 10.222.0.86 () {58 vars in 1439 bytes} [Tue Jun 7 14:20:16 2022] PUT /identity/v3/projects/3cd4810e72844bb58991b6fc44dacec5/users/a453037a2b4a425fa2238ee5e0d74396/roles/a2755a2b621b4e969fd366f0035d672b => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:20:17.114544 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-5e45b4c1-c411-41a3-a5e6-5fa9b0831daf None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:20:17.116440 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-5e45b4c1-c411-41a3-a5e6-5fa9b0831daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:20:17.224668 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 68/139] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:20:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 14:20:17.261486 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11403980-80b3-4197-9bde-d6be889b7d3e None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:17.334506 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:17.390164 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11403980-80b3-4197-9bde-d6be889b7d3e None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:17.430025 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d42ba2-3285-4099-a883-6ecd32e30fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:17.431258 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d42ba2-3285-4099-a883-6ecd32e30fe3 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:17.431799 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d42ba2-3285-4099-a883-6ecd32e30fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:17.432357 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d42ba2-3285-4099-a883-6ecd32e30fe3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:17.433895 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d42ba2-3285-4099-a883-6ecd32e30fe3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:17.435635 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d42ba2-3285-4099-a883-6ecd32e30fe3 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:17.440879 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 72/140] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jun 7 14:20:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:17.446371 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e45b4c1-c411-41a3-a5e6-5fa9b0831daf None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:17.572923 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:17.584103 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e45b4c1-c411-41a3-a5e6-5fa9b0831daf None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:17.626454 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581cbb36-781f-4de3-b059-fd995f4b1b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:17.627286 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581cbb36-781f-4de3-b059-fd995f4b1b11 None admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:17.627687 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581cbb36-781f-4de3-b059-fd995f4b1b11 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:17.628115 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581cbb36-781f-4de3-b059-fd995f4b1b11 None admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:17.628956 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581cbb36-781f-4de3-b059-fd995f4b1b11 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:17.630578 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581cbb36-781f-4de3-b059-fd995f4b1b11 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:17.656611 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897259f7-a941-41fa-992c-f538b2c648c0 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:17.657163 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897259f7-a941-41fa-992c-f538b2c648c0 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:17.657553 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897259f7-a941-41fa-992c-f538b2c648c0 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:17.659147 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 73/141] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:20:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 07 14:20:17.665260 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd703aa-88e2-4ef4-bdfc-db261c2a5c5f None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:17.665669 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd703aa-88e2-4ef4-bdfc-db261c2a5c5f None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:17.666014 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd703aa-88e2-4ef4-bdfc-db261c2a5c5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:17.686397 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-afd703aa-88e2-4ef4-bdfc-db261c2a5c5f None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:20:17.687803 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-afd703aa-88e2-4ef4-bdfc-db261c2a5c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:20:17.755512 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 69/142] 10.222.0.86 () {60 vars in 1132 bytes} [Tue Jun 7 14:20:17 2022] POST /identity/v3/users => generated 283 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:20:17.770720 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 74/143] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:20:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 07 14:20:17.812737 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581cbb36-781f-4de3-b059-fd995f4b1b11 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:17.960900 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581cbb36-781f-4de3-b059-fd995f4b1b11 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:18.004175 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14291383-2c7a-4968-bda4-76081a4f89bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:18.005013 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14291383-2c7a-4968-bda4-76081a4f89bd None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:18.005305 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14291383-2c7a-4968-bda4-76081a4f89bd None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:18.005590 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14291383-2c7a-4968-bda4-76081a4f89bd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:18.022500 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14291383-2c7a-4968-bda4-76081a4f89bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:20:18.030550 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-14291383-2c7a-4968-bda4-76081a4f89bd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 07 14:20:18.030550 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:20:18.030550 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:20:18.030550 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:20:18.030550 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:20:18.030550 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:20:18.030550 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:20:18.030550 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:20:18.030550 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:20:18.030550 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:20:18.030550 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:20:18.030550 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:20:18.030550 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:20:18.030550 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:20:18.030550 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:20:18.030550 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:20:18.031368 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:20:18.031368 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:20:18.031368 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:20:18.031368 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:20:18.031368 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:20:18.031368 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:20:18.031368 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:20:18.031368 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:20:18.031368 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:20:18.031368 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:20:18.031368 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:20:18.031368 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jun 07 14:20:18.031368 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:20:18.031368 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:20:18.031368 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:20:18.031368 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:20:18.032678 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:20:18.032678 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:20:18.032678 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:20:18.032678 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:20:18.032678 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:20:18.032678 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:20:18.032678 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:20:18.032678 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:20:18.032678 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:20:18.032678 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:20:18.032678 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 07 14:20:18.032678 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:20:18.032678 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 70/144] 10.222.0.86 () {56 vars in 1099 bytes} [Tue Jun 7 14:20:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:20:18.038152 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd703aa-88e2-4ef4-bdfc-db261c2a5c5f None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:18.096317 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:18.147833 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd703aa-88e2-4ef4-bdfc-db261c2a5c5f None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:18.186718 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847e0b69-4946-4580-a7c6-caa3633c3597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:18.187403 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847e0b69-4946-4580-a7c6-caa3633c3597 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:18.187691 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847e0b69-4946-4580-a7c6-caa3633c3597 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:18.188003 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847e0b69-4946-4580-a7c6-caa3633c3597 None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:18.189327 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847e0b69-4946-4580-a7c6-caa3633c3597 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:20:18.189640 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847e0b69-4946-4580-a7c6-caa3633c3597 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:18.191053 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847e0b69-4946-4580-a7c6-caa3633c3597 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:18.200233 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 75/145] 10.222.0.86 () {56 vars in 1101 bytes} [Tue Jun 7 14:20:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:18.209362 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14291383-2c7a-4968-bda4-76081a4f89bd None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:18.220066 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700bf0b0-7209-4520-8dcf-4f5129e5ae9b None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:18.220316 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700bf0b0-7209-4520-8dcf-4f5129e5ae9b None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:18.220558 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700bf0b0-7209-4520-8dcf-4f5129e5ae9b None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:18.220778 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:18.221981 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 76/146] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:20:18 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:20:18.228421 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ac2d2f-c6bd-45f4-a7ed-79bb9dada045 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:18.228713 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ac2d2f-c6bd-45f4-a7ed-79bb9dada045 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:18.229002 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ac2d2f-c6bd-45f4-a7ed-79bb9dada045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:18.258757 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-30ac2d2f-c6bd-45f4-a7ed-79bb9dada045 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:20:18.260024 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-30ac2d2f-c6bd-45f4-a7ed-79bb9dada045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:20:18.341368 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 77/147] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:20:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 14:20:18.347278 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14291383-2c7a-4968-bda4-76081a4f89bd None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:18.393310 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ac2d2f-c6bd-45f4-a7ed-79bb9dada045 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:18.394798 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252a9148-c593-49b7-bcbb-02c439865a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:18.395883 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252a9148-c593-49b7-bcbb-02c439865a92 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:18.396181 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252a9148-c593-49b7-bcbb-02c439865a92 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:18.396470 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252a9148-c593-49b7-bcbb-02c439865a92 None admin] PATH_INFO: `/v3/users/35094e5446044635bb90baf80fccdf18` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:18.398593 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252a9148-c593-49b7-bcbb-02c439865a92 None admin] RBAC: Authorizing `identity:get_user(user_id=35094e5446044635bb90baf80fccdf18)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:18.400250 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252a9148-c593-49b7-bcbb-02c439865a92 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:18.401927 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 71/148] 10.222.0.86 () {56 vars in 1177 bytes} [Tue Jun 7 14:20:18 2022] GET /identity/v3/users/35094e5446044635bb90baf80fccdf18 => generated 289 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:18.408148 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252a9148-c593-49b7-bcbb-02c439865a92 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:18.454066 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:18.516244 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:18.542489 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252a9148-c593-49b7-bcbb-02c439865a92 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:18.566565 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ac2d2f-c6bd-45f4-a7ed-79bb9dada045 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:18.593465 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eb1e91-fdd1-48c5-9a93-4a3e3b4edaf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:18.594374 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eb1e91-fdd1-48c5-9a93-4a3e3b4edaf9 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:18.595206 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eb1e91-fdd1-48c5-9a93-4a3e3b4edaf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:18.595494 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eb1e91-fdd1-48c5-9a93-4a3e3b4edaf9 None admin] PATH_INFO: `/v3/projects/3cd4810e72844bb58991b6fc44dacec5` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:18.597684 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65eb1e91-fdd1-48c5-9a93-4a3e3b4edaf9 None admin] RBAC: Authorizing `identity:get_project(project_id=3cd4810e72844bb58991b6fc44dacec5)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:18.599218 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65eb1e91-fdd1-48c5-9a93-4a3e3b4edaf9 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:18.605816 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 72/149] 10.222.0.86 () {56 vars in 1186 bytes} [Tue Jun 7 14:20:18 2022] GET /identity/v3/projects/3cd4810e72844bb58991b6fc44dacec5 => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:18.607009 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eb1e91-fdd1-48c5-9a93-4a3e3b4edaf9 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:18.614079 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30062211-e430-4294-97a3-fede0a7739c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:18.614898 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30062211-e430-4294-97a3-fede0a7739c2 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:18.615184 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30062211-e430-4294-97a3-fede0a7739c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:18.615459 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30062211-e430-4294-97a3-fede0a7739c2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:18.626798 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30062211-e430-4294-97a3-fede0a7739c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:20:18.634718 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-30062211-e430-4294-97a3-fede0a7739c2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 14:20:18.634718 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:20:18.634718 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:20:18.634718 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:20:18.634718 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:20:18.634718 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:20:18.634718 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:20:18.634718 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:20:18.634718 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:20:18.634718 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:20:18.634718 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:20:18.634718 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:20:18.634718 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:20:18.634718 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:20:18.634718 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:20:18.634718 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:20:18.635562 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:20:18.635562 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:20:18.635562 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:20:18.635562 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:20:18.635562 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:20:18.635562 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:20:18.635562 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:20:18.635562 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:20:18.635562 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:20:18.635562 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:20:18.635562 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:20:18.635562 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jun 07 14:20:18.635562 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:20:18.635562 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:20:18.635562 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:20:18.635562 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:20:18.636352 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:20:18.636352 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:20:18.636352 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:20:18.636352 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:20:18.636352 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:20:18.636352 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:20:18.636352 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:20:18.636352 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:20:18.636352 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:20:18.636352 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:20:18.636352 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 14:20:18.636352 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:20:18.636352 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 78/150] 10.222.0.86 () {56 vars in 1096 bytes} [Tue Jun 7 14:20:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:20:18.669426 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30062211-e430-4294-97a3-fede0a7739c2 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:18.727140 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eb1e91-fdd1-48c5-9a93-4a3e3b4edaf9 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:18.776925 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e783864-3c0a-4dd5-8390-deb835fbae27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:18.777847 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e783864-3c0a-4dd5-8390-deb835fbae27 None admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:18.778138 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e783864-3c0a-4dd5-8390-deb835fbae27 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:18.778422 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e783864-3c0a-4dd5-8390-deb835fbae27 None admin] PATH_INFO: `/v3/projects/3cd4810e72844bb58991b6fc44dacec5/users/35094e5446044635bb90baf80fccdf18/roles/bce2bd9e8c164e7ca92ba5e110848be0` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:18.784350 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e783864-3c0a-4dd5-8390-deb835fbae27 None admin] RBAC: Authorizing `identity:create_grant(project_id=3cd4810e72844bb58991b6fc44dacec5, user_id=35094e5446044635bb90baf80fccdf18, role_id=bce2bd9e8c164e7ca92ba5e110848be0)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:18.785901 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e783864-3c0a-4dd5-8390-deb835fbae27 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:18.863488 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30062211-e430-4294-97a3-fede0a7739c2 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:18.873739 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 73/151] 10.222.0.86 () {58 vars in 1439 bytes} [Tue Jun 7 14:20:18 2022] PUT /identity/v3/projects/3cd4810e72844bb58991b6fc44dacec5/users/35094e5446044635bb90baf80fccdf18/roles/bce2bd9e8c164e7ca92ba5e110848be0 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:20:18.884140 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:18.924326 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59352a8-9329-452e-afe9-43541bb7918f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:18.925031 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59352a8-9329-452e-afe9-43541bb7918f None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:18.925317 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59352a8-9329-452e-afe9-43541bb7918f None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:18.925596 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59352a8-9329-452e-afe9-43541bb7918f None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:18.926382 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59352a8-9329-452e-afe9-43541bb7918f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:20:18.926696 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59352a8-9329-452e-afe9-43541bb7918f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:18.928225 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59352a8-9329-452e-afe9-43541bb7918f None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:18.942327 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 79/152] 10.222.0.86 () {56 vars in 1099 bytes} [Tue Jun 7 14:20:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:18.948384 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e783864-3c0a-4dd5-8390-deb835fbae27 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:18.951377 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:19.097228 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e783864-3c0a-4dd5-8390-deb835fbae27 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:19.143326 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62ccecd-9609-4559-919c-16decd437a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:19.144775 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62ccecd-9609-4559-919c-16decd437a60 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:19.145273 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62ccecd-9609-4559-919c-16decd437a60 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:19.145740 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62ccecd-9609-4559-919c-16decd437a60 None admin] PATH_INFO: `/v3/users/5e52b7dc1f3e460b87cf6e04ac06baf2` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:19.147816 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62ccecd-9609-4559-919c-16decd437a60 None admin] RBAC: Authorizing `identity:get_user(user_id=5e52b7dc1f3e460b87cf6e04ac06baf2)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:19.149477 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62ccecd-9609-4559-919c-16decd437a60 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:19.151304 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 74/153] 10.222.0.86 () {56 vars in 1177 bytes} [Tue Jun 7 14:20:18 2022] GET /identity/v3/users/5e52b7dc1f3e460b87cf6e04ac06baf2 => generated 247 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:19.157645 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59352a8-9329-452e-afe9-43541bb7918f None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:19.275706 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59352a8-9329-452e-afe9-43541bb7918f None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:19.324592 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49f8f1e-1957-4df9-afaf-ae9afe8e8055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:19.325280 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49f8f1e-1957-4df9-afaf-ae9afe8e8055 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:19.325571 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49f8f1e-1957-4df9-afaf-ae9afe8e8055 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:19.325852 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49f8f1e-1957-4df9-afaf-ae9afe8e8055 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:19.369987 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:19.410367 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49f8f1e-1957-4df9-afaf-ae9afe8e8055 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:19.411931 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49f8f1e-1957-4df9-afaf-ae9afe8e8055 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:19.533668 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 80/154] 10.222.0.86 () {58 vars in 1282 bytes} [Tue Jun 7 14:20:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 07 14:20:19.539423 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62ccecd-9609-4559-919c-16decd437a60 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:19.636963 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:19.672990 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62ccecd-9609-4559-919c-16decd437a60 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:19.721954 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b492384-537b-43c0-b848-b179b1a4dfbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:19.722827 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b492384-537b-43c0-b848-b179b1a4dfbb None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:19.723110 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b492384-537b-43c0-b848-b179b1a4dfbb None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:19.723387 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b492384-537b-43c0-b848-b179b1a4dfbb None admin] PATH_INFO: `/v3/projects/3cd4810e72844bb58991b6fc44dacec5` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:19.724634 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b492384-537b-43c0-b848-b179b1a4dfbb None admin] RBAC: Authorizing `identity:get_project(project_id=3cd4810e72844bb58991b6fc44dacec5)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:19.726075 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b492384-537b-43c0-b848-b179b1a4dfbb None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:19.728100 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 75/155] 10.222.0.86 () {56 vars in 1186 bytes} [Tue Jun 7 14:20:19 2022] GET /identity/v3/projects/3cd4810e72844bb58991b6fc44dacec5 => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:19.733935 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49f8f1e-1957-4df9-afaf-ae9afe8e8055 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:19.852133 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:19.886411 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49f8f1e-1957-4df9-afaf-ae9afe8e8055 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:19.931469 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b270995c-050a-4b7b-8875-8c5a923eb333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:19.932088 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b270995c-050a-4b7b-8875-8c5a923eb333 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:19.932862 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b270995c-050a-4b7b-8875-8c5a923eb333 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:19.933147 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b270995c-050a-4b7b-8875-8c5a923eb333 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:19.934001 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b270995c-050a-4b7b-8875-8c5a923eb333 None admin] RBAC: Adding query filter params (role.id=e3bf6239f5bf477b965704b086786f11, scope.project.id=3cd4810e72844bb58991b6fc44dacec5, user.id=5e52b7dc1f3e460b87cf6e04ac06baf2) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:20:19.934322 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b270995c-050a-4b7b-8875-8c5a923eb333 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:19.935805 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b270995c-050a-4b7b-8875-8c5a923eb333 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:19.942405 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 81/156] 10.222.0.86 () {56 vars in 1374 bytes} [Tue Jun 7 14:20:19 2022] GET /identity/v3/role_assignments?user.id=5e52b7dc1f3e460b87cf6e04ac06baf2&scope.project.id=3cd4810e72844bb58991b6fc44dacec5&role.id=e3bf6239f5bf477b965704b086786f11 => generated 608 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:20.412658 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd44d69-5af3-44e6-8fd2-c280c8f8a2c0 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:20.413160 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd44d69-5af3-44e6-8fd2-c280c8f8a2c0 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:20.413264 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd44d69-5af3-44e6-8fd2-c280c8f8a2c0 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:20.414569 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 76/157] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:20:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:20:20.437833 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ea2a35-265f-41fb-ae5b-b1a94c3a0555 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:20.438902 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ea2a35-265f-41fb-ae5b-b1a94c3a0555 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:20.438974 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ea2a35-265f-41fb-ae5b-b1a94c3a0555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:20.460263 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-b4ea2a35-265f-41fb-ae5b-b1a94c3a0555 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:20:20.461819 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-b4ea2a35-265f-41fb-ae5b-b1a94c3a0555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:20:20.541311 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 82/158] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:20:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 07 14:20:20.568372 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd44d69-5af3-44e6-8fd2-c280c8f8a2c0 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:20.702091 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd44d69-5af3-44e6-8fd2-c280c8f8a2c0 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:20.738063 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800bfa41-8677-46c4-a7ec-fd2338f0a3da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:20.738864 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800bfa41-8677-46c4-a7ec-fd2338f0a3da None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:20.739145 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800bfa41-8677-46c4-a7ec-fd2338f0a3da None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:20.739413 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800bfa41-8677-46c4-a7ec-fd2338f0a3da None admin] PATH_INFO: `/v3/roles/member` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:20.746868 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:20.751740 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800bfa41-8677-46c4-a7ec-fd2338f0a3da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:20:20.759481 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-800bfa41-8677-46c4-a7ec-fd2338f0a3da None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 07 14:20:20.759481 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:20:20.759481 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:20:20.759481 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:20:20.759481 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:20:20.759481 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:20:20.759481 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:20:20.759481 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:20:20.759481 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:20:20.759481 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:20:20.759481 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:20:20.759481 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:20:20.759481 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:20:20.759481 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:20:20.759481 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:20:20.759481 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:20:20.760424 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:20:20.760424 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:20:20.760424 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:20:20.760424 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:20:20.760424 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:20:20.760424 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:20:20.760424 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:20:20.760424 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:20:20.760424 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:20:20.760424 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:20:20.760424 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:20:20.760424 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jun 07 14:20:20.760424 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:20:20.760424 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:20:20.760424 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:20:20.760424 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:20:20.761278 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:20:20.761278 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:20:20.761278 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:20:20.761278 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:20:20.761278 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:20:20.761278 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:20:20.761278 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:20:20.761278 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:20:20.761278 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:20:20.761278 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:20:20.761278 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 07 14:20:20.761278 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:20:20.761278 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 77/159] 10.222.0.86 () {56 vars in 1099 bytes} [Tue Jun 7 14:20:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:20:20.772966 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ea2a35-265f-41fb-ae5b-b1a94c3a0555 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:20.867501 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:20.910780 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ea2a35-265f-41fb-ae5b-b1a94c3a0555 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:20.956560 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5906beb-830e-4453-a2f5-c0791054e9e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:20.957247 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5906beb-830e-4453-a2f5-c0791054e9e5 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:20.957534 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5906beb-830e-4453-a2f5-c0791054e9e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:20.957811 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5906beb-830e-4453-a2f5-c0791054e9e5 None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:20.958759 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5906beb-830e-4453-a2f5-c0791054e9e5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:20:20.959075 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5906beb-830e-4453-a2f5-c0791054e9e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:20.960526 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5906beb-830e-4453-a2f5-c0791054e9e5 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:20.975916 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 83/160] 10.222.0.86 () {56 vars in 1101 bytes} [Tue Jun 7 14:20:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:20.981977 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800bfa41-8677-46c4-a7ec-fd2338f0a3da None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:21.129130 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800bfa41-8677-46c4-a7ec-fd2338f0a3da None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:21.174372 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279cb51d-41a5-4b11-9cca-f0e09d0438ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:21.175648 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279cb51d-41a5-4b11-9cca-f0e09d0438ba None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:21.176146 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279cb51d-41a5-4b11-9cca-f0e09d0438ba None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:21.176616 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279cb51d-41a5-4b11-9cca-f0e09d0438ba None admin] PATH_INFO: `/v3/users/a453037a2b4a425fa2238ee5e0d74396` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:21.178036 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279cb51d-41a5-4b11-9cca-f0e09d0438ba None admin] RBAC: Authorizing `identity:get_user(user_id=a453037a2b4a425fa2238ee5e0d74396)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:21.179710 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279cb51d-41a5-4b11-9cca-f0e09d0438ba None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:21.181514 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 78/161] 10.222.0.86 () {56 vars in 1177 bytes} [Tue Jun 7 14:20:20 2022] GET /identity/v3/users/a453037a2b4a425fa2238ee5e0d74396 => generated 275 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:21.187389 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5906beb-830e-4453-a2f5-c0791054e9e5 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:21.339241 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5906beb-830e-4453-a2f5-c0791054e9e5 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:21.371326 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:21.387203 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03af56ab-aa5a-47cc-9db2-9187f67acbb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:21.387203 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03af56ab-aa5a-47cc-9db2-9187f67acbb0 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:21.387203 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03af56ab-aa5a-47cc-9db2-9187f67acbb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:21.387203 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03af56ab-aa5a-47cc-9db2-9187f67acbb0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:21.478870 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03af56ab-aa5a-47cc-9db2-9187f67acbb0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:21.480449 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03af56ab-aa5a-47cc-9db2-9187f67acbb0 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:21.602574 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 84/162] 10.222.0.86 () {58 vars in 1282 bytes} [Tue Jun 7 14:20:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 07 14:20:21.609224 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279cb51d-41a5-4b11-9cca-f0e09d0438ba None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:21.640302 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c4226a-9b6f-4718-994d-c02e16867a73 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:21.640592 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c4226a-9b6f-4718-994d-c02e16867a73 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:21.640793 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c4226a-9b6f-4718-994d-c02e16867a73 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:21.642965 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 85/163] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:20:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:20:21.648006 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7078f75e-42a9-45e3-8725-8a3fb53afa77 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:21.648303 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7078f75e-42a9-45e3-8725-8a3fb53afa77 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:21.648588 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7078f75e-42a9-45e3-8725-8a3fb53afa77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:21.670336 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-7078f75e-42a9-45e3-8725-8a3fb53afa77 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:20:21.671530 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-7078f75e-42a9-45e3-8725-8a3fb53afa77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:20:21.704802 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:21.712116 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:21.760477 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279cb51d-41a5-4b11-9cca-f0e09d0438ba None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:21.777385 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 86/164] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:20:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 14:20:21.778777 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72469166-9d2b-4dad-9543-a456cd66f186 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:21.779077 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72469166-9d2b-4dad-9543-a456cd66f186 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:21.779360 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72469166-9d2b-4dad-9543-a456cd66f186 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:21.789416 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 87/165] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:20:21 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:20:21.795677 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9982246b-9077-47ae-b314-287e444ffeb3 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:21.795992 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9982246b-9077-47ae-b314-287e444ffeb3 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:21.796254 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9982246b-9077-47ae-b314-287e444ffeb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:21.820321 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755b35f0-50b0-4b04-905e-3fbb333f04ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:21.821206 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755b35f0-50b0-4b04-905e-3fbb333f04ea None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:21.821489 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755b35f0-50b0-4b04-905e-3fbb333f04ea None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:21.821762 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755b35f0-50b0-4b04-905e-3fbb333f04ea None admin] PATH_INFO: `/v3/projects/3cd4810e72844bb58991b6fc44dacec5` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:21.823027 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755b35f0-50b0-4b04-905e-3fbb333f04ea None admin] RBAC: Authorizing `identity:get_project(project_id=3cd4810e72844bb58991b6fc44dacec5)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:21.823292 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-9982246b-9077-47ae-b314-287e444ffeb3 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:20:21.824515 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755b35f0-50b0-4b04-905e-3fbb333f04ea None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:21.826229 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 79/166] 10.222.0.86 () {56 vars in 1186 bytes} [Tue Jun 7 14:20:21 2022] GET /identity/v3/projects/3cd4810e72844bb58991b6fc44dacec5 => generated 298 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:21.826987 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755b35f0-50b0-4b04-905e-3fbb333f04ea None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:21.829688 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-9982246b-9077-47ae-b314-287e444ffeb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:20:21.934980 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 88/167] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:20:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 07 14:20:21.935797 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9982246b-9077-47ae-b314-287e444ffeb3 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:21.994924 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755b35f0-50b0-4b04-905e-3fbb333f04ea None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:22.076515 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7854efaf-9ca8-479d-9e7c-e48a70a73893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:22.077335 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7854efaf-9ca8-479d-9e7c-e48a70a73893 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:22.077617 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7854efaf-9ca8-479d-9e7c-e48a70a73893 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:22.078058 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7854efaf-9ca8-479d-9e7c-e48a70a73893 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:22.085281 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:22.086409 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:22.108963 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7854efaf-9ca8-479d-9e7c-e48a70a73893 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:20:22.111440 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9982246b-9077-47ae-b314-287e444ffeb3 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:22.126140 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-7854efaf-9ca8-479d-9e7c-e48a70a73893 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 07 14:20:22.126140 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:20:22.126140 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:20:22.126140 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:20:22.126140 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:20:22.126140 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:20:22.126140 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:20:22.126140 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:20:22.126140 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:20:22.126140 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:20:22.126140 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:20:22.126140 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:20:22.126140 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:20:22.126140 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:20:22.126140 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:20:22.126140 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:20:22.127470 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:20:22.127470 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:20:22.127470 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:20:22.127470 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:20:22.127470 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:20:22.127470 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:20:22.127470 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:20:22.127470 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:20:22.127470 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:20:22.127470 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:20:22.127470 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:20:22.127470 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jun 07 14:20:22.127470 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:20:22.127470 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:20:22.127470 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:20:22.127470 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:20:22.128423 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:20:22.128423 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:20:22.128423 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:20:22.128423 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:20:22.128423 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:20:22.128423 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:20:22.128423 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:20:22.128423 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:20:22.128423 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:20:22.128423 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:20:22.128423 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 07 14:20:22.128423 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:20:22.128423 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 80/168] 10.222.0.86 () {56 vars in 1099 bytes} [Tue Jun 7 14:20:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:20:22.128423 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7854efaf-9ca8-479d-9e7c-e48a70a73893 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:22.168705 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1cb74d-003c-49d6-95f5-ef51e4b32eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:22.169452 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1cb74d-003c-49d6-95f5-ef51e4b32eb5 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:22.169696 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1cb74d-003c-49d6-95f5-ef51e4b32eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:22.169978 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1cb74d-003c-49d6-95f5-ef51e4b32eb5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:22.170843 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1cb74d-003c-49d6-95f5-ef51e4b32eb5 None admin] RBAC: Adding query filter params (role.id=c17acc2a8bb348f59ba7edd22fcf0c47, scope.project.id=3cd4810e72844bb58991b6fc44dacec5, user.id=a453037a2b4a425fa2238ee5e0d74396) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:20:22.171161 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1cb74d-003c-49d6-95f5-ef51e4b32eb5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:22.173231 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1cb74d-003c-49d6-95f5-ef51e4b32eb5 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:22.179524 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 89/169] 10.222.0.86 () {56 vars in 1374 bytes} [Tue Jun 7 14:20:21 2022] GET /identity/v3/role_assignments?user.id=a453037a2b4a425fa2238ee5e0d74396&scope.project.id=3cd4810e72844bb58991b6fc44dacec5&role.id=c17acc2a8bb348f59ba7edd22fcf0c47 => generated 608 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:22.189171 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1cb74d-003c-49d6-95f5-ef51e4b32eb5 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:22.306893 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7854efaf-9ca8-479d-9e7c-e48a70a73893 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:22.357248 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1cb74d-003c-49d6-95f5-ef51e4b32eb5 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:22.370225 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0926363b-5f29-453e-bacb-9d2e29f88b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:22.371060 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0926363b-5f29-453e-bacb-9d2e29f88b99 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:22.371340 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0926363b-5f29-453e-bacb-9d2e29f88b99 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:22.371615 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0926363b-5f29-453e-bacb-9d2e29f88b99 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:22.390508 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0926363b-5f29-453e-bacb-9d2e29f88b99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:20:22.403331 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5ef53b-35d5-4405-afb1-84e93be0682c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:22.404080 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5ef53b-35d5-4405-afb1-84e93be0682c None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:22.404369 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5ef53b-35d5-4405-afb1-84e93be0682c None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:22.404652 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5ef53b-35d5-4405-afb1-84e93be0682c None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:22.405470 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5ef53b-35d5-4405-afb1-84e93be0682c None admin] RBAC: Adding query filter params (name=member) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:20:22.405784 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5ef53b-35d5-4405-afb1-84e93be0682c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:22.407158 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-0926363b-5f29-453e-bacb-9d2e29f88b99 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 07 14:20:22.407158 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:20:22.407158 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:20:22.407158 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:20:22.407158 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:20:22.407158 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:20:22.407158 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:20:22.407158 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:20:22.407158 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:20:22.407158 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:20:22.407158 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:20:22.407158 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:20:22.407158 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:20:22.407158 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:20:22.407158 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:20:22.407158 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:20:22.408066 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:20:22.408066 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:20:22.408066 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:20:22.408066 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:20:22.408066 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:20:22.408066 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:20:22.408066 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:20:22.408066 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:20:22.408066 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:20:22.408066 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:20:22.408066 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:20:22.408066 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jun 07 14:20:22.408066 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:20:22.408066 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:20:22.408066 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:20:22.408066 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:20:22.410081 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:20:22.410081 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:20:22.410081 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:20:22.410081 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:20:22.410081 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:20:22.410081 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:20:22.410081 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:20:22.410081 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:20:22.410081 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:20:22.410081 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:20:22.410081 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 07 14:20:22.410081 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:20:22.410665 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5ef53b-35d5-4405-afb1-84e93be0682c None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:22.410741 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 81/170] 10.222.0.86 () {56 vars in 1114 bytes} [Tue Jun 7 14:20:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:20:22.410741 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead0d2f6-ed26-4ebe-a9eb-6c4d9348abe9 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:22.410741 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead0d2f6-ed26-4ebe-a9eb-6c4d9348abe9 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:22.410741 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead0d2f6-ed26-4ebe-a9eb-6c4d9348abe9 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:22.412131 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 82/171] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:20:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:20:22.421933 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b9b962-91a2-49fd-a54c-7af2e50791ba None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:22.422799 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b9b962-91a2-49fd-a54c-7af2e50791ba None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:22.423032 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b9b962-91a2-49fd-a54c-7af2e50791ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:22.427412 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 90/172] 10.222.0.86 () {56 vars in 1101 bytes} [Tue Jun 7 14:20:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:22.428316 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5ef53b-35d5-4405-afb1-84e93be0682c None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:22.458218 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:22.460793 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-36b9b962-91a2-49fd-a54c-7af2e50791ba None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:20:22.462040 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-36b9b962-91a2-49fd-a54c-7af2e50791ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:20:22.565825 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:22.601518 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5ef53b-35d5-4405-afb1-84e93be0682c None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:22.602048 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 83/173] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:20:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 14:20:22.602433 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b9b962-91a2-49fd-a54c-7af2e50791ba None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:22.645651 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784a1be0-c33c-4e8d-ad93-fef21dc2f1ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:22.649967 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784a1be0-c33c-4e8d-ad93-fef21dc2f1ca None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:22.650592 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784a1be0-c33c-4e8d-ad93-fef21dc2f1ca None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:22.651099 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784a1be0-c33c-4e8d-ad93-fef21dc2f1ca None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:22.652136 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784a1be0-c33c-4e8d-ad93-fef21dc2f1ca None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:20:22.652597 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784a1be0-c33c-4e8d-ad93-fef21dc2f1ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:22.654563 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784a1be0-c33c-4e8d-ad93-fef21dc2f1ca None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:22.669151 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 91/174] 10.222.0.86 () {56 vars in 1111 bytes} [Tue Jun 7 14:20:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:22.670466 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784a1be0-c33c-4e8d-ad93-fef21dc2f1ca None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:22.807558 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:22.819554 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b9b962-91a2-49fd-a54c-7af2e50791ba None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:22.863911 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b375cc85-c1c4-4789-88b0-68b15b3e94c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:22.864862 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b375cc85-c1c4-4789-88b0-68b15b3e94c0 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:22.865150 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b375cc85-c1c4-4789-88b0-68b15b3e94c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:22.865428 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b375cc85-c1c4-4789-88b0-68b15b3e94c0 None admin] PATH_INFO: `/v3/users/a453037a2b4a425fa2238ee5e0d74396` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:22.866692 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b375cc85-c1c4-4789-88b0-68b15b3e94c0 None admin] RBAC: Authorizing `identity:get_user(user_id=a453037a2b4a425fa2238ee5e0d74396)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:22.868349 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b375cc85-c1c4-4789-88b0-68b15b3e94c0 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:22.870665 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 84/175] 10.222.0.86 () {56 vars in 1177 bytes} [Tue Jun 7 14:20:22 2022] GET /identity/v3/users/a453037a2b4a425fa2238ee5e0d74396 => generated 275 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:22.871408 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b375cc85-c1c4-4789-88b0-68b15b3e94c0 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:22.881978 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784a1be0-c33c-4e8d-ad93-fef21dc2f1ca None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:22.936009 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:22.949268 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a2f60d-b88e-4a6d-9fd3-80242ef4d7d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:22.950065 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a2f60d-b88e-4a6d-9fd3-80242ef4d7d6 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:22.950345 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a2f60d-b88e-4a6d-9fd3-80242ef4d7d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:22.950619 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a2f60d-b88e-4a6d-9fd3-80242ef4d7d6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:22.962891 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a2f60d-b88e-4a6d-9fd3-80242ef4d7d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:20:22.971394 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-e7a2f60d-b88e-4a6d-9fd3-80242ef4d7d6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 14:20:22.971394 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:20:22.971394 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:20:22.971394 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:20:22.971394 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:20:22.971394 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:20:22.971394 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:20:22.971394 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:20:22.971394 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:20:22.971394 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:20:22.971394 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:20:22.971394 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:20:22.971394 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:20:22.971394 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:20:22.971394 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:20:22.971394 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:20:22.973790 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:20:22.973790 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:20:22.973790 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:20:22.973790 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:20:22.973790 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:20:22.973790 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:20:22.973790 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:20:22.973790 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:20:22.973790 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:20:22.973790 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:20:22.973790 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:20:22.973790 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jun 07 14:20:22.973790 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:20:22.973790 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:20:22.973790 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:20:22.973790 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:20:22.975806 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:20:22.975806 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:20:22.975806 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:20:22.975806 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:20:22.975806 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:20:22.975806 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:20:22.975806 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:20:22.975806 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:20:22.975806 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:20:22.975806 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:20:22.975806 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 14:20:22.975806 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:20:22.975806 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 92/176] 10.222.0.86 () {56 vars in 1096 bytes} [Tue Jun 7 14:20:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:20:22.975806 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a2f60d-b88e-4a6d-9fd3-80242ef4d7d6 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:22.996306 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b375cc85-c1c4-4789-88b0-68b15b3e94c0 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:23.041013 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb04d8e-8a2a-4596-9783-d947647db430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:23.042139 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb04d8e-8a2a-4596-9783-d947647db430 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:23.042429 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb04d8e-8a2a-4596-9783-d947647db430 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:23.042708 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb04d8e-8a2a-4596-9783-d947647db430 None admin] PATH_INFO: `/v3/users/a453037a2b4a425fa2238ee5e0d74396` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:23.043969 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb04d8e-8a2a-4596-9783-d947647db430 None admin] RBAC: Authorizing `identity:get_user(user_id=a453037a2b4a425fa2238ee5e0d74396)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:23.045423 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb04d8e-8a2a-4596-9783-d947647db430 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:23.047079 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 85/177] 10.222.0.86 () {56 vars in 1177 bytes} [Tue Jun 7 14:20:22 2022] GET /identity/v3/users/a453037a2b4a425fa2238ee5e0d74396 => generated 275 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:23.048471 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e04e5d-9163-49b2-9999-bf330c60347c None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:23.048764 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e04e5d-9163-49b2-9999-bf330c60347c None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:23.049046 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e04e5d-9163-49b2-9999-bf330c60347c None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:23.050421 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 86/178] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:20:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:20:23.051055 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e04e5d-9163-49b2-9999-bf330c60347c None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:23.094182 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a2f60d-b88e-4a6d-9fd3-80242ef4d7d6 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:23.124394 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:23.130182 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59820fe0-d12e-46aa-a2e6-292845d85299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:23.131189 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59820fe0-d12e-46aa-a2e6-292845d85299 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:23.131189 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59820fe0-d12e-46aa-a2e6-292845d85299 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:23.131440 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59820fe0-d12e-46aa-a2e6-292845d85299 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:23.165214 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e04e5d-9163-49b2-9999-bf330c60347c None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:23.188310 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:23.203091 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59820fe0-d12e-46aa-a2e6-292845d85299 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:23.205100 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59820fe0-d12e-46aa-a2e6-292845d85299 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:23.206392 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16ff8bc-aca2-4163-ac36-5740b577c5ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:23.207224 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16ff8bc-aca2-4163-ac36-5740b577c5ac None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:23.207505 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16ff8bc-aca2-4163-ac36-5740b577c5ac None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:23.208590 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16ff8bc-aca2-4163-ac36-5740b577c5ac None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:23.209356 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16ff8bc-aca2-4163-ac36-5740b577c5ac None admin] RBAC: Adding query filter params (name=admin) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:20:23.209668 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16ff8bc-aca2-4163-ac36-5740b577c5ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:23.211020 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16ff8bc-aca2-4163-ac36-5740b577c5ac None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:23.221643 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 87/179] 10.222.0.86 () {56 vars in 1099 bytes} [Tue Jun 7 14:20:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:23.228945 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881692d5-0a42-4b6b-9a90-2ac6ef0809a9 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:23.228945 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881692d5-0a42-4b6b-9a90-2ac6ef0809a9 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:23.228945 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881692d5-0a42-4b6b-9a90-2ac6ef0809a9 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:23.228945 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 88/180] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:20:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:20:23.228945 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881692d5-0a42-4b6b-9a90-2ac6ef0809a9 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:23.318285 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 93/181] 10.222.0.86 () {58 vars in 1282 bytes} [Tue Jun 7 14:20:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 07 14:20:23.319666 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b79bc5-0baf-4a92-97aa-bd8215a27df8 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:23.319986 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b79bc5-0baf-4a92-97aa-bd8215a27df8 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:23.320268 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b79bc5-0baf-4a92-97aa-bd8215a27df8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:23.338070 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-79b79bc5-0baf-4a92-97aa-bd8215a27df8 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:20:23.339344 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-79b79bc5-0baf-4a92-97aa-bd8215a27df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:20:23.359788 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881692d5-0a42-4b6b-9a90-2ac6ef0809a9 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:23.382428 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:23.401609 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bc7c94-803c-4edd-a1a0-9f725b53dbcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:23.402634 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bc7c94-803c-4edd-a1a0-9f725b53dbcf None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:23.403176 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bc7c94-803c-4edd-a1a0-9f725b53dbcf None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:23.403466 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bc7c94-803c-4edd-a1a0-9f725b53dbcf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:23.434381 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 94/182] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:20:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 14:20:23.444745 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b79bc5-0baf-4a92-97aa-bd8215a27df8 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:23.462486 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:23.482475 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bc7c94-803c-4edd-a1a0-9f725b53dbcf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:23.484245 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bc7c94-803c-4edd-a1a0-9f725b53dbcf None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:23.559612 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b79bc5-0baf-4a92-97aa-bd8215a27df8 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:23.588647 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 89/183] 10.222.0.86 () {58 vars in 1282 bytes} [Tue Jun 7 14:20:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 07 14:20:23.589941 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcda023-7dba-4ead-84d8-f4348612f277 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:23.590226 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcda023-7dba-4ead-84d8-f4348612f277 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:23.590496 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcda023-7dba-4ead-84d8-f4348612f277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:23.601166 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cef6972-12aa-47b5-abc4-e36bbed14b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:23.603155 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cef6972-12aa-47b5-abc4-e36bbed14b9d None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:23.603155 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cef6972-12aa-47b5-abc4-e36bbed14b9d None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:23.603155 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cef6972-12aa-47b5-abc4-e36bbed14b9d None admin] PATH_INFO: `/v3/users/f7119cc5aa984236b9de50bec037f956` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:23.608099 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-6dcda023-7dba-4ead-84d8-f4348612f277 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:20:23.609492 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-6dcda023-7dba-4ead-84d8-f4348612f277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:20:23.617802 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cef6972-12aa-47b5-abc4-e36bbed14b9d None admin] RBAC: Authorizing `identity:get_user(user_id=f7119cc5aa984236b9de50bec037f956)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:23.619203 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cef6972-12aa-47b5-abc4-e36bbed14b9d None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:23.620948 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 95/184] 10.222.0.86 () {56 vars in 1177 bytes} [Tue Jun 7 14:20:23 2022] GET /identity/v3/users/f7119cc5aa984236b9de50bec037f956 => generated 283 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:23.624608 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cef6972-12aa-47b5-abc4-e36bbed14b9d None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:23.647322 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:23.684682 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 90/185] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:20:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 14:20:23.686043 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28076a1a-823a-46ee-985c-22dedbc45140 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:23.686337 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28076a1a-823a-46ee-985c-22dedbc45140 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:23.699907 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28076a1a-823a-46ee-985c-22dedbc45140 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:23.699907 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 91/186] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:20:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:20:23.699907 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28076a1a-823a-46ee-985c-22dedbc45140 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:23.704131 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:23.732519 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cef6972-12aa-47b5-abc4-e36bbed14b9d None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:23.765333 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5abe3e-2201-4223-8bba-6b2b24dd2c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:23.766721 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5abe3e-2201-4223-8bba-6b2b24dd2c86 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:23.767005 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5abe3e-2201-4223-8bba-6b2b24dd2c86 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:23.767282 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5abe3e-2201-4223-8bba-6b2b24dd2c86 None admin] PATH_INFO: `/v3/projects/dd1d9739ff9648cfaa8cc32f1b6552e3` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:23.768494 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5abe3e-2201-4223-8bba-6b2b24dd2c86 None admin] RBAC: Authorizing `identity:get_project(project_id=dd1d9739ff9648cfaa8cc32f1b6552e3)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:23.769935 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5abe3e-2201-4223-8bba-6b2b24dd2c86 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:23.771628 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 96/187] 10.222.0.86 () {56 vars in 1186 bytes} [Tue Jun 7 14:20:23 2022] GET /identity/v3/projects/dd1d9739ff9648cfaa8cc32f1b6552e3 => generated 312 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:23.772533 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5abe3e-2201-4223-8bba-6b2b24dd2c86 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:23.794845 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28076a1a-823a-46ee-985c-22dedbc45140 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:23.827892 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db15273-06f4-44ac-be9d-7f873cdc862f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:23.831492 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db15273-06f4-44ac-be9d-7f873cdc862f None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:23.831492 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db15273-06f4-44ac-be9d-7f873cdc862f None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:23.831492 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db15273-06f4-44ac-be9d-7f873cdc862f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:23.840028 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db15273-06f4-44ac-be9d-7f873cdc862f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:20:23.848807 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-2db15273-06f4-44ac-be9d-7f873cdc862f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 07 14:20:23.848807 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:20:23.848807 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:20:23.848807 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:20:23.848807 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:20:23.848807 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:20:23.848807 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:20:23.848807 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:20:23.848807 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:20:23.848807 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:20:23.848807 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:20:23.848807 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:20:23.848807 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:20:23.848807 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:20:23.848807 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:20:23.848807 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:20:23.849688 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:20:23.849688 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:20:23.849688 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:20:23.849688 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:20:23.849688 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:20:23.849688 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:20:23.849688 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:20:23.849688 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:20:23.849688 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:20:23.849688 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:20:23.849688 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:20:23.849688 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jun 07 14:20:23.849688 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:20:23.849688 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:20:23.849688 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:20:23.849688 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:20:23.850461 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:20:23.850461 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:20:23.850461 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:20:23.850461 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:20:23.850461 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:20:23.850461 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:20:23.850461 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:20:23.850461 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:20:23.850461 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:20:23.850461 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:20:23.850461 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 07 14:20:23.850461 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:20:23.850461 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 92/188] 10.222.0.86 () {56 vars in 1114 bytes} [Tue Jun 7 14:20:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:20:23.851172 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db15273-06f4-44ac-be9d-7f873cdc862f None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:23.858292 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:23.873016 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5abe3e-2201-4223-8bba-6b2b24dd2c86 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:23.906453 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e4c316-0126-4665-ad06-b0e610553fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:23.907898 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e4c316-0126-4665-ad06-b0e610553fbc None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:23.908187 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e4c316-0126-4665-ad06-b0e610553fbc None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:23.908463 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e4c316-0126-4665-ad06-b0e610553fbc None admin] PATH_INFO: `/v3/projects/3cd4810e72844bb58991b6fc44dacec5` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:23.909679 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e4c316-0126-4665-ad06-b0e610553fbc None admin] RBAC: Authorizing `identity:get_project(project_id=3cd4810e72844bb58991b6fc44dacec5)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:23.911250 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e4c316-0126-4665-ad06-b0e610553fbc None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:23.912993 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 97/189] 10.222.0.86 () {56 vars in 1186 bytes} [Tue Jun 7 14:20:23 2022] GET /identity/v3/projects/3cd4810e72844bb58991b6fc44dacec5 => generated 298 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:23.914200 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16edfefe-b846-4fc4-baa9-c64d9fd56fd5 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:23.914495 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16edfefe-b846-4fc4-baa9-c64d9fd56fd5 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:23.914776 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16edfefe-b846-4fc4-baa9-c64d9fd56fd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:23.920800 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:23.932739 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-16edfefe-b846-4fc4-baa9-c64d9fd56fd5 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:20:23.933923 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-16edfefe-b846-4fc4-baa9-c64d9fd56fd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:20:23.949452 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db15273-06f4-44ac-be9d-7f873cdc862f None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:23.983108 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996f4420-3d25-448a-ad9e-67bfb0bafd07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:23.983768 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996f4420-3d25-448a-ad9e-67bfb0bafd07 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:23.984073 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996f4420-3d25-448a-ad9e-67bfb0bafd07 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:23.984354 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996f4420-3d25-448a-ad9e-67bfb0bafd07 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:23.999831 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 98/190] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:20:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 14:20:24.011967 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16edfefe-b846-4fc4-baa9-c64d9fd56fd5 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:24.052129 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996f4420-3d25-448a-ad9e-67bfb0bafd07 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:24.053637 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996f4420-3d25-448a-ad9e-67bfb0bafd07 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:24.095681 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:24.110816 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16edfefe-b846-4fc4-baa9-c64d9fd56fd5 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:24.124090 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:24.144968 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a568c44-ba78-4cf2-9576-22c20307e2d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:24.145758 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a568c44-ba78-4cf2-9576-22c20307e2d8 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:24.146042 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a568c44-ba78-4cf2-9576-22c20307e2d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:24.146316 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a568c44-ba78-4cf2-9576-22c20307e2d8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:24.155320 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 93/191] 10.222.0.86 () {58 vars in 1282 bytes} [Tue Jun 7 14:20:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 07 14:20:24.156180 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996f4420-3d25-448a-ad9e-67bfb0bafd07 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:24.160727 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a568c44-ba78-4cf2-9576-22c20307e2d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:20:24.168665 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-4a568c44-ba78-4cf2-9576-22c20307e2d8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 07 14:20:24.168665 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:20:24.168665 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:20:24.168665 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:20:24.168665 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:20:24.168665 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:20:24.168665 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:20:24.168665 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:20:24.168665 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:20:24.168665 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:20:24.168665 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:20:24.168665 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:20:24.168665 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:20:24.168665 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:20:24.168665 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:20:24.168665 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:20:24.169526 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:20:24.169526 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:20:24.169526 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:20:24.169526 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:20:24.169526 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:20:24.169526 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:20:24.169526 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:20:24.169526 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:20:24.169526 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:20:24.169526 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:20:24.169526 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:20:24.169526 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jun 07 14:20:24.169526 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:20:24.169526 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:20:24.169526 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:20:24.169526 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:20:24.175162 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:20:24.175162 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:20:24.175162 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:20:24.175162 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:20:24.175162 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:20:24.175162 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:20:24.175162 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:20:24.175162 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:20:24.175162 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:20:24.175162 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:20:24.175162 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 07 14:20:24.175162 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:20:24.175162 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 99/192] 10.222.0.86 () {56 vars in 1099 bytes} [Tue Jun 7 14:20:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:20:24.175162 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a568c44-ba78-4cf2-9576-22c20307e2d8 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:24.255841 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996f4420-3d25-448a-ad9e-67bfb0bafd07 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:24.270189 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a568c44-ba78-4cf2-9576-22c20307e2d8 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:24.289772 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a3085b-5989-4394-acc4-08bcffb4218a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:24.290432 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a3085b-5989-4394-acc4-08bcffb4218a None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:24.290708 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a3085b-5989-4394-acc4-08bcffb4218a None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:24.290980 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a3085b-5989-4394-acc4-08bcffb4218a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:24.292082 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a3085b-5989-4394-acc4-08bcffb4218a None admin] RBAC: Adding query filter params (role.id=c17acc2a8bb348f59ba7edd22fcf0c47, scope.project.id=dd1d9739ff9648cfaa8cc32f1b6552e3, user.id=a453037a2b4a425fa2238ee5e0d74396) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:20:24.292400 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a3085b-5989-4394-acc4-08bcffb4218a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:24.293842 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a3085b-5989-4394-acc4-08bcffb4218a None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:24.301941 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 94/193] 10.222.0.86 () {56 vars in 1374 bytes} [Tue Jun 7 14:20:24 2022] GET /identity/v3/role_assignments?user.id=a453037a2b4a425fa2238ee5e0d74396&scope.project.id=dd1d9739ff9648cfaa8cc32f1b6552e3&role.id=c17acc2a8bb348f59ba7edd22fcf0c47 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:24.302286 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4efafce-fdba-4658-95df-554bd3c614e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:24.302947 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4efafce-fdba-4658-95df-554bd3c614e6 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:24.303047 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a3085b-5989-4394-acc4-08bcffb4218a None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:24.303234 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4efafce-fdba-4658-95df-554bd3c614e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:24.303508 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4efafce-fdba-4658-95df-554bd3c614e6 None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:24.304288 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4efafce-fdba-4658-95df-554bd3c614e6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:20:24.304606 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4efafce-fdba-4658-95df-554bd3c614e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:24.305985 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4efafce-fdba-4658-95df-554bd3c614e6 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:24.315520 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 100/194] 10.222.0.86 () {56 vars in 1111 bytes} [Tue Jun 7 14:20:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:24.316664 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4efafce-fdba-4658-95df-554bd3c614e6 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:24.327730 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:24.352640 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:24.423971 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a3085b-5989-4394-acc4-08bcffb4218a None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:24.430532 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4efafce-fdba-4658-95df-554bd3c614e6 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:24.465494 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a953da-aaf6-46a8-a37b-d1d2e6a7cb1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:24.466302 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a953da-aaf6-46a8-a37b-d1d2e6a7cb1a None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:24.466582 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a953da-aaf6-46a8-a37b-d1d2e6a7cb1a None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:24.466852 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a953da-aaf6-46a8-a37b-d1d2e6a7cb1a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:24.468148 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a953da-aaf6-46a8-a37b-d1d2e6a7cb1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:24.469130 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5347e7d9-3bcb-46c3-bd4d-6a59ddc37937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:24.469646 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a953da-aaf6-46a8-a37b-d1d2e6a7cb1a None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:24.469827 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5347e7d9-3bcb-46c3-bd4d-6a59ddc37937 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:24.470085 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5347e7d9-3bcb-46c3-bd4d-6a59ddc37937 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:24.470363 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5347e7d9-3bcb-46c3-bd4d-6a59ddc37937 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:24.471529 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5347e7d9-3bcb-46c3-bd4d-6a59ddc37937 None admin] RBAC: Adding query filter params (role.id=a2755a2b621b4e969fd366f0035d672b, scope.project.id=3cd4810e72844bb58991b6fc44dacec5, user.id=a453037a2b4a425fa2238ee5e0d74396) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:20:24.471637 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 101/195] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jun 7 14:20:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:24.471722 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5347e7d9-3bcb-46c3-bd4d-6a59ddc37937 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:24.473015 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5347e7d9-3bcb-46c3-bd4d-6a59ddc37937 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:24.476763 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a953da-aaf6-46a8-a37b-d1d2e6a7cb1a None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:24.480251 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 95/196] 10.222.0.86 () {56 vars in 1374 bytes} [Tue Jun 7 14:20:24 2022] GET /identity/v3/role_assignments?user.id=a453037a2b4a425fa2238ee5e0d74396&scope.project.id=3cd4810e72844bb58991b6fc44dacec5&role.id=a2755a2b621b4e969fd366f0035d672b => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:24.482164 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5347e7d9-3bcb-46c3-bd4d-6a59ddc37937 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:24.584145 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:24.615510 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a953da-aaf6-46a8-a37b-d1d2e6a7cb1a None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:24.618193 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:24.621285 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5347e7d9-3bcb-46c3-bd4d-6a59ddc37937 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:24.653353 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1ca88e-916b-4cc0-ae26-0f62060a42fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:24.654231 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1ca88e-916b-4cc0-ae26-0f62060a42fa None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:24.654510 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1ca88e-916b-4cc0-ae26-0f62060a42fa None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:24.654792 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1ca88e-916b-4cc0-ae26-0f62060a42fa None admin] PATH_INFO: `/v3/projects/6c6e558540ce4a0d85d5c0b4a9d24870` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:24.656027 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1ca88e-916b-4cc0-ae26-0f62060a42fa None admin] RBAC: Authorizing `identity:get_project(project_id=6c6e558540ce4a0d85d5c0b4a9d24870)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:24.658043 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1ca88e-916b-4cc0-ae26-0f62060a42fa None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:24.659524 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9177dc67-1825-41df-ad0b-5a6537b5fb4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:24.659830 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 102/197] 10.222.0.86 () {56 vars in 1186 bytes} [Tue Jun 7 14:20:24 2022] GET /identity/v3/projects/6c6e558540ce4a0d85d5c0b4a9d24870 => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:24.660559 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9177dc67-1825-41df-ad0b-5a6537b5fb4d None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:24.660849 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9177dc67-1825-41df-ad0b-5a6537b5fb4d None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:24.661131 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9177dc67-1825-41df-ad0b-5a6537b5fb4d None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:24.661906 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9177dc67-1825-41df-ad0b-5a6537b5fb4d None admin] RBAC: Adding query filter params (name=reader) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:20:24.662217 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9177dc67-1825-41df-ad0b-5a6537b5fb4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:24.663614 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9177dc67-1825-41df-ad0b-5a6537b5fb4d None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:24.665845 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1ca88e-916b-4cc0-ae26-0f62060a42fa None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:24.674109 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 96/198] 10.222.0.86 () {56 vars in 1101 bytes} [Tue Jun 7 14:20:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:24.674875 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9177dc67-1825-41df-ad0b-5a6537b5fb4d None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:24.782011 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1ca88e-916b-4cc0-ae26-0f62060a42fa None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:24.795463 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9177dc67-1825-41df-ad0b-5a6537b5fb4d None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:24.815393 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2ef5f6-e2d8-42f5-a5a1-fd0def88ab57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:24.816298 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2ef5f6-e2d8-42f5-a5a1-fd0def88ab57 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:24.816993 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2ef5f6-e2d8-42f5-a5a1-fd0def88ab57 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:24.817282 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2ef5f6-e2d8-42f5-a5a1-fd0def88ab57 None admin] PATH_INFO: `/v3/users/f7119cc5aa984236b9de50bec037f956` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:24.818483 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2ef5f6-e2d8-42f5-a5a1-fd0def88ab57 None admin] RBAC: Authorizing `identity:get_user(user_id=f7119cc5aa984236b9de50bec037f956)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:24.819959 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2ef5f6-e2d8-42f5-a5a1-fd0def88ab57 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:24.821665 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 103/199] 10.222.0.86 () {56 vars in 1177 bytes} [Tue Jun 7 14:20:24 2022] GET /identity/v3/users/f7119cc5aa984236b9de50bec037f956 => generated 283 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:24.822429 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2ef5f6-e2d8-42f5-a5a1-fd0def88ab57 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:24.833490 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdb9e56-cb07-468c-8261-96d7407a9ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:24.834216 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb9e56-cb07-468c-8261-96d7407a9ace None admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:24.834500 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb9e56-cb07-468c-8261-96d7407a9ace None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:24.835844 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb9e56-cb07-468c-8261-96d7407a9ace None admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:24.835972 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:24.836049 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdb9e56-cb07-468c-8261-96d7407a9ace None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:24.836926 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdb9e56-cb07-468c-8261-96d7407a9ace None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:24.919183 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2ef5f6-e2d8-42f5-a5a1-fd0def88ab57 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:24.951410 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412cb3af-7a92-4bd7-8b88-4003e0868a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:24.952020 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412cb3af-7a92-4bd7-8b88-4003e0868a6a None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:24.952307 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412cb3af-7a92-4bd7-8b88-4003e0868a6a None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:24.952585 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412cb3af-7a92-4bd7-8b88-4003e0868a6a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:24.953988 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412cb3af-7a92-4bd7-8b88-4003e0868a6a None admin] RBAC: Adding query filter params (role.id=e3bf6239f5bf477b965704b086786f11, scope.project.id=6c6e558540ce4a0d85d5c0b4a9d24870, user.id=f7119cc5aa984236b9de50bec037f956) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:20:24.954290 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412cb3af-7a92-4bd7-8b88-4003e0868a6a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:24.955722 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412cb3af-7a92-4bd7-8b88-4003e0868a6a None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:24.961107 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 104/200] 10.222.0.86 () {56 vars in 1374 bytes} [Tue Jun 7 14:20:24 2022] GET /identity/v3/role_assignments?user.id=f7119cc5aa984236b9de50bec037f956&scope.project.id=6c6e558540ce4a0d85d5c0b4a9d24870&role.id=e3bf6239f5bf477b965704b086786f11 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:24.961873 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412cb3af-7a92-4bd7-8b88-4003e0868a6a None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:25.043235 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:25.051346 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 97/201] 10.222.0.86 () {60 vars in 1132 bytes} [Tue Jun 7 14:20:24 2022] POST /identity/v3/users => generated 297 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:20:25.052395 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdb9e56-cb07-468c-8261-96d7407a9ace None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:25.083132 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412cb3af-7a92-4bd7-8b88-4003e0868a6a None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:25.085083 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:25.134431 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2141bc16-083e-45c4-b6e0-a85a9f571f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:25.135678 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2141bc16-083e-45c4-b6e0-a85a9f571f63 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:25.136012 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2141bc16-083e-45c4-b6e0-a85a9f571f63 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:25.136329 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2141bc16-083e-45c4-b6e0-a85a9f571f63 None admin] PATH_INFO: `/v3/users/35094e5446044635bb90baf80fccdf18` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:25.138042 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2141bc16-083e-45c4-b6e0-a85a9f571f63 None admin] RBAC: Authorizing `identity:get_user(user_id=35094e5446044635bb90baf80fccdf18)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:25.140443 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2141bc16-083e-45c4-b6e0-a85a9f571f63 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:25.143367 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 105/202] 10.222.0.86 () {56 vars in 1177 bytes} [Tue Jun 7 14:20:24 2022] GET /identity/v3/users/35094e5446044635bb90baf80fccdf18 => generated 289 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:25.155787 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2141bc16-083e-45c4-b6e0-a85a9f571f63 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:25.200766 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdb9e56-cb07-468c-8261-96d7407a9ace None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:25.248038 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ec6c15-1fbc-4ff7-9094-6afb12742914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:25.248956 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ec6c15-1fbc-4ff7-9094-6afb12742914 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:25.249410 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ec6c15-1fbc-4ff7-9094-6afb12742914 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:25.249831 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ec6c15-1fbc-4ff7-9094-6afb12742914 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:25.300044 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2141bc16-083e-45c4-b6e0-a85a9f571f63 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:25.340677 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ec6c15-1fbc-4ff7-9094-6afb12742914 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:25.342154 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ec6c15-1fbc-4ff7-9094-6afb12742914 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:25.345351 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6d6c68-0761-45d5-b02f-13d350fa3cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:25.346311 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6d6c68-0761-45d5-b02f-13d350fa3cb8 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:25.346870 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6d6c68-0761-45d5-b02f-13d350fa3cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:25.347156 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6d6c68-0761-45d5-b02f-13d350fa3cb8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:25.363199 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:25.364318 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:25.438905 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6d6c68-0761-45d5-b02f-13d350fa3cb8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:25.440405 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6d6c68-0761-45d5-b02f-13d350fa3cb8 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:25.476192 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 98/203] 10.222.0.86 () {58 vars in 1282 bytes} [Tue Jun 7 14:20:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 07 14:20:25.482578 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ec6c15-1fbc-4ff7-9094-6afb12742914 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:25.577598 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 106/204] 10.222.0.86 () {58 vars in 1282 bytes} [Tue Jun 7 14:20:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 07 14:20:25.583017 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6d6c68-0761-45d5-b02f-13d350fa3cb8 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:25.600709 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ec6c15-1fbc-4ff7-9094-6afb12742914 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:25.622019 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:25.638803 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:25.641000 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c240f35-9736-4f27-972a-962ad2fa0d86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:25.641996 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c240f35-9736-4f27-972a-962ad2fa0d86 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:25.642284 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c240f35-9736-4f27-972a-962ad2fa0d86 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:25.642563 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c240f35-9736-4f27-972a-962ad2fa0d86 None admin] PATH_INFO: `/v3/projects/6c6e558540ce4a0d85d5c0b4a9d24870` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:25.643802 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c240f35-9736-4f27-972a-962ad2fa0d86 None admin] RBAC: Authorizing `identity:get_project(project_id=6c6e558540ce4a0d85d5c0b4a9d24870)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:25.645919 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c240f35-9736-4f27-972a-962ad2fa0d86 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:25.648067 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 99/205] 10.222.0.86 () {56 vars in 1186 bytes} [Tue Jun 7 14:20:25 2022] GET /identity/v3/projects/6c6e558540ce4a0d85d5c0b4a9d24870 => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:25.655275 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c240f35-9736-4f27-972a-962ad2fa0d86 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:25.765988 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6d6c68-0761-45d5-b02f-13d350fa3cb8 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:25.834658 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2829caa-feac-4d08-a525-99c8b653de6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:25.835529 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2829caa-feac-4d08-a525-99c8b653de6f None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:25.835838 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2829caa-feac-4d08-a525-99c8b653de6f None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:25.836230 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2829caa-feac-4d08-a525-99c8b653de6f None admin] PATH_INFO: `/v3/projects/3cd4810e72844bb58991b6fc44dacec5` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:25.838584 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2829caa-feac-4d08-a525-99c8b653de6f None admin] RBAC: Authorizing `identity:get_project(project_id=3cd4810e72844bb58991b6fc44dacec5)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:25.840144 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2829caa-feac-4d08-a525-99c8b653de6f None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:25.846719 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 107/206] 10.222.0.86 () {56 vars in 1186 bytes} [Tue Jun 7 14:20:25 2022] GET /identity/v3/projects/3cd4810e72844bb58991b6fc44dacec5 => generated 298 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:20:25.849265 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c240f35-9736-4f27-972a-962ad2fa0d86 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:25.852197 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2829caa-feac-4d08-a525-99c8b653de6f None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:25.954763 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4ec5bb-56b4-4510-b0a7-038c48d50bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:25.955431 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4ec5bb-56b4-4510-b0a7-038c48d50bc8 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:25.955714 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4ec5bb-56b4-4510-b0a7-038c48d50bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:25.956041 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4ec5bb-56b4-4510-b0a7-038c48d50bc8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:25.956881 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4ec5bb-56b4-4510-b0a7-038c48d50bc8 None admin] RBAC: Adding query filter params (role.id=a2755a2b621b4e969fd366f0035d672b, scope.project.id=6c6e558540ce4a0d85d5c0b4a9d24870, user.id=f7119cc5aa984236b9de50bec037f956) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:20:25.957192 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4ec5bb-56b4-4510-b0a7-038c48d50bc8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:25.958635 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4ec5bb-56b4-4510-b0a7-038c48d50bc8 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:25.967856 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 100/207] 10.222.0.86 () {56 vars in 1374 bytes} [Tue Jun 7 14:20:25 2022] GET /identity/v3/role_assignments?user.id=f7119cc5aa984236b9de50bec037f956&scope.project.id=6c6e558540ce4a0d85d5c0b4a9d24870&role.id=a2755a2b621b4e969fd366f0035d672b => generated 259 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:20:26.060888 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2829caa-feac-4d08-a525-99c8b653de6f None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:26.077322 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:26.113132 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80ac4e3-04f5-417d-9b0e-02d17421bb9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:26.113810 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80ac4e3-04f5-417d-9b0e-02d17421bb9b None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:26.114096 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80ac4e3-04f5-417d-9b0e-02d17421bb9b None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:26.114374 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80ac4e3-04f5-417d-9b0e-02d17421bb9b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:26.115238 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80ac4e3-04f5-417d-9b0e-02d17421bb9b None admin] RBAC: Adding query filter params (role.id=bce2bd9e8c164e7ca92ba5e110848be0, scope.project.id=3cd4810e72844bb58991b6fc44dacec5, user.id=35094e5446044635bb90baf80fccdf18) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:20:26.115553 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80ac4e3-04f5-417d-9b0e-02d17421bb9b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:26.117259 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80ac4e3-04f5-417d-9b0e-02d17421bb9b None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:26.128987 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 108/208] 10.222.0.86 () {56 vars in 1374 bytes} [Tue Jun 7 14:20:25 2022] GET /identity/v3/role_assignments?user.id=35094e5446044635bb90baf80fccdf18&scope.project.id=3cd4810e72844bb58991b6fc44dacec5&role.id=bce2bd9e8c164e7ca92ba5e110848be0 => generated 608 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:20:27.397406 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4926ad6a-086f-4824-9eff-654ad1977204 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:27.398274 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4926ad6a-086f-4824-9eff-654ad1977204 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:27.398702 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4926ad6a-086f-4824-9eff-654ad1977204 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:27.400636 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 101/209] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:20:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:20:27.406748 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7d4a9f-23b0-42f4-a881-b160689d8eb0 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:27.407667 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7d4a9f-23b0-42f4-a881-b160689d8eb0 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:27.408187 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7d4a9f-23b0-42f4-a881-b160689d8eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:27.425913 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-3f7d4a9f-23b0-42f4-a881-b160689d8eb0 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:20:27.427421 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-3f7d4a9f-23b0-42f4-a881-b160689d8eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:20:27.504309 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 109/210] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:20:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 14:20:27.526650 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4926ad6a-086f-4824-9eff-654ad1977204 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:27.582703 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:27.634846 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4926ad6a-086f-4824-9eff-654ad1977204 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:27.670713 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7988e67-fea0-47ea-929e-b83feaa567c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:27.671884 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7988e67-fea0-47ea-929e-b83feaa567c1 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:27.672428 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7988e67-fea0-47ea-929e-b83feaa567c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:27.672905 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7988e67-fea0-47ea-929e-b83feaa567c1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:27.683706 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7988e67-fea0-47ea-929e-b83feaa567c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:20:27.691713 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-b7988e67-fea0-47ea-929e-b83feaa567c1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 14:20:27.691713 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:20:27.691713 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:20:27.691713 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:20:27.691713 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:20:27.691713 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:20:27.691713 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:20:27.691713 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:20:27.691713 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:20:27.691713 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:20:27.691713 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:20:27.691713 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:20:27.691713 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:20:27.691713 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:20:27.691713 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:20:27.691713 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:20:27.692806 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:20:27.692806 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:20:27.692806 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:20:27.692806 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:20:27.692806 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:20:27.692806 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:20:27.692806 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:20:27.692806 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:20:27.692806 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:20:27.692806 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:20:27.692806 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:20:27.692806 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jun 07 14:20:27.692806 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:20:27.692806 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:20:27.692806 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:20:27.692806 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:20:27.693760 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:20:27.693760 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:20:27.693760 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:20:27.693760 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:20:27.693760 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:20:27.693760 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:20:27.693760 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:20:27.693760 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:20:27.693760 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:20:27.693760 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:20:27.693760 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 14:20:27.693760 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:20:27.696179 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 102/211] 10.222.0.86 () {56 vars in 1096 bytes} [Tue Jun 7 14:20:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:20:27.701563 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7d4a9f-23b0-42f4-a881-b160689d8eb0 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:27.759231 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b25cc-107c-4133-ad37-92b5f8aacc45 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:27.759482 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b25cc-107c-4133-ad37-92b5f8aacc45 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:27.760047 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b25cc-107c-4133-ad37-92b5f8aacc45 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:27.762147 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 103/212] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:20:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 07 14:20:27.770655 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f97984-2981-40c1-ba83-18b1218e8c88 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:27.771029 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f97984-2981-40c1-ba83-18b1218e8c88 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:27.771382 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f97984-2981-40c1-ba83-18b1218e8c88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:27.791155 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-86f97984-2981-40c1-ba83-18b1218e8c88 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:20:27.792643 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-86f97984-2981-40c1-ba83-18b1218e8c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:20:27.813545 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7d4a9f-23b0-42f4-a881-b160689d8eb0 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:27.817221 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:27.853236 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b9ab91-563a-4891-ae85-bac8a06125e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:27.854302 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b9ab91-563a-4891-ae85-bac8a06125e2 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:27.854800 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b9ab91-563a-4891-ae85-bac8a06125e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:27.855148 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b9ab91-563a-4891-ae85-bac8a06125e2 None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:27.856105 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b9ab91-563a-4891-ae85-bac8a06125e2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:20:27.856425 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b9ab91-563a-4891-ae85-bac8a06125e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:27.857936 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b9ab91-563a-4891-ae85-bac8a06125e2 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:27.861121 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 104/213] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:20:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 07 14:20:27.871002 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 110/214] 10.222.0.86 () {56 vars in 1099 bytes} [Tue Jun 7 14:20:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:20:27.871147 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe4fc80-9375-4d71-b452-cac35c2adc14 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:27.871147 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe4fc80-9375-4d71-b452-cac35c2adc14 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:27.871147 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe4fc80-9375-4d71-b452-cac35c2adc14 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:27.872026 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b9ab91-563a-4891-ae85-bac8a06125e2 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:27.872398 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 105/215] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:20:27 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:20:27.878475 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1b86fa-82be-40b7-923a-2a86dc1fe3bd None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:27.879022 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1b86fa-82be-40b7-923a-2a86dc1fe3bd None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:27.879529 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1b86fa-82be-40b7-923a-2a86dc1fe3bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:27.897062 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-dc1b86fa-82be-40b7-923a-2a86dc1fe3bd None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:20:27.898373 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-dc1b86fa-82be-40b7-923a-2a86dc1fe3bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:20:27.938044 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:27.972352 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 106/216] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:20:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 07 14:20:27.979940 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1b86fa-82be-40b7-923a-2a86dc1fe3bd None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:27.992644 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b9ab91-563a-4891-ae85-bac8a06125e2 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:28.030419 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d09918-8c93-4734-bad3-fc9728633a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:28.031678 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d09918-8c93-4734-bad3-fc9728633a86 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:28.032164 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d09918-8c93-4734-bad3-fc9728633a86 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:28.032613 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d09918-8c93-4734-bad3-fc9728633a86 None admin] PATH_INFO: `/v3/users/f7119cc5aa984236b9de50bec037f956` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:28.034146 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d09918-8c93-4734-bad3-fc9728633a86 None admin] RBAC: Authorizing `identity:get_user(user_id=f7119cc5aa984236b9de50bec037f956)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:28.035928 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d09918-8c93-4734-bad3-fc9728633a86 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:28.037841 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 111/217] 10.222.0.86 () {56 vars in 1177 bytes} [Tue Jun 7 14:20:27 2022] GET /identity/v3/users/f7119cc5aa984236b9de50bec037f956 => generated 283 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:20:28.038755 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d09918-8c93-4734-bad3-fc9728633a86 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:28.076490 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:28.078215 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1b86fa-82be-40b7-923a-2a86dc1fe3bd None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:28.114302 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c192b98-cd4f-4e45-9f86-4cf3cfd6dfc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:28.115107 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c192b98-cd4f-4e45-9f86-4cf3cfd6dfc3 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:28.115389 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c192b98-cd4f-4e45-9f86-4cf3cfd6dfc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:28.115659 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c192b98-cd4f-4e45-9f86-4cf3cfd6dfc3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:28.126982 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c192b98-cd4f-4e45-9f86-4cf3cfd6dfc3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:20:28.134787 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-2c192b98-cd4f-4e45-9f86-4cf3cfd6dfc3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 07 14:20:28.134787 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:20:28.134787 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:20:28.134787 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:20:28.134787 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:20:28.134787 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:20:28.134787 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:20:28.134787 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:20:28.134787 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:20:28.134787 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:20:28.134787 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:20:28.134787 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:20:28.134787 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:20:28.134787 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:20:28.134787 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:20:28.134787 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:20:28.135629 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:20:28.135629 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:20:28.135629 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:20:28.135629 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:20:28.135629 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:20:28.135629 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:20:28.135629 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:20:28.135629 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:20:28.135629 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:20:28.135629 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:20:28.135629 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:20:28.135629 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jun 07 14:20:28.135629 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:20:28.135629 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:20:28.135629 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:20:28.135629 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:20:28.136526 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:20:28.136526 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:20:28.136526 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:20:28.136526 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:20:28.136526 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:20:28.136526 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:20:28.136526 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:20:28.136526 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:20:28.136526 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:20:28.136526 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:20:28.136526 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 07 14:20:28.136526 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:20:28.136526 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 107/218] 10.222.0.86 () {56 vars in 1099 bytes} [Tue Jun 7 14:20:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:20:28.140948 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c192b98-cd4f-4e45-9f86-4cf3cfd6dfc3 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:28.158291 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d09918-8c93-4734-bad3-fc9728633a86 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:28.172719 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:28.195680 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a32ea5a-b6ae-46ca-baea-16ab0e73bdf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:28.196505 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a32ea5a-b6ae-46ca-baea-16ab0e73bdf9 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:28.196794 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a32ea5a-b6ae-46ca-baea-16ab0e73bdf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:28.197072 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a32ea5a-b6ae-46ca-baea-16ab0e73bdf9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:28.198691 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a32ea5a-b6ae-46ca-baea-16ab0e73bdf9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:28.200283 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a32ea5a-b6ae-46ca-baea-16ab0e73bdf9 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:28.201918 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 112/219] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jun 7 14:20:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:28.201918 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a32ea5a-b6ae-46ca-baea-16ab0e73bdf9 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:28.256796 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c192b98-cd4f-4e45-9f86-4cf3cfd6dfc3 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:28.292173 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd07c2af-1bd0-41ca-bd8f-59ac9ae46a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:28.292955 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd07c2af-1bd0-41ca-bd8f-59ac9ae46a86 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:28.293237 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd07c2af-1bd0-41ca-bd8f-59ac9ae46a86 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:28.293514 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd07c2af-1bd0-41ca-bd8f-59ac9ae46a86 None admin] PATH_INFO: `/v3/projects/6c6e558540ce4a0d85d5c0b4a9d24870` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:28.294718 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd07c2af-1bd0-41ca-bd8f-59ac9ae46a86 None admin] RBAC: Authorizing `identity:get_project(project_id=6c6e558540ce4a0d85d5c0b4a9d24870)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:28.296580 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd07c2af-1bd0-41ca-bd8f-59ac9ae46a86 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:28.298425 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 108/220] 10.222.0.86 () {56 vars in 1186 bytes} [Tue Jun 7 14:20:28 2022] GET /identity/v3/projects/6c6e558540ce4a0d85d5c0b4a9d24870 => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:28.303930 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd07c2af-1bd0-41ca-bd8f-59ac9ae46a86 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:28.309956 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a32ea5a-b6ae-46ca-baea-16ab0e73bdf9 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:28.311656 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:28.347410 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92134a6-6621-4528-8ecb-c969ce313391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:28.348189 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92134a6-6621-4528-8ecb-c969ce313391 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:28.348846 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92134a6-6621-4528-8ecb-c969ce313391 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:28.349123 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92134a6-6621-4528-8ecb-c969ce313391 None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:28.350161 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92134a6-6621-4528-8ecb-c969ce313391 None admin] RBAC: Adding query filter params (name=member) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:20:28.350471 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92134a6-6621-4528-8ecb-c969ce313391 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:28.352570 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92134a6-6621-4528-8ecb-c969ce313391 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:28.367706 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 113/221] 10.222.0.86 () {56 vars in 1101 bytes} [Tue Jun 7 14:20:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:28.367706 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92134a6-6621-4528-8ecb-c969ce313391 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:28.410173 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:28.414171 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd07c2af-1bd0-41ca-bd8f-59ac9ae46a86 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:28.448736 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ac013d-1466-4d26-99f7-6a93c4b27e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:28.449483 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ac013d-1466-4d26-99f7-6a93c4b27e6d None admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:28.449763 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ac013d-1466-4d26-99f7-6a93c4b27e6d None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:28.450035 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ac013d-1466-4d26-99f7-6a93c4b27e6d None admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:28.450740 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ac013d-1466-4d26-99f7-6a93c4b27e6d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:28.452205 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ac013d-1466-4d26-99f7-6a93c4b27e6d None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:28.466168 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92134a6-6621-4528-8ecb-c969ce313391 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:28.498673 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c978748d-7fc4-4e17-b77d-2011c390209b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:28.499546 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c978748d-7fc4-4e17-b77d-2011c390209b None admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:28.499866 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c978748d-7fc4-4e17-b77d-2011c390209b None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:28.500722 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c978748d-7fc4-4e17-b77d-2011c390209b None admin] PATH_INFO: `/v3/projects/6c6e558540ce4a0d85d5c0b4a9d24870/users/f7119cc5aa984236b9de50bec037f956/roles/e3bf6239f5bf477b965704b086786f11` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:28.502631 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c978748d-7fc4-4e17-b77d-2011c390209b None admin] RBAC: Authorizing `identity:create_grant(project_id=6c6e558540ce4a0d85d5c0b4a9d24870, user_id=f7119cc5aa984236b9de50bec037f956, role_id=e3bf6239f5bf477b965704b086786f11)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:28.504075 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c978748d-7fc4-4e17-b77d-2011c390209b None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:28.562134 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 109/222] 10.222.0.86 () {60 vars in 1132 bytes} [Tue Jun 7 14:20:28 2022] POST /identity/v3/users => generated 297 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:20:28.562900 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ac013d-1466-4d26-99f7-6a93c4b27e6d None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:28.591588 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 114/223] 10.222.0.86 () {58 vars in 1439 bytes} [Tue Jun 7 14:20:28 2022] PUT /identity/v3/projects/6c6e558540ce4a0d85d5c0b4a9d24870/users/f7119cc5aa984236b9de50bec037f956/roles/e3bf6239f5bf477b965704b086786f11 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:20:28.599945 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950b0fb7-ca06-4428-b81a-8d3471aa6fc5 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:28.599945 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950b0fb7-ca06-4428-b81a-8d3471aa6fc5 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:28.599945 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950b0fb7-ca06-4428-b81a-8d3471aa6fc5 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:28.599945 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 115/224] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:20:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:20:28.601825 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e921e577-c914-46c2-8feb-09c51b6d2be8 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:28.602186 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e921e577-c914-46c2-8feb-09c51b6d2be8 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:28.602476 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e921e577-c914-46c2-8feb-09c51b6d2be8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:28.621502 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-e921e577-c914-46c2-8feb-09c51b6d2be8 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:20:28.622756 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-e921e577-c914-46c2-8feb-09c51b6d2be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:20:28.643602 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:28.713826 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 116/225] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:20:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 14:20:28.728822 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ac013d-1466-4d26-99f7-6a93c4b27e6d None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:28.737601 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e921e577-c914-46c2-8feb-09c51b6d2be8 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:28.778109 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274c83c9-c892-4678-9ffb-65bc360e925a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:28.779008 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274c83c9-c892-4678-9ffb-65bc360e925a None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:28.779288 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274c83c9-c892-4678-9ffb-65bc360e925a None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:28.779561 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274c83c9-c892-4678-9ffb-65bc360e925a None admin] PATH_INFO: `/v3/users/351e45598a2743978ac8dce1348662d9` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:28.800292 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274c83c9-c892-4678-9ffb-65bc360e925a None admin] RBAC: Authorizing `identity:get_user(user_id=351e45598a2743978ac8dce1348662d9)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:28.802375 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274c83c9-c892-4678-9ffb-65bc360e925a None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:28.804232 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 110/226] 10.222.0.86 () {56 vars in 1177 bytes} [Tue Jun 7 14:20:28 2022] GET /identity/v3/users/351e45598a2743978ac8dce1348662d9 => generated 297 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:28.810337 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274c83c9-c892-4678-9ffb-65bc360e925a None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:28.829040 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:28.865519 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e921e577-c914-46c2-8feb-09c51b6d2be8 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:28.905095 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eab3033-1e54-4321-a694-cd029b035b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:28.905907 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eab3033-1e54-4321-a694-cd029b035b17 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:28.906186 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eab3033-1e54-4321-a694-cd029b035b17 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:28.906493 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eab3033-1e54-4321-a694-cd029b035b17 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:28.919326 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eab3033-1e54-4321-a694-cd029b035b17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:20:28.929062 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-8eab3033-1e54-4321-a694-cd029b035b17 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 07 14:20:28.929062 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:20:28.929062 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:20:28.929062 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:20:28.929062 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:20:28.929062 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:20:28.929062 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:20:28.929062 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:20:28.929062 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:20:28.929062 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:20:28.929062 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:20:28.929062 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:20:28.929062 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:20:28.929062 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:20:28.929062 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:20:28.929062 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:20:28.930144 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:20:28.930144 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:20:28.930144 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:20:28.930144 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:20:28.930144 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:20:28.930144 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:20:28.930144 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:20:28.930144 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:20:28.930144 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:20:28.930144 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:20:28.930144 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:20:28.930144 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jun 07 14:20:28.930144 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:20:28.930144 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:20:28.930144 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:20:28.930144 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:20:28.930969 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:20:28.930969 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:20:28.930969 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:20:28.930969 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:20:28.930969 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:20:28.930969 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:20:28.930969 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:20:28.930969 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:20:28.930969 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:20:28.930969 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:20:28.930969 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 07 14:20:28.930969 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:20:28.930969 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 117/227] 10.222.0.86 () {56 vars in 1114 bytes} [Tue Jun 7 14:20:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 14:20:28.936186 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274c83c9-c892-4678-9ffb-65bc360e925a None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:28.936338 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eab3033-1e54-4321-a694-cd029b035b17 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:28.957679 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:28.982750 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3cd27f-50df-4dbe-be0c-5fb58c4e2f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:28.983416 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3cd27f-50df-4dbe-be0c-5fb58c4e2f63 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:28.983705 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3cd27f-50df-4dbe-be0c-5fb58c4e2f63 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:28.984012 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3cd27f-50df-4dbe-be0c-5fb58c4e2f63 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:29.064321 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eab3033-1e54-4321-a694-cd029b035b17 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:29.080532 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3cd27f-50df-4dbe-be0c-5fb58c4e2f63 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:29.082392 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3cd27f-50df-4dbe-be0c-5fb58c4e2f63 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:29.102496 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:29.106028 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09efc0c8-d129-45cd-8be8-f76f93dbd916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:29.106874 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09efc0c8-d129-45cd-8be8-f76f93dbd916 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:29.107383 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09efc0c8-d129-45cd-8be8-f76f93dbd916 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:29.107834 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09efc0c8-d129-45cd-8be8-f76f93dbd916 None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:29.108802 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09efc0c8-d129-45cd-8be8-f76f93dbd916 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:20:29.109250 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09efc0c8-d129-45cd-8be8-f76f93dbd916 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:29.111291 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09efc0c8-d129-45cd-8be8-f76f93dbd916 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:29.120745 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 118/228] 10.222.0.86 () {56 vars in 1111 bytes} [Tue Jun 7 14:20:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:20:29.127922 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09efc0c8-d129-45cd-8be8-f76f93dbd916 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:29.225087 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 111/229] 10.222.0.86 () {58 vars in 1282 bytes} [Tue Jun 7 14:20:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 07 14:20:29.227746 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:29.230968 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3cd27f-50df-4dbe-be0c-5fb58c4e2f63 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:29.272180 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09efc0c8-d129-45cd-8be8-f76f93dbd916 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:29.343186 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8235475-736a-4337-af5f-75e07ccc9764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:29.344861 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8235475-736a-4337-af5f-75e07ccc9764 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:29.345318 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8235475-736a-4337-af5f-75e07ccc9764 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:29.345979 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8235475-736a-4337-af5f-75e07ccc9764 None admin] PATH_INFO: `/v3/users/f7119cc5aa984236b9de50bec037f956` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:29.351907 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8235475-736a-4337-af5f-75e07ccc9764 None admin] RBAC: Authorizing `identity:get_user(user_id=f7119cc5aa984236b9de50bec037f956)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:29.351907 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8235475-736a-4337-af5f-75e07ccc9764 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:29.351907 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 119/230] 10.222.0.86 () {56 vars in 1177 bytes} [Tue Jun 7 14:20:29 2022] GET /identity/v3/users/f7119cc5aa984236b9de50bec037f956 => generated 283 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:29.360345 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8235475-736a-4337-af5f-75e07ccc9764 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:29.439825 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3cd27f-50df-4dbe-be0c-5fb58c4e2f63 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:29.484126 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:29.511798 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774c78f8-7cda-42f5-be49-c4e13ad58bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:29.512672 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774c78f8-7cda-42f5-be49-c4e13ad58bdb None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:29.512975 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774c78f8-7cda-42f5-be49-c4e13ad58bdb None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:29.513253 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774c78f8-7cda-42f5-be49-c4e13ad58bdb None admin] PATH_INFO: `/v3/projects/6c6e558540ce4a0d85d5c0b4a9d24870` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:29.514662 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774c78f8-7cda-42f5-be49-c4e13ad58bdb None admin] RBAC: Authorizing `identity:get_project(project_id=6c6e558540ce4a0d85d5c0b4a9d24870)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:29.516720 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774c78f8-7cda-42f5-be49-c4e13ad58bdb None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:29.520035 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 112/231] 10.222.0.86 () {56 vars in 1186 bytes} [Tue Jun 7 14:20:29 2022] GET /identity/v3/projects/6c6e558540ce4a0d85d5c0b4a9d24870 => generated 302 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:29.526735 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774c78f8-7cda-42f5-be49-c4e13ad58bdb None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:29.558347 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8235475-736a-4337-af5f-75e07ccc9764 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:29.622460 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f64d03-e9f9-451e-a0c0-4fd556368fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:29.623244 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f64d03-e9f9-451e-a0c0-4fd556368fa2 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:29.623528 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f64d03-e9f9-451e-a0c0-4fd556368fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:29.623860 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f64d03-e9f9-451e-a0c0-4fd556368fa2 None admin] PATH_INFO: `/v3/projects/6c6e558540ce4a0d85d5c0b4a9d24870` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:29.625690 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f64d03-e9f9-451e-a0c0-4fd556368fa2 None admin] RBAC: Authorizing `identity:get_project(project_id=6c6e558540ce4a0d85d5c0b4a9d24870)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:29.627162 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f64d03-e9f9-451e-a0c0-4fd556368fa2 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:29.631115 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 120/232] 10.222.0.86 () {56 vars in 1186 bytes} [Tue Jun 7 14:20:29 2022] GET /identity/v3/projects/6c6e558540ce4a0d85d5c0b4a9d24870 => generated 302 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:29.634900 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f64d03-e9f9-451e-a0c0-4fd556368fa2 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:29.662158 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:29.707023 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774c78f8-7cda-42f5-be49-c4e13ad58bdb None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:29.774876 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f64d03-e9f9-451e-a0c0-4fd556368fa2 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:29.795659 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a71036-5038-4696-bbe2-f3b90f0a6166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:29.796348 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a71036-5038-4696-bbe2-f3b90f0a6166 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:29.796634 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a71036-5038-4696-bbe2-f3b90f0a6166 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:29.796937 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a71036-5038-4696-bbe2-f3b90f0a6166 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:29.797784 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a71036-5038-4696-bbe2-f3b90f0a6166 None admin] RBAC: Adding query filter params (role.id=c17acc2a8bb348f59ba7edd22fcf0c47, scope.project.id=6c6e558540ce4a0d85d5c0b4a9d24870, user.id=351e45598a2743978ac8dce1348662d9) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:20:29.798092 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a71036-5038-4696-bbe2-f3b90f0a6166 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:29.799522 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a71036-5038-4696-bbe2-f3b90f0a6166 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:29.810445 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e13449-d398-4fc4-b6e8-d2826ed540db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:29.811338 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e13449-d398-4fc4-b6e8-d2826ed540db None admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:29.811629 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e13449-d398-4fc4-b6e8-d2826ed540db None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:29.811936 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e13449-d398-4fc4-b6e8-d2826ed540db None admin] PATH_INFO: `/v3/projects/6c6e558540ce4a0d85d5c0b4a9d24870/users/f7119cc5aa984236b9de50bec037f956/roles/a2755a2b621b4e969fd366f0035d672b` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:29.814493 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e13449-d398-4fc4-b6e8-d2826ed540db None admin] RBAC: Authorizing `identity:create_grant(project_id=6c6e558540ce4a0d85d5c0b4a9d24870, user_id=f7119cc5aa984236b9de50bec037f956, role_id=a2755a2b621b4e969fd366f0035d672b)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:29.814827 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 113/233] 10.222.0.86 () {56 vars in 1374 bytes} [Tue Jun 7 14:20:29 2022] GET /identity/v3/role_assignments?user.id=351e45598a2743978ac8dce1348662d9&scope.project.id=6c6e558540ce4a0d85d5c0b4a9d24870&role.id=c17acc2a8bb348f59ba7edd22fcf0c47 => generated 259 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:29.821387 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e13449-d398-4fc4-b6e8-d2826ed540db None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:29.938241 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 121/234] 10.222.0.86 () {58 vars in 1439 bytes} [Tue Jun 7 14:20:29 2022] PUT /identity/v3/projects/6c6e558540ce4a0d85d5c0b4a9d24870/users/f7119cc5aa984236b9de50bec037f956/roles/a2755a2b621b4e969fd366f0035d672b => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 14:20:31.369601 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9a41c6-bb41-4226-a3eb-3a4d4794c7a3 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:31.370138 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9a41c6-bb41-4226-a3eb-3a4d4794c7a3 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:31.370138 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9a41c6-bb41-4226-a3eb-3a4d4794c7a3 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:31.371523 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 114/235] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:20:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:20:31.390276 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738d411e-3a99-458f-a315-24ba26c0ac29 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:31.390766 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738d411e-3a99-458f-a315-24ba26c0ac29 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:31.390952 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738d411e-3a99-458f-a315-24ba26c0ac29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:31.411424 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-738d411e-3a99-458f-a315-24ba26c0ac29 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:20:31.412623 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-738d411e-3a99-458f-a315-24ba26c0ac29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:20:31.472639 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6470a223-5210-441e-bcdc-eceeed46b1b1 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:31.472972 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6470a223-5210-441e-bcdc-eceeed46b1b1 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:31.473194 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6470a223-5210-441e-bcdc-eceeed46b1b1 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:31.474567 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 115/236] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:20:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:20:31.495058 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15faa57-36ca-49d4-8e10-895a2d27bbe9 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:31.495287 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15faa57-36ca-49d4-8e10-895a2d27bbe9 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:31.495557 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15faa57-36ca-49d4-8e10-895a2d27bbe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:31.512094 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 122/237] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:20:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 14:20:31.520705 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-b15faa57-36ca-49d4-8e10-895a2d27bbe9 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:20:31.522135 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-b15faa57-36ca-49d4-8e10-895a2d27bbe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:20:31.534606 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738d411e-3a99-458f-a315-24ba26c0ac29 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:31.536732 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:31.600144 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:31.622388 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 116/238] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:20:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 07 14:20:31.634202 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0384e461-f3bc-4da0-8869-0889debc737f None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:31.634518 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0384e461-f3bc-4da0-8869-0889debc737f None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:31.634802 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0384e461-f3bc-4da0-8869-0889debc737f None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:31.636345 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 117/239] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:20:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:20:31.642886 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb8ca5a-a2bc-49b8-a362-82b3ba24ec8c None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:31.643177 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb8ca5a-a2bc-49b8-a362-82b3ba24ec8c None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:31.643461 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb8ca5a-a2bc-49b8-a362-82b3ba24ec8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:31.671637 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-acb8ca5a-a2bc-49b8-a362-82b3ba24ec8c None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:20:31.673293 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-acb8ca5a-a2bc-49b8-a362-82b3ba24ec8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:20:31.680686 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738d411e-3a99-458f-a315-24ba26c0ac29 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:31.716585 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3254e1c-acaf-40fb-a3a0-8b80eb21ffd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:31.717568 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3254e1c-acaf-40fb-a3a0-8b80eb21ffd8 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:31.717866 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3254e1c-acaf-40fb-a3a0-8b80eb21ffd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:31.718146 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3254e1c-acaf-40fb-a3a0-8b80eb21ffd8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:31.729245 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3254e1c-acaf-40fb-a3a0-8b80eb21ffd8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:20:31.737648 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-e3254e1c-acaf-40fb-a3a0-8b80eb21ffd8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 14:20:31.737648 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:20:31.737648 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:20:31.737648 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:20:31.737648 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:20:31.737648 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:20:31.737648 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:20:31.737648 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:20:31.737648 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:20:31.737648 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:20:31.737648 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:20:31.737648 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:20:31.737648 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:20:31.737648 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:20:31.737648 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:20:31.737648 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:20:31.738564 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:20:31.738564 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:20:31.738564 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:20:31.738564 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:20:31.738564 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:20:31.738564 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:20:31.738564 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:20:31.738564 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:20:31.738564 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:20:31.738564 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:20:31.738564 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:20:31.738564 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jun 07 14:20:31.738564 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:20:31.738564 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:20:31.738564 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:20:31.738564 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:20:31.739838 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:20:31.739838 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:20:31.739838 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:20:31.739838 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:20:31.739838 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:20:31.739838 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:20:31.739838 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:20:31.739838 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:20:31.739838 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:20:31.739838 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:20:31.739838 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 14:20:31.739838 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:20:31.739838 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 123/240] 10.222.0.86 () {56 vars in 1096 bytes} [Tue Jun 7 14:20:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:20:31.745036 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3254e1c-acaf-40fb-a3a0-8b80eb21ffd8 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:31.754307 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 118/241] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:20:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 07 14:20:31.755904 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb8ca5a-a2bc-49b8-a362-82b3ba24ec8c None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:31.837822 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:31.883435 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3254e1c-acaf-40fb-a3a0-8b80eb21ffd8 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:31.905205 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb8ca5a-a2bc-49b8-a362-82b3ba24ec8c None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:31.908732 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:31.921020 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e99bafe-279e-40a9-822a-c2424f403c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:31.922145 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e99bafe-279e-40a9-822a-c2424f403c06 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:31.922636 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e99bafe-279e-40a9-822a-c2424f403c06 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:31.923085 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e99bafe-279e-40a9-822a-c2424f403c06 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:31.934016 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e99bafe-279e-40a9-822a-c2424f403c06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:20:31.943442 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-3e99bafe-279e-40a9-822a-c2424f403c06 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 07 14:20:31.943442 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:20:31.943442 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:20:31.943442 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:20:31.943442 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:20:31.943442 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:20:31.943442 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:20:31.943442 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:20:31.943442 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:20:31.943442 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:20:31.943442 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:20:31.943442 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:20:31.943442 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:20:31.943442 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:20:31.943442 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:20:31.943442 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:20:31.944467 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:20:31.944467 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:20:31.944467 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:20:31.944467 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:20:31.944467 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:20:31.944467 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:20:31.944467 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:20:31.944467 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:20:31.944467 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:20:31.944467 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:20:31.944467 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:20:31.944467 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jun 07 14:20:31.944467 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:20:31.944467 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:20:31.944467 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:20:31.944467 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:20:31.945423 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:20:31.945423 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:20:31.945423 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:20:31.945423 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:20:31.945423 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:20:31.945423 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:20:31.945423 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:20:31.945423 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:20:31.945423 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:20:31.945423 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:20:31.945423 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 07 14:20:31.945423 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:20:31.951847 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcb7137-6d03-4a2a-88e7-c4507245a2e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:31.951847 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcb7137-6d03-4a2a-88e7-c4507245a2e9 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:31.951847 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcb7137-6d03-4a2a-88e7-c4507245a2e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:31.951847 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcb7137-6d03-4a2a-88e7-c4507245a2e9 None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:31.952175 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcb7137-6d03-4a2a-88e7-c4507245a2e9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:20:31.952175 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcb7137-6d03-4a2a-88e7-c4507245a2e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:31.952175 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcb7137-6d03-4a2a-88e7-c4507245a2e9 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:31.952925 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 124/242] 10.222.0.86 () {56 vars in 1099 bytes} [Tue Jun 7 14:20:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:20:31.954591 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e99bafe-279e-40a9-822a-c2424f403c06 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:31.966611 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 119/243] 10.222.0.86 () {56 vars in 1099 bytes} [Tue Jun 7 14:20:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:31.966611 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcb7137-6d03-4a2a-88e7-c4507245a2e9 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:32.081643 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcb7137-6d03-4a2a-88e7-c4507245a2e9 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:32.083657 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e99bafe-279e-40a9-822a-c2424f403c06 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:32.112530 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:32.119574 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ad33d8-3a18-42c0-9d1a-61a72be5a2f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:32.127783 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ad33d8-3a18-42c0-9d1a-61a72be5a2f4 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:32.127783 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ad33d8-3a18-42c0-9d1a-61a72be5a2f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:32.127783 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ad33d8-3a18-42c0-9d1a-61a72be5a2f4 None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:32.127783 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ad33d8-3a18-42c0-9d1a-61a72be5a2f4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:20:32.127783 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ad33d8-3a18-42c0-9d1a-61a72be5a2f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:32.127783 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ad33d8-3a18-42c0-9d1a-61a72be5a2f4 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:32.128294 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abda5762-03ce-40d4-bf57-1c33ba32ca1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:32.128294 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abda5762-03ce-40d4-bf57-1c33ba32ca1f None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:32.128294 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abda5762-03ce-40d4-bf57-1c33ba32ca1f None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:32.128294 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abda5762-03ce-40d4-bf57-1c33ba32ca1f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:32.129278 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abda5762-03ce-40d4-bf57-1c33ba32ca1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:32.131426 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abda5762-03ce-40d4-bf57-1c33ba32ca1f None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:32.133561 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 125/244] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jun 7 14:20:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:32.134545 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abda5762-03ce-40d4-bf57-1c33ba32ca1f None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:32.138875 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 120/245] 10.222.0.86 () {56 vars in 1101 bytes} [Tue Jun 7 14:20:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:32.139830 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ad33d8-3a18-42c0-9d1a-61a72be5a2f4 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:32.183288 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:32.257087 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abda5762-03ce-40d4-bf57-1c33ba32ca1f None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:32.289798 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ad33d8-3a18-42c0-9d1a-61a72be5a2f4 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:32.294870 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db0007b-3a4c-4059-82a0-43e934fd3d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:32.296047 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db0007b-3a4c-4059-82a0-43e934fd3d05 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:32.296536 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db0007b-3a4c-4059-82a0-43e934fd3d05 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:32.297618 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db0007b-3a4c-4059-82a0-43e934fd3d05 None admin] PATH_INFO: `/v3/users/f7119cc5aa984236b9de50bec037f956` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:32.299190 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db0007b-3a4c-4059-82a0-43e934fd3d05 None admin] RBAC: Authorizing `identity:get_user(user_id=f7119cc5aa984236b9de50bec037f956)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:32.300958 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db0007b-3a4c-4059-82a0-43e934fd3d05 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:32.307571 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 126/246] 10.222.0.86 () {56 vars in 1177 bytes} [Tue Jun 7 14:20:32 2022] GET /identity/v3/users/f7119cc5aa984236b9de50bec037f956 => generated 283 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:32.308870 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db0007b-3a4c-4059-82a0-43e934fd3d05 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:32.329651 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865269a3-c2b4-4068-8961-1f70f2af24eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:32.330354 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865269a3-c2b4-4068-8961-1f70f2af24eb None admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:32.330645 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865269a3-c2b4-4068-8961-1f70f2af24eb None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:32.330930 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865269a3-c2b4-4068-8961-1f70f2af24eb None admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:32.331707 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865269a3-c2b4-4068-8961-1f70f2af24eb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:32.333132 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865269a3-c2b4-4068-8961-1f70f2af24eb None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:32.370944 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:32.412984 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db0007b-3a4c-4059-82a0-43e934fd3d05 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:32.424074 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 121/247] 10.222.0.86 () {60 vars in 1132 bytes} [Tue Jun 7 14:20:32 2022] POST /identity/v3/users => generated 293 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:20:32.424074 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865269a3-c2b4-4068-8961-1f70f2af24eb None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:32.453235 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f03591c-c3f6-4be4-98bf-89db32e219d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:32.454140 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f03591c-c3f6-4be4-98bf-89db32e219d4 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:32.454427 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f03591c-c3f6-4be4-98bf-89db32e219d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:32.454730 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f03591c-c3f6-4be4-98bf-89db32e219d4 None admin] PATH_INFO: `/v3/users/0776ca86f74c47558e89e050470c81b2` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:32.472904 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f03591c-c3f6-4be4-98bf-89db32e219d4 None admin] RBAC: Authorizing `identity:get_user(user_id=0776ca86f74c47558e89e050470c81b2)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:32.474539 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f03591c-c3f6-4be4-98bf-89db32e219d4 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:32.476425 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 127/248] 10.222.0.86 () {56 vars in 1177 bytes} [Tue Jun 7 14:20:32 2022] GET /identity/v3/users/0776ca86f74c47558e89e050470c81b2 => generated 297 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:32.477873 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc14c66-4226-4b09-ad40-b1b778822a56 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:32.478168 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc14c66-4226-4b09-ad40-b1b778822a56 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:32.478447 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc14c66-4226-4b09-ad40-b1b778822a56 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:32.480272 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 128/249] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:20:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:20:32.482230 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc14c66-4226-4b09-ad40-b1b778822a56 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:32.556217 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:32.578819 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865269a3-c2b4-4068-8961-1f70f2af24eb None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:32.608616 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc14c66-4226-4b09-ad40-b1b778822a56 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:32.628158 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa84d209-05b8-41ed-bf46-9e488f9c56dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:32.628831 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa84d209-05b8-41ed-bf46-9e488f9c56dc None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:32.628939 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:32.629119 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa84d209-05b8-41ed-bf46-9e488f9c56dc None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:32.629402 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa84d209-05b8-41ed-bf46-9e488f9c56dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:32.655047 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce1288a-4880-45dd-9723-879812d3d8fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:32.657213 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce1288a-4880-45dd-9723-879812d3d8fb None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:32.657689 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce1288a-4880-45dd-9723-879812d3d8fb None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:32.657970 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce1288a-4880-45dd-9723-879812d3d8fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:32.711566 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa84d209-05b8-41ed-bf46-9e488f9c56dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:32.713220 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa84d209-05b8-41ed-bf46-9e488f9c56dc None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:32.733756 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce1288a-4880-45dd-9723-879812d3d8fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:32.735470 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce1288a-4880-45dd-9723-879812d3d8fb None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:32.824120 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:32.849361 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 122/250] 10.222.0.86 () {58 vars in 1282 bytes} [Tue Jun 7 14:20:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 07 14:20:32.851744 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3383c6f-2caf-4d6c-9031-90fc31b3d7b0 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:32.852285 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3383c6f-2caf-4d6c-9031-90fc31b3d7b0 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:32.852744 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3383c6f-2caf-4d6c-9031-90fc31b3d7b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:32.870313 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 129/251] 10.222.0.86 () {58 vars in 1282 bytes} [Tue Jun 7 14:20:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 07 14:20:32.870313 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40b2a00-4655-4ea4-9151-5760626a8e20 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:32.870313 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40b2a00-4655-4ea4-9151-5760626a8e20 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:32.870313 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40b2a00-4655-4ea4-9151-5760626a8e20 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:32.870313 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 130/252] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:20:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:20:32.870313 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40b2a00-4655-4ea4-9151-5760626a8e20 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:32.873221 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-a3383c6f-2caf-4d6c-9031-90fc31b3d7b0 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:20:32.874421 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-a3383c6f-2caf-4d6c-9031-90fc31b3d7b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:20:32.896528 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:32.949240 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 123/253] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:20:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 14:20:32.950490 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3383c6f-2caf-4d6c-9031-90fc31b3d7b0 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:33.004659 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40b2a00-4655-4ea4-9151-5760626a8e20 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:33.050389 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d09ce71-08fe-4756-b044-34453ae49e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:33.051308 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d09ce71-08fe-4756-b044-34453ae49e12 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:33.051596 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d09ce71-08fe-4756-b044-34453ae49e12 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:33.051899 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d09ce71-08fe-4756-b044-34453ae49e12 None admin] PATH_INFO: `/v3/projects/6c6e558540ce4a0d85d5c0b4a9d24870` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:33.053623 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d09ce71-08fe-4756-b044-34453ae49e12 None admin] RBAC: Authorizing `identity:get_project(project_id=6c6e558540ce4a0d85d5c0b4a9d24870)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:33.055450 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d09ce71-08fe-4756-b044-34453ae49e12 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:33.062738 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 131/254] 10.222.0.86 () {56 vars in 1186 bytes} [Tue Jun 7 14:20:32 2022] GET /identity/v3/projects/6c6e558540ce4a0d85d5c0b4a9d24870 => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:33.062738 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1017d859-6536-4c9c-b59e-0844b24bd92f None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:33.062738 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1017d859-6536-4c9c-b59e-0844b24bd92f None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:33.062738 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1017d859-6536-4c9c-b59e-0844b24bd92f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:33.071853 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3383c6f-2caf-4d6c-9031-90fc31b3d7b0 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:33.085734 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-1017d859-6536-4c9c-b59e-0844b24bd92f None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:20:33.086732 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:33.088865 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-1017d859-6536-4c9c-b59e-0844b24bd92f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:20:33.107020 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa97945e-d9c2-4e57-96cf-7e279cc7dc52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:33.107940 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa97945e-d9c2-4e57-96cf-7e279cc7dc52 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:33.108228 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa97945e-d9c2-4e57-96cf-7e279cc7dc52 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:33.108505 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa97945e-d9c2-4e57-96cf-7e279cc7dc52 None admin] PATH_INFO: `/v3/projects/6c6e558540ce4a0d85d5c0b4a9d24870` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:33.110236 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa97945e-d9c2-4e57-96cf-7e279cc7dc52 None admin] RBAC: Authorizing `identity:get_project(project_id=6c6e558540ce4a0d85d5c0b4a9d24870)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:33.111703 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa97945e-d9c2-4e57-96cf-7e279cc7dc52 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:33.113447 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 124/255] 10.222.0.86 () {56 vars in 1186 bytes} [Tue Jun 7 14:20:32 2022] GET /identity/v3/projects/6c6e558540ce4a0d85d5c0b4a9d24870 => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:33.114209 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa97945e-d9c2-4e57-96cf-7e279cc7dc52 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:33.179413 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 132/256] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:20:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 14:20:33.185047 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1017d859-6536-4c9c-b59e-0844b24bd92f None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:33.216133 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:33.246996 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa97945e-d9c2-4e57-96cf-7e279cc7dc52 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:33.282487 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cc756f-c398-48d1-ab2e-e4f01903f028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:33.283523 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cc756f-c398-48d1-ab2e-e4f01903f028 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:33.283994 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cc756f-c398-48d1-ab2e-e4f01903f028 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:33.284419 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cc756f-c398-48d1-ab2e-e4f01903f028 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:33.295153 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cc756f-c398-48d1-ab2e-e4f01903f028 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:20:33.302453 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1017d859-6536-4c9c-b59e-0844b24bd92f None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:33.303393 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-31cc756f-c398-48d1-ab2e-e4f01903f028 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 07 14:20:33.303393 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:20:33.303393 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:20:33.303393 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:20:33.303393 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:20:33.303393 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:20:33.303393 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:20:33.303393 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:20:33.303393 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:20:33.303393 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:20:33.303393 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:20:33.303393 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:20:33.303393 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:20:33.303393 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:20:33.303393 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:20:33.303393 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:20:33.304332 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:20:33.304332 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:20:33.304332 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:20:33.304332 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:20:33.304332 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:20:33.304332 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:20:33.304332 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:20:33.304332 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:20:33.304332 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:20:33.304332 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:20:33.304332 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:20:33.304332 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jun 07 14:20:33.304332 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:20:33.304332 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:20:33.304332 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:20:33.304332 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:20:33.305092 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:20:33.305092 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:20:33.305092 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:20:33.305092 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:20:33.305092 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:20:33.305092 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:20:33.305092 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:20:33.305092 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:20:33.305092 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:20:33.305092 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:20:33.305092 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 07 14:20:33.305092 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:20:33.307488 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 125/257] 10.222.0.86 () {56 vars in 1099 bytes} [Tue Jun 7 14:20:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:20:33.313139 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cc756f-c398-48d1-ab2e-e4f01903f028 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:33.339858 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e260ea0-4e12-4c9b-ae1a-116b973d511d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:33.340514 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e260ea0-4e12-4c9b-ae1a-116b973d511d None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:33.340803 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e260ea0-4e12-4c9b-ae1a-116b973d511d None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:33.341085 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e260ea0-4e12-4c9b-ae1a-116b973d511d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:33.342039 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e260ea0-4e12-4c9b-ae1a-116b973d511d None admin] RBAC: Adding query filter params (role.id=e3bf6239f5bf477b965704b086786f11, scope.project.id=6c6e558540ce4a0d85d5c0b4a9d24870, user.id=f7119cc5aa984236b9de50bec037f956) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:20:33.342361 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e260ea0-4e12-4c9b-ae1a-116b973d511d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:33.343932 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e260ea0-4e12-4c9b-ae1a-116b973d511d None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:33.350291 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 133/258] 10.222.0.86 () {56 vars in 1374 bytes} [Tue Jun 7 14:20:33 2022] GET /identity/v3/role_assignments?user.id=f7119cc5aa984236b9de50bec037f956&scope.project.id=6c6e558540ce4a0d85d5c0b4a9d24870&role.id=e3bf6239f5bf477b965704b086786f11 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:33.355893 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e260ea0-4e12-4c9b-ae1a-116b973d511d None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:33.375789 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:33.448264 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:33.466908 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e260ea0-4e12-4c9b-ae1a-116b973d511d None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:33.485331 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cc756f-c398-48d1-ab2e-e4f01903f028 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:33.505777 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706c4da3-cc92-4905-8bdf-e41c9e7ce7b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:33.506838 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706c4da3-cc92-4905-8bdf-e41c9e7ce7b2 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:33.507125 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706c4da3-cc92-4905-8bdf-e41c9e7ce7b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:33.507472 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706c4da3-cc92-4905-8bdf-e41c9e7ce7b2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:33.537549 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706c4da3-cc92-4905-8bdf-e41c9e7ce7b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:20:33.553288 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-706c4da3-cc92-4905-8bdf-e41c9e7ce7b2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 07 14:20:33.553288 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:20:33.553288 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:20:33.553288 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:20:33.553288 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:20:33.553288 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:20:33.553288 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:20:33.553288 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:20:33.553288 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:20:33.553288 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:20:33.553288 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:20:33.553288 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:20:33.553288 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:20:33.553288 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:20:33.553288 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:20:33.553288 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:20:33.554470 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:20:33.554470 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:20:33.554470 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:20:33.554470 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:20:33.554470 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:20:33.554470 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:20:33.554470 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:20:33.554470 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:20:33.554470 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:20:33.554470 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:20:33.554470 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:20:33.554470 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jun 07 14:20:33.554470 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:20:33.554470 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:20:33.554470 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:20:33.554470 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:20:33.555448 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:20:33.555448 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:20:33.555448 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:20:33.555448 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:20:33.555448 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:20:33.555448 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:20:33.555448 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:20:33.555448 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:20:33.555448 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:20:33.555448 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:20:33.555448 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 07 14:20:33.555448 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:20:33.555448 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 134/259] 10.222.0.86 () {56 vars in 1114 bytes} [Tue Jun 7 14:20:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:20:33.562893 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706c4da3-cc92-4905-8bdf-e41c9e7ce7b2 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:33.573755 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49764b33-6a2a-49c1-be32-c9d32cd71b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:33.574770 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49764b33-6a2a-49c1-be32-c9d32cd71b77 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:33.575061 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49764b33-6a2a-49c1-be32-c9d32cd71b77 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:33.575346 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49764b33-6a2a-49c1-be32-c9d32cd71b77 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:33.576293 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49764b33-6a2a-49c1-be32-c9d32cd71b77 None admin] RBAC: Adding query filter params (role.id=bce2bd9e8c164e7ca92ba5e110848be0, scope.project.id=6c6e558540ce4a0d85d5c0b4a9d24870, user.id=0776ca86f74c47558e89e050470c81b2) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:20:33.576614 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49764b33-6a2a-49c1-be32-c9d32cd71b77 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:33.578612 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49764b33-6a2a-49c1-be32-c9d32cd71b77 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:33.597898 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 126/260] 10.222.0.86 () {56 vars in 1374 bytes} [Tue Jun 7 14:20:33 2022] GET /identity/v3/role_assignments?user.id=0776ca86f74c47558e89e050470c81b2&scope.project.id=6c6e558540ce4a0d85d5c0b4a9d24870&role.id=bce2bd9e8c164e7ca92ba5e110848be0 => generated 259 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:33.598768 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49764b33-6a2a-49c1-be32-c9d32cd71b77 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:33.758920 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706c4da3-cc92-4905-8bdf-e41c9e7ce7b2 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:33.819087 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49764b33-6a2a-49c1-be32-c9d32cd71b77 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:33.829840 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:33.830719 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9b4efa-f2f0-426f-9174-e598b97d9902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:33.831426 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9b4efa-f2f0-426f-9174-e598b97d9902 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:33.831700 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9b4efa-f2f0-426f-9174-e598b97d9902 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:33.832009 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9b4efa-f2f0-426f-9174-e598b97d9902 None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:33.832789 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9b4efa-f2f0-426f-9174-e598b97d9902 None admin] RBAC: Adding query filter params (name=member) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:20:33.833098 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9b4efa-f2f0-426f-9174-e598b97d9902 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:33.834523 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9b4efa-f2f0-426f-9174-e598b97d9902 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:33.845273 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:33.851123 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 135/261] 10.222.0.86 () {56 vars in 1101 bytes} [Tue Jun 7 14:20:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:33.862415 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9b4efa-f2f0-426f-9174-e598b97d9902 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:33.895010 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d11efd-dcaa-4798-b22c-ce0702b77cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:33.895743 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d11efd-dcaa-4798-b22c-ce0702b77cbb None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:33.899119 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d11efd-dcaa-4798-b22c-ce0702b77cbb None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:33.899119 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d11efd-dcaa-4798-b22c-ce0702b77cbb None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:33.899119 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d11efd-dcaa-4798-b22c-ce0702b77cbb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:20:33.899119 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d11efd-dcaa-4798-b22c-ce0702b77cbb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:33.901867 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d11efd-dcaa-4798-b22c-ce0702b77cbb None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:33.913287 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 127/262] 10.222.0.86 () {56 vars in 1111 bytes} [Tue Jun 7 14:20:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:33.919496 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d11efd-dcaa-4798-b22c-ce0702b77cbb None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:34.036224 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9b4efa-f2f0-426f-9174-e598b97d9902 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:34.036563 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d11efd-dcaa-4798-b22c-ce0702b77cbb None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:34.076099 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf7fd00-028a-4884-bae7-ae441098c0dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:34.076989 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf7fd00-028a-4884-bae7-ae441098c0dc None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:34.077272 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf7fd00-028a-4884-bae7-ae441098c0dc None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:34.077543 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf7fd00-028a-4884-bae7-ae441098c0dc None admin] PATH_INFO: `/v3/users/f7119cc5aa984236b9de50bec037f956` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:34.079342 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf7fd00-028a-4884-bae7-ae441098c0dc None admin] RBAC: Authorizing `identity:get_user(user_id=f7119cc5aa984236b9de50bec037f956)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:34.080823 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf7fd00-028a-4884-bae7-ae441098c0dc None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:34.082871 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 128/263] 10.222.0.86 () {56 vars in 1177 bytes} [Tue Jun 7 14:20:33 2022] GET /identity/v3/users/f7119cc5aa984236b9de50bec037f956 => generated 283 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:34.084245 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d8c5ce-95c9-44d1-89c6-df4c9e0652b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:34.085174 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d8c5ce-95c9-44d1-89c6-df4c9e0652b0 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:34.085430 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d8c5ce-95c9-44d1-89c6-df4c9e0652b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:34.085716 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d8c5ce-95c9-44d1-89c6-df4c9e0652b0 None admin] PATH_INFO: `/v3/users/351e45598a2743978ac8dce1348662d9` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:34.087978 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d8c5ce-95c9-44d1-89c6-df4c9e0652b0 None admin] RBAC: Authorizing `identity:get_user(user_id=351e45598a2743978ac8dce1348662d9)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:34.089451 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d8c5ce-95c9-44d1-89c6-df4c9e0652b0 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:34.094884 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 136/264] 10.222.0.86 () {56 vars in 1177 bytes} [Tue Jun 7 14:20:33 2022] GET /identity/v3/users/351e45598a2743978ac8dce1348662d9 => generated 297 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:20:34.096828 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf7fd00-028a-4884-bae7-ae441098c0dc None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:34.096969 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d8c5ce-95c9-44d1-89c6-df4c9e0652b0 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:34.161541 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:34.202645 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:34.256339 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf7fd00-028a-4884-bae7-ae441098c0dc None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:34.276593 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d8c5ce-95c9-44d1-89c6-df4c9e0652b0 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:34.291238 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cabb43d-879f-47c5-8dac-d6a466f5dcb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:34.293970 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cabb43d-879f-47c5-8dac-d6a466f5dcb5 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:34.295511 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cabb43d-879f-47c5-8dac-d6a466f5dcb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:34.297139 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cabb43d-879f-47c5-8dac-d6a466f5dcb5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:34.344485 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04737d6c-a85c-4eee-a989-d436963e0066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:34.345356 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04737d6c-a85c-4eee-a989-d436963e0066 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:34.345805 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04737d6c-a85c-4eee-a989-d436963e0066 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:34.346229 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04737d6c-a85c-4eee-a989-d436963e0066 None admin] PATH_INFO: `/v3/projects/6c6e558540ce4a0d85d5c0b4a9d24870` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:34.353009 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04737d6c-a85c-4eee-a989-d436963e0066 None admin] RBAC: Authorizing `identity:get_project(project_id=6c6e558540ce4a0d85d5c0b4a9d24870)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:34.354702 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04737d6c-a85c-4eee-a989-d436963e0066 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:34.357001 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 137/265] 10.222.0.86 () {56 vars in 1186 bytes} [Tue Jun 7 14:20:34 2022] GET /identity/v3/projects/6c6e558540ce4a0d85d5c0b4a9d24870 => generated 302 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:20:34.362619 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04737d6c-a85c-4eee-a989-d436963e0066 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:34.373450 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cabb43d-879f-47c5-8dac-d6a466f5dcb5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:34.375472 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cabb43d-879f-47c5-8dac-d6a466f5dcb5 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:34.409646 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:34.476179 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 129/266] 10.222.0.86 () {58 vars in 1282 bytes} [Tue Jun 7 14:20:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 07 14:20:34.481637 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cabb43d-879f-47c5-8dac-d6a466f5dcb5 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:34.514390 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04737d6c-a85c-4eee-a989-d436963e0066 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:34.551348 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64d61e3-8f1d-46f0-ab3c-b40834d149b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:34.552194 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64d61e3-8f1d-46f0-ab3c-b40834d149b0 None admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:34.552480 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64d61e3-8f1d-46f0-ab3c-b40834d149b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:34.552758 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64d61e3-8f1d-46f0-ab3c-b40834d149b0 None admin] PATH_INFO: `/v3/projects/6c6e558540ce4a0d85d5c0b4a9d24870/users/351e45598a2743978ac8dce1348662d9/roles/c17acc2a8bb348f59ba7edd22fcf0c47` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:34.555396 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64d61e3-8f1d-46f0-ab3c-b40834d149b0 None admin] RBAC: Authorizing `identity:create_grant(project_id=6c6e558540ce4a0d85d5c0b4a9d24870, user_id=351e45598a2743978ac8dce1348662d9, role_id=c17acc2a8bb348f59ba7edd22fcf0c47)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:34.556878 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64d61e3-8f1d-46f0-ab3c-b40834d149b0 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:34.560153 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:34.589196 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cabb43d-879f-47c5-8dac-d6a466f5dcb5 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:34.625071 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396fd67d-6f78-4579-a3ee-e26f6c4e1645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:34.625979 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396fd67d-6f78-4579-a3ee-e26f6c4e1645 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:34.626270 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396fd67d-6f78-4579-a3ee-e26f6c4e1645 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:34.626544 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396fd67d-6f78-4579-a3ee-e26f6c4e1645 None admin] PATH_INFO: `/v3/projects/6c6e558540ce4a0d85d5c0b4a9d24870` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:34.627905 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396fd67d-6f78-4579-a3ee-e26f6c4e1645 None admin] RBAC: Authorizing `identity:get_project(project_id=6c6e558540ce4a0d85d5c0b4a9d24870)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:34.629362 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396fd67d-6f78-4579-a3ee-e26f6c4e1645 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:34.631126 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 130/267] 10.222.0.86 () {56 vars in 1186 bytes} [Tue Jun 7 14:20:34 2022] GET /identity/v3/projects/6c6e558540ce4a0d85d5c0b4a9d24870 => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:20:34.637013 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396fd67d-6f78-4579-a3ee-e26f6c4e1645 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:34.640941 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:34.662136 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 138/268] 10.222.0.86 () {58 vars in 1439 bytes} [Tue Jun 7 14:20:34 2022] PUT /identity/v3/projects/6c6e558540ce4a0d85d5c0b4a9d24870/users/351e45598a2743978ac8dce1348662d9/roles/c17acc2a8bb348f59ba7edd22fcf0c47 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:20:34.749707 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396fd67d-6f78-4579-a3ee-e26f6c4e1645 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:34.785568 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7746e8-1358-41bd-b1c1-0d1e09ff3586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:34.786276 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7746e8-1358-41bd-b1c1-0d1e09ff3586 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:34.786564 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7746e8-1358-41bd-b1c1-0d1e09ff3586 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:34.786843 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7746e8-1358-41bd-b1c1-0d1e09ff3586 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:34.787672 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7746e8-1358-41bd-b1c1-0d1e09ff3586 None admin] RBAC: Adding query filter params (role.id=a2755a2b621b4e969fd366f0035d672b, scope.project.id=6c6e558540ce4a0d85d5c0b4a9d24870, user.id=f7119cc5aa984236b9de50bec037f956) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:20:34.788009 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7746e8-1358-41bd-b1c1-0d1e09ff3586 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:34.789473 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7746e8-1358-41bd-b1c1-0d1e09ff3586 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:34.797484 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 131/269] 10.222.0.86 () {56 vars in 1374 bytes} [Tue Jun 7 14:20:34 2022] GET /identity/v3/role_assignments?user.id=f7119cc5aa984236b9de50bec037f956&scope.project.id=6c6e558540ce4a0d85d5c0b4a9d24870&role.id=a2755a2b621b4e969fd366f0035d672b => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:20:35.249260 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3468756-320f-4b7a-a0c7-b17b9de5f43c None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:35.250497 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3468756-320f-4b7a-a0c7-b17b9de5f43c None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:35.250985 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3468756-320f-4b7a-a0c7-b17b9de5f43c None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:35.252608 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 139/270] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:20:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:20:35.258890 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034889f4-1a95-4ec5-8f75-a7ffbf5631f2 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:35.259471 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034889f4-1a95-4ec5-8f75-a7ffbf5631f2 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:35.259978 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034889f4-1a95-4ec5-8f75-a7ffbf5631f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:35.277850 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-034889f4-1a95-4ec5-8f75-a7ffbf5631f2 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:20:35.279387 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-034889f4-1a95-4ec5-8f75-a7ffbf5631f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:20:35.342945 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:35.349303 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 132/271] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:20:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 14:20:35.373641 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3468756-320f-4b7a-a0c7-b17b9de5f43c None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:35.444816 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23df4b4b-b651-462b-a747-cb3980929418 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:35.445459 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23df4b4b-b651-462b-a747-cb3980929418 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:35.445971 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23df4b4b-b651-462b-a747-cb3980929418 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:35.448911 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 133/272] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:20:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:20:35.453659 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74db8573-44a0-4c16-96d3-5d030e529930 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:35.453983 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74db8573-44a0-4c16-96d3-5d030e529930 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:35.454221 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74db8573-44a0-4c16-96d3-5d030e529930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:35.478179 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-74db8573-44a0-4c16-96d3-5d030e529930 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:20:35.480327 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-74db8573-44a0-4c16-96d3-5d030e529930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:20:35.487590 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3468756-320f-4b7a-a0c7-b17b9de5f43c None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:35.524863 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabd069b-ae84-4900-8e21-aa2e580c46f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:35.526446 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabd069b-ae84-4900-8e21-aa2e580c46f9 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:35.526927 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabd069b-ae84-4900-8e21-aa2e580c46f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:35.527427 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabd069b-ae84-4900-8e21-aa2e580c46f9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:35.539950 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabd069b-ae84-4900-8e21-aa2e580c46f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:20:35.548223 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-cabd069b-ae84-4900-8e21-aa2e580c46f9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 07 14:20:35.548223 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:20:35.548223 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:20:35.548223 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:20:35.548223 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:20:35.548223 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:20:35.548223 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:20:35.548223 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:20:35.548223 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:20:35.548223 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:20:35.548223 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:20:35.548223 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:20:35.548223 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:20:35.548223 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:20:35.548223 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:20:35.548223 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:20:35.549195 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:20:35.549195 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:20:35.549195 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:20:35.549195 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:20:35.549195 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:20:35.549195 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:20:35.549195 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:20:35.549195 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:20:35.549195 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:20:35.549195 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:20:35.549195 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:20:35.549195 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jun 07 14:20:35.549195 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:20:35.549195 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:20:35.549195 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:20:35.549195 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:20:35.549974 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:20:35.549974 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:20:35.549974 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:20:35.549974 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:20:35.549974 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:20:35.549974 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:20:35.549974 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:20:35.549974 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:20:35.549974 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:20:35.549974 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:20:35.549974 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 07 14:20:35.549974 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:20:35.552327 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 140/273] 10.222.0.86 () {56 vars in 1099 bytes} [Tue Jun 7 14:20:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:20:35.558482 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabd069b-ae84-4900-8e21-aa2e580c46f9 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:35.575777 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 134/274] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:20:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 07 14:20:35.595006 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74db8573-44a0-4c16-96d3-5d030e529930 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:35.632265 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:35.692179 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabd069b-ae84-4900-8e21-aa2e580c46f9 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:35.725426 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74db8573-44a0-4c16-96d3-5d030e529930 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:35.732787 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b19cc27-ebcf-41d4-9cfb-b30d5ae6841e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:35.733899 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b19cc27-ebcf-41d4-9cfb-b30d5ae6841e None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:35.733899 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b19cc27-ebcf-41d4-9cfb-b30d5ae6841e None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:35.734264 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b19cc27-ebcf-41d4-9cfb-b30d5ae6841e None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:35.735106 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b19cc27-ebcf-41d4-9cfb-b30d5ae6841e None admin] RBAC: Adding query filter params (name=member) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:20:35.735512 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b19cc27-ebcf-41d4-9cfb-b30d5ae6841e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:35.737156 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b19cc27-ebcf-41d4-9cfb-b30d5ae6841e None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:35.751585 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 141/275] 10.222.0.86 () {56 vars in 1101 bytes} [Tue Jun 7 14:20:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:20:35.752728 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b19cc27-ebcf-41d4-9cfb-b30d5ae6841e None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:35.755910 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:35.764757 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f6119d-3ba5-43be-bb4f-5fa4c9d9b1b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:35.770091 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f6119d-3ba5-43be-bb4f-5fa4c9d9b1b3 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:35.770091 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f6119d-3ba5-43be-bb4f-5fa4c9d9b1b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:35.770091 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f6119d-3ba5-43be-bb4f-5fa4c9d9b1b3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:35.770091 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f6119d-3ba5-43be-bb4f-5fa4c9d9b1b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:35.770091 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f6119d-3ba5-43be-bb4f-5fa4c9d9b1b3 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:35.776976 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 135/276] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jun 7 14:20:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:35.779131 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f6119d-3ba5-43be-bb4f-5fa4c9d9b1b3 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:35.869538 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b19cc27-ebcf-41d4-9cfb-b30d5ae6841e None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:35.890228 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:35.898711 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f6119d-3ba5-43be-bb4f-5fa4c9d9b1b3 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:35.910091 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b82caf-9469-4e42-a890-ed0201e24022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:35.910985 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b82caf-9469-4e42-a890-ed0201e24022 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:35.911274 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b82caf-9469-4e42-a890-ed0201e24022 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:35.911555 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b82caf-9469-4e42-a890-ed0201e24022 None admin] PATH_INFO: `/v3/users/92b3fbfe750744f0946cdbfc15841af2` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:35.926713 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b82caf-9469-4e42-a890-ed0201e24022 None admin] RBAC: Authorizing `identity:get_user(user_id=92b3fbfe750744f0946cdbfc15841af2)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:35.928327 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b82caf-9469-4e42-a890-ed0201e24022 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:35.930325 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 142/277] 10.222.0.86 () {56 vars in 1177 bytes} [Tue Jun 7 14:20:35 2022] GET /identity/v3/users/92b3fbfe750744f0946cdbfc15841af2 => generated 293 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:35.935826 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b82caf-9469-4e42-a890-ed0201e24022 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:35.939941 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46fc951-2365-4726-b935-3e0e40acec9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:35.940861 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46fc951-2365-4726-b935-3e0e40acec9e None admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:35.941399 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46fc951-2365-4726-b935-3e0e40acec9e None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:35.941877 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46fc951-2365-4726-b935-3e0e40acec9e None admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:35.942803 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46fc951-2365-4726-b935-3e0e40acec9e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:35.944634 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46fc951-2365-4726-b935-3e0e40acec9e None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:36.042387 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b82caf-9469-4e42-a890-ed0201e24022 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:36.067640 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 136/278] 10.222.0.86 () {60 vars in 1132 bytes} [Tue Jun 7 14:20:35 2022] POST /identity/v3/users => generated 293 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 14:20:36.089818 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4de78e-d64c-4241-af49-2e91a12256d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:36.090912 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4de78e-d64c-4241-af49-2e91a12256d8 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:36.091379 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4de78e-d64c-4241-af49-2e91a12256d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:36.091918 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4de78e-d64c-4241-af49-2e91a12256d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:36.093031 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4de78e-d64c-4241-af49-2e91a12256d8 None admin] RBAC: Adding query filter params (role.id=c17acc2a8bb348f59ba7edd22fcf0c47, user.id=92b3fbfe750744f0946cdbfc15841af2, scope.system=all) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:20:36.093598 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4de78e-d64c-4241-af49-2e91a12256d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:36.095449 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4de78e-d64c-4241-af49-2e91a12256d8 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:36.102348 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 143/279] 10.222.0.86 () {56 vars in 1308 bytes} [Tue Jun 7 14:20:35 2022] GET /identity/v3/role_assignments?user.id=92b3fbfe750744f0946cdbfc15841af2&scope.system=all&role.id=c17acc2a8bb348f59ba7edd22fcf0c47 => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:36.214998 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73f7046-1e2c-4294-9486-debc7d6bc9ad None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:36.215299 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73f7046-1e2c-4294-9486-debc7d6bc9ad None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:36.215565 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73f7046-1e2c-4294-9486-debc7d6bc9ad None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:36.217019 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 137/280] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:20:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:20:36.222892 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780f6922-e7e1-47dc-adee-8ba8fe5762c4 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:36.223194 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780f6922-e7e1-47dc-adee-8ba8fe5762c4 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:36.223459 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780f6922-e7e1-47dc-adee-8ba8fe5762c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:36.247091 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-780f6922-e7e1-47dc-adee-8ba8fe5762c4 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:20:36.248828 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-780f6922-e7e1-47dc-adee-8ba8fe5762c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:20:36.291187 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:36.329042 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 144/281] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:20:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 14:20:36.351777 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73f7046-1e2c-4294-9486-debc7d6bc9ad None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:36.418165 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:36.478309 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73f7046-1e2c-4294-9486-debc7d6bc9ad None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:36.519435 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44622858-aff1-4ddf-8165-a487b162bf5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:36.520279 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44622858-aff1-4ddf-8165-a487b162bf5c None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:36.520571 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44622858-aff1-4ddf-8165-a487b162bf5c None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:36.520906 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44622858-aff1-4ddf-8165-a487b162bf5c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:36.534892 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44622858-aff1-4ddf-8165-a487b162bf5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:20:36.543560 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-44622858-aff1-4ddf-8165-a487b162bf5c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 07 14:20:36.543560 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:20:36.543560 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:20:36.543560 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:20:36.543560 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:20:36.543560 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:20:36.543560 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:20:36.543560 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:20:36.543560 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:20:36.543560 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:20:36.543560 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:20:36.543560 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:20:36.543560 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:20:36.543560 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:20:36.543560 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:20:36.543560 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:20:36.544514 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:20:36.544514 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:20:36.544514 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:20:36.544514 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:20:36.544514 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:20:36.544514 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:20:36.544514 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:20:36.544514 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:20:36.544514 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:20:36.544514 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:20:36.544514 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:20:36.544514 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jun 07 14:20:36.544514 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:20:36.544514 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:20:36.544514 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:20:36.544514 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:20:36.545290 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:20:36.545290 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:20:36.545290 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:20:36.545290 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:20:36.545290 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:20:36.545290 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:20:36.545290 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:20:36.545290 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:20:36.545290 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:20:36.545290 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:20:36.545290 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 07 14:20:36.545290 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:20:36.551343 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 138/282] 10.222.0.86 () {56 vars in 1099 bytes} [Tue Jun 7 14:20:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:20:36.553878 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780f6922-e7e1-47dc-adee-8ba8fe5762c4 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:36.658519 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780f6922-e7e1-47dc-adee-8ba8fe5762c4 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:36.704473 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed8037c-8b7e-44a0-8cbd-9c98f4ecec68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:36.705167 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed8037c-8b7e-44a0-8cbd-9c98f4ecec68 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:36.705459 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed8037c-8b7e-44a0-8cbd-9c98f4ecec68 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:36.705743 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed8037c-8b7e-44a0-8cbd-9c98f4ecec68 None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:36.706509 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed8037c-8b7e-44a0-8cbd-9c98f4ecec68 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:20:36.706821 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed8037c-8b7e-44a0-8cbd-9c98f4ecec68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:36.708263 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed8037c-8b7e-44a0-8cbd-9c98f4ecec68 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:36.717729 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 145/283] 10.222.0.86 () {56 vars in 1101 bytes} [Tue Jun 7 14:20:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:36.723878 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44622858-aff1-4ddf-8165-a487b162bf5c None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:36.877513 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44622858-aff1-4ddf-8165-a487b162bf5c None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:36.900644 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:36.929522 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563b14de-40bc-45bf-8f2a-313055d206cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:36.930775 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563b14de-40bc-45bf-8f2a-313055d206cd None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:36.931266 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563b14de-40bc-45bf-8f2a-313055d206cd None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:36.931746 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563b14de-40bc-45bf-8f2a-313055d206cd None admin] PATH_INFO: `/v3/users/0776ca86f74c47558e89e050470c81b2` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:36.933208 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563b14de-40bc-45bf-8f2a-313055d206cd None admin] RBAC: Authorizing `identity:get_user(user_id=0776ca86f74c47558e89e050470c81b2)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:36.934874 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563b14de-40bc-45bf-8f2a-313055d206cd None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:36.936760 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 139/284] 10.222.0.86 () {56 vars in 1177 bytes} [Tue Jun 7 14:20:36 2022] GET /identity/v3/users/0776ca86f74c47558e89e050470c81b2 => generated 297 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:36.942482 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed8037c-8b7e-44a0-8cbd-9c98f4ecec68 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:36.975382 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:37.071469 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed8037c-8b7e-44a0-8cbd-9c98f4ecec68 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:37.125790 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b93cd9-6fdd-4ac1-84d7-f8ce6805e006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:37.126710 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b93cd9-6fdd-4ac1-84d7-f8ce6805e006 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:37.126995 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b93cd9-6fdd-4ac1-84d7-f8ce6805e006 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:37.127289 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b93cd9-6fdd-4ac1-84d7-f8ce6805e006 None admin] PATH_INFO: `/v3/projects/6c6e558540ce4a0d85d5c0b4a9d24870` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:37.132521 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b93cd9-6fdd-4ac1-84d7-f8ce6805e006 None admin] RBAC: Authorizing `identity:get_project(project_id=6c6e558540ce4a0d85d5c0b4a9d24870)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:37.133991 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b93cd9-6fdd-4ac1-84d7-f8ce6805e006 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:37.135730 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 146/285] 10.222.0.86 () {56 vars in 1186 bytes} [Tue Jun 7 14:20:36 2022] GET /identity/v3/projects/6c6e558540ce4a0d85d5c0b4a9d24870 => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:37.141998 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563b14de-40bc-45bf-8f2a-313055d206cd None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:37.258708 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9810e9-9ef1-47c5-bae7-4934cdc97025 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:37.259055 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9810e9-9ef1-47c5-bae7-4934cdc97025 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:37.259270 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9810e9-9ef1-47c5-bae7-4934cdc97025 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:37.260686 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 147/286] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:20:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:20:37.296151 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2b4c56-b73b-49e4-a724-f34685669bff None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:37.297028 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2b4c56-b73b-49e4-a724-f34685669bff None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:37.297224 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2b4c56-b73b-49e4-a724-f34685669bff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:37.328902 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563b14de-40bc-45bf-8f2a-313055d206cd None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:37.347748 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-bc2b4c56-b73b-49e4-a724-f34685669bff None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:20:37.348965 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-bc2b4c56-b73b-49e4-a724-f34685669bff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:20:37.373944 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcb1943-d951-4c27-a3d1-fa1ddc58c7e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:37.375396 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcb1943-d951-4c27-a3d1-fa1ddc58c7e9 None admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:37.375723 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcb1943-d951-4c27-a3d1-fa1ddc58c7e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:37.376025 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcb1943-d951-4c27-a3d1-fa1ddc58c7e9 None admin] PATH_INFO: `/v3/projects/6c6e558540ce4a0d85d5c0b4a9d24870/users/0776ca86f74c47558e89e050470c81b2/roles/bce2bd9e8c164e7ca92ba5e110848be0` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:37.379070 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcb1943-d951-4c27-a3d1-fa1ddc58c7e9 None admin] RBAC: Authorizing `identity:create_grant(project_id=6c6e558540ce4a0d85d5c0b4a9d24870, user_id=0776ca86f74c47558e89e050470c81b2, role_id=bce2bd9e8c164e7ca92ba5e110848be0)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:37.380568 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcb1943-d951-4c27-a3d1-fa1ddc58c7e9 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:37.438835 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 148/287] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:20:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 14:20:37.463144 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2b4c56-b73b-49e4-a724-f34685669bff None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:37.494773 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:37.504139 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 140/288] 10.222.0.86 () {58 vars in 1439 bytes} [Tue Jun 7 14:20:37 2022] PUT /identity/v3/projects/6c6e558540ce4a0d85d5c0b4a9d24870/users/0776ca86f74c47558e89e050470c81b2/roles/bce2bd9e8c164e7ca92ba5e110848be0 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:20:37.580722 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2b4c56-b73b-49e4-a724-f34685669bff None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:37.629388 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd692fef-c0a3-4616-9754-2e6ea7801e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:37.630193 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd692fef-c0a3-4616-9754-2e6ea7801e85 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:37.630475 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd692fef-c0a3-4616-9754-2e6ea7801e85 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:37.630748 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd692fef-c0a3-4616-9754-2e6ea7801e85 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:37.647267 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd692fef-c0a3-4616-9754-2e6ea7801e85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:20:37.659657 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-cd692fef-c0a3-4616-9754-2e6ea7801e85 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 07 14:20:37.659657 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:20:37.659657 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:20:37.659657 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:20:37.659657 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:20:37.659657 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:20:37.659657 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:20:37.659657 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:20:37.659657 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:20:37.659657 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:20:37.659657 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:20:37.659657 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:20:37.659657 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:20:37.659657 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:20:37.659657 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:20:37.659657 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:20:37.660698 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:20:37.660698 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:20:37.660698 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:20:37.660698 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:20:37.660698 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:20:37.660698 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:20:37.660698 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:20:37.660698 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:20:37.660698 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:20:37.660698 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:20:37.660698 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:20:37.660698 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jun 07 14:20:37.660698 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:20:37.660698 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:20:37.660698 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:20:37.660698 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:20:37.661516 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:20:37.661516 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:20:37.661516 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:20:37.661516 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:20:37.661516 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:20:37.661516 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:20:37.661516 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:20:37.661516 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:20:37.661516 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:20:37.661516 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:20:37.661516 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 07 14:20:37.661516 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:20:37.661516 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 149/289] 10.222.0.86 () {56 vars in 1099 bytes} [Tue Jun 7 14:20:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 14:20:37.669637 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcb1943-d951-4c27-a3d1-fa1ddc58c7e9 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:37.758842 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:37.840555 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcb1943-d951-4c27-a3d1-fa1ddc58c7e9 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:37.877206 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9afa05-6fd9-411a-b3f4-f51b81d9cc8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:37.877882 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9afa05-6fd9-411a-b3f4-f51b81d9cc8b None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:37.878166 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9afa05-6fd9-411a-b3f4-f51b81d9cc8b None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:37.878442 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9afa05-6fd9-411a-b3f4-f51b81d9cc8b None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:37.879195 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9afa05-6fd9-411a-b3f4-f51b81d9cc8b None admin] RBAC: Adding query filter params (name=member) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:20:37.879499 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9afa05-6fd9-411a-b3f4-f51b81d9cc8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:37.880998 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9afa05-6fd9-411a-b3f4-f51b81d9cc8b None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:37.890081 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 141/290] 10.222.0.86 () {56 vars in 1101 bytes} [Tue Jun 7 14:20:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:37.895422 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd692fef-c0a3-4616-9754-2e6ea7801e85 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:37.989958 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:38.000422 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd692fef-c0a3-4616-9754-2e6ea7801e85 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:38.035326 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49296d58-d5c8-4358-882d-2308bd46da5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:38.036248 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49296d58-d5c8-4358-882d-2308bd46da5e None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:38.036528 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49296d58-d5c8-4358-882d-2308bd46da5e None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:38.036796 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49296d58-d5c8-4358-882d-2308bd46da5e None admin] PATH_INFO: `/v3/users/351e45598a2743978ac8dce1348662d9` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:38.037989 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49296d58-d5c8-4358-882d-2308bd46da5e None admin] RBAC: Authorizing `identity:get_user(user_id=351e45598a2743978ac8dce1348662d9)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:38.039434 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49296d58-d5c8-4358-882d-2308bd46da5e None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:38.041622 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 150/291] 10.222.0.86 () {56 vars in 1177 bytes} [Tue Jun 7 14:20:37 2022] GET /identity/v3/users/351e45598a2743978ac8dce1348662d9 => generated 297 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:20:38.048866 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9afa05-6fd9-411a-b3f4-f51b81d9cc8b None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:38.160936 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9afa05-6fd9-411a-b3f4-f51b81d9cc8b None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:38.162481 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:38.213349 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a56d0c9-5170-40dc-834b-3a8830a06314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:38.214385 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a56d0c9-5170-40dc-834b-3a8830a06314 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:38.214891 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a56d0c9-5170-40dc-834b-3a8830a06314 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:38.215380 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a56d0c9-5170-40dc-834b-3a8830a06314 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:38.293968 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a56d0c9-5170-40dc-834b-3a8830a06314 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:38.295777 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a56d0c9-5170-40dc-834b-3a8830a06314 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:38.418924 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 142/292] 10.222.0.86 () {58 vars in 1282 bytes} [Tue Jun 7 14:20:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 07 14:20:38.425221 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49296d58-d5c8-4358-882d-2308bd46da5e None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:38.572329 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49296d58-d5c8-4358-882d-2308bd46da5e None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:38.616233 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5a2ded-8c9a-4ffa-973c-44c4fec3c803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:38.617111 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5a2ded-8c9a-4ffa-973c-44c4fec3c803 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:38.617532 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5a2ded-8c9a-4ffa-973c-44c4fec3c803 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:38.617820 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5a2ded-8c9a-4ffa-973c-44c4fec3c803 None admin] PATH_INFO: `/v3/projects/6c6e558540ce4a0d85d5c0b4a9d24870` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:38.624555 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5a2ded-8c9a-4ffa-973c-44c4fec3c803 None admin] RBAC: Authorizing `identity:get_project(project_id=6c6e558540ce4a0d85d5c0b4a9d24870)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:38.626017 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5a2ded-8c9a-4ffa-973c-44c4fec3c803 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:38.627982 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 151/293] 10.222.0.86 () {56 vars in 1186 bytes} [Tue Jun 7 14:20:38 2022] GET /identity/v3/projects/6c6e558540ce4a0d85d5c0b4a9d24870 => generated 302 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:38.633712 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a56d0c9-5170-40dc-834b-3a8830a06314 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:38.639801 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:38.783956 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a56d0c9-5170-40dc-834b-3a8830a06314 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:38.833209 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d62b7f8-f8c8-41e2-a45f-ddd1e09bb995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:38.834294 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d62b7f8-f8c8-41e2-a45f-ddd1e09bb995 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:38.834782 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d62b7f8-f8c8-41e2-a45f-ddd1e09bb995 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:38.835267 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d62b7f8-f8c8-41e2-a45f-ddd1e09bb995 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:38.836395 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d62b7f8-f8c8-41e2-a45f-ddd1e09bb995 None admin] RBAC: Adding query filter params (role.id=c17acc2a8bb348f59ba7edd22fcf0c47, scope.project.id=6c6e558540ce4a0d85d5c0b4a9d24870, user.id=351e45598a2743978ac8dce1348662d9) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:20:38.836943 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d62b7f8-f8c8-41e2-a45f-ddd1e09bb995 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:38.838708 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d62b7f8-f8c8-41e2-a45f-ddd1e09bb995 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:38.846230 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 143/294] 10.222.0.86 () {56 vars in 1374 bytes} [Tue Jun 7 14:20:38 2022] GET /identity/v3/role_assignments?user.id=351e45598a2743978ac8dce1348662d9&scope.project.id=6c6e558540ce4a0d85d5c0b4a9d24870&role.id=c17acc2a8bb348f59ba7edd22fcf0c47 => generated 608 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:38.940938 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238fbbdc-a6be-4930-8f1c-47ca1f9df734 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:38.941281 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238fbbdc-a6be-4930-8f1c-47ca1f9df734 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:38.941508 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238fbbdc-a6be-4930-8f1c-47ca1f9df734 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:38.943143 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 152/295] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:20:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:20:38.948645 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26cc643-01c8-4509-825d-a08d6f051f5c None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:38.948931 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26cc643-01c8-4509-825d-a08d6f051f5c None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:38.949205 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26cc643-01c8-4509-825d-a08d6f051f5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:38.973622 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-f26cc643-01c8-4509-825d-a08d6f051f5c None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:20:38.974845 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-f26cc643-01c8-4509-825d-a08d6f051f5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:20:39.047622 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:39.065448 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 144/296] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:20:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 14:20:39.107199 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238fbbdc-a6be-4930-8f1c-47ca1f9df734 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:39.146935 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:39.159203 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7266484c-8fa8-4230-9472-5838229485ff None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:39.159534 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7266484c-8fa8-4230-9472-5838229485ff None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:39.166783 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7266484c-8fa8-4230-9472-5838229485ff None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:39.166783 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 145/297] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:20:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:20:39.167189 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d488a3-12aa-4714-90e9-a15e64d04536 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:39.167482 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d488a3-12aa-4714-90e9-a15e64d04536 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:39.167788 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d488a3-12aa-4714-90e9-a15e64d04536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:39.184971 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-f3d488a3-12aa-4714-90e9-a15e64d04536 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:20:39.186215 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-f3d488a3-12aa-4714-90e9-a15e64d04536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:20:39.282552 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238fbbdc-a6be-4930-8f1c-47ca1f9df734 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:39.306734 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 146/298] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:20:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 07 14:20:39.308123 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3bee1e-dab8-4781-bcf8-d02859b37576 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:39.308454 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3bee1e-dab8-4781-bcf8-d02859b37576 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:39.308705 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3bee1e-dab8-4781-bcf8-d02859b37576 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:39.314549 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 147/299] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:20:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:20:39.317116 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5425e9-3446-49f8-a1da-b36767248009 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:39.317376 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5425e9-3446-49f8-a1da-b36767248009 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:39.317660 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5425e9-3446-49f8-a1da-b36767248009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:39.328920 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925bb3bc-cc54-41c9-b4c9-61871d8c558a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:39.330729 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925bb3bc-cc54-41c9-b4c9-61871d8c558a None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:39.331065 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925bb3bc-cc54-41c9-b4c9-61871d8c558a None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:39.331406 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925bb3bc-cc54-41c9-b4c9-61871d8c558a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:39.343535 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-dd5425e9-3446-49f8-a1da-b36767248009 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:20:39.344750 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-dd5425e9-3446-49f8-a1da-b36767248009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:20:39.345234 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925bb3bc-cc54-41c9-b4c9-61871d8c558a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:20:39.353369 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-925bb3bc-cc54-41c9-b4c9-61871d8c558a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 07 14:20:39.353369 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:20:39.353369 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:20:39.353369 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:20:39.353369 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:20:39.353369 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:20:39.353369 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:20:39.353369 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:20:39.353369 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:20:39.353369 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:20:39.353369 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:20:39.353369 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:20:39.353369 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:20:39.353369 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:20:39.353369 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:20:39.353369 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:20:39.354413 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:20:39.354413 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:20:39.354413 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:20:39.354413 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:20:39.354413 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:20:39.354413 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:20:39.354413 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:20:39.354413 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:20:39.354413 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:20:39.354413 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:20:39.354413 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:20:39.354413 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jun 07 14:20:39.354413 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:20:39.354413 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:20:39.354413 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:20:39.354413 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:20:39.355350 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:20:39.355350 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:20:39.355350 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:20:39.355350 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:20:39.355350 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:20:39.355350 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:20:39.355350 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:20:39.355350 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:20:39.355350 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:20:39.355350 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:20:39.355350 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 07 14:20:39.355350 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:20:39.358270 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 153/300] 10.222.0.86 () {56 vars in 1099 bytes} [Tue Jun 7 14:20:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:20:39.359744 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925bb3bc-cc54-41c9-b4c9-61871d8c558a None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:39.427925 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 148/301] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:20:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 14:20:39.427925 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5425e9-3446-49f8-a1da-b36767248009 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:39.470950 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:39.479224 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:39.485945 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925bb3bc-cc54-41c9-b4c9-61871d8c558a None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:39.521635 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc51b3b4-7d87-4307-a399-81336ea82dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:39.521852 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5425e9-3446-49f8-a1da-b36767248009 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:39.522430 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc51b3b4-7d87-4307-a399-81336ea82dd2 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:39.522717 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc51b3b4-7d87-4307-a399-81336ea82dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:39.522996 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc51b3b4-7d87-4307-a399-81336ea82dd2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:39.533358 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc51b3b4-7d87-4307-a399-81336ea82dd2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:20:39.541129 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-bc51b3b4-7d87-4307-a399-81336ea82dd2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 07 14:20:39.541129 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:20:39.541129 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:20:39.541129 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:20:39.541129 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:20:39.541129 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:20:39.541129 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:20:39.541129 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:20:39.541129 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:20:39.541129 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:20:39.541129 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:20:39.541129 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:20:39.541129 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:20:39.541129 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:20:39.541129 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:20:39.541129 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:20:39.542288 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:20:39.542288 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:20:39.542288 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:20:39.542288 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:20:39.542288 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:20:39.542288 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:20:39.542288 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:20:39.542288 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:20:39.542288 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:20:39.542288 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:20:39.542288 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:20:39.542288 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jun 07 14:20:39.542288 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:20:39.542288 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:20:39.542288 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:20:39.542288 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:20:39.543090 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:20:39.543090 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:20:39.543090 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:20:39.543090 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:20:39.543090 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:20:39.543090 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:20:39.543090 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:20:39.543090 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:20:39.543090 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:20:39.543090 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:20:39.543090 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 07 14:20:39.543090 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:20:39.543090 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 154/302] 10.222.0.86 () {56 vars in 1099 bytes} [Tue Jun 7 14:20:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:20:39.544578 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc51b3b4-7d87-4307-a399-81336ea82dd2 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:39.563551 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e679d1-7799-40b4-99c7-a102d92a83b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:39.564256 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e679d1-7799-40b4-99c7-a102d92a83b4 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:39.564536 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e679d1-7799-40b4-99c7-a102d92a83b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:39.564823 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e679d1-7799-40b4-99c7-a102d92a83b4 None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:39.565545 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e679d1-7799-40b4-99c7-a102d92a83b4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:20:39.565848 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e679d1-7799-40b4-99c7-a102d92a83b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:39.567219 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e679d1-7799-40b4-99c7-a102d92a83b4 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:39.575557 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 149/303] 10.222.0.86 () {56 vars in 1101 bytes} [Tue Jun 7 14:20:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:39.576371 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e679d1-7799-40b4-99c7-a102d92a83b4 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:39.652040 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc51b3b4-7d87-4307-a399-81336ea82dd2 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:39.688530 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c019adf-71ff-46c0-ae1c-2f19ec9723a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:39.689320 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c019adf-71ff-46c0-ae1c-2f19ec9723a0 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:39.689630 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c019adf-71ff-46c0-ae1c-2f19ec9723a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:39.689909 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c019adf-71ff-46c0-ae1c-2f19ec9723a0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:39.690920 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e679d1-7799-40b4-99c7-a102d92a83b4 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:39.691110 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c019adf-71ff-46c0-ae1c-2f19ec9723a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:39.692600 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c019adf-71ff-46c0-ae1c-2f19ec9723a0 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:39.698964 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 155/304] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jun 7 14:20:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:39.698964 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c019adf-71ff-46c0-ae1c-2f19ec9723a0 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:39.710490 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:39.715263 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:39.728418 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7be967-c429-4413-8d88-6e1b7be8d122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:39.729123 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7be967-c429-4413-8d88-6e1b7be8d122 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:39.729407 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7be967-c429-4413-8d88-6e1b7be8d122 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:39.729739 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7be967-c429-4413-8d88-6e1b7be8d122 None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:39.730488 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7be967-c429-4413-8d88-6e1b7be8d122 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:20:39.730795 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7be967-c429-4413-8d88-6e1b7be8d122 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:39.732181 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7be967-c429-4413-8d88-6e1b7be8d122 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:39.744822 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 150/305] 10.222.0.86 () {56 vars in 1101 bytes} [Tue Jun 7 14:20:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:39.746710 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7be967-c429-4413-8d88-6e1b7be8d122 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:39.815274 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c019adf-71ff-46c0-ae1c-2f19ec9723a0 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:39.852098 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7be967-c429-4413-8d88-6e1b7be8d122 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:39.854140 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a03f4d-9ed3-43af-ae2d-8d79d278577a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:39.855226 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a03f4d-9ed3-43af-ae2d-8d79d278577a None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:39.855354 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a03f4d-9ed3-43af-ae2d-8d79d278577a None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:39.855548 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a03f4d-9ed3-43af-ae2d-8d79d278577a None admin] PATH_INFO: `/v3/users/92b3fbfe750744f0946cdbfc15841af2` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:39.856772 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a03f4d-9ed3-43af-ae2d-8d79d278577a None admin] RBAC: Authorizing `identity:get_user(user_id=92b3fbfe750744f0946cdbfc15841af2)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:39.861223 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a03f4d-9ed3-43af-ae2d-8d79d278577a None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:39.861223 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 156/306] 10.222.0.86 () {56 vars in 1177 bytes} [Tue Jun 7 14:20:39 2022] GET /identity/v3/users/92b3fbfe750744f0946cdbfc15841af2 => generated 293 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:39.861223 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a03f4d-9ed3-43af-ae2d-8d79d278577a None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:39.895938 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8945630-0fd2-4714-b4a4-e39f8babc292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:39.896616 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8945630-0fd2-4714-b4a4-e39f8babc292 None admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:39.896903 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8945630-0fd2-4714-b4a4-e39f8babc292 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:39.897181 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8945630-0fd2-4714-b4a4-e39f8babc292 None admin] PATH_INFO: `/v3/groups` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:39.897868 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8945630-0fd2-4714-b4a4-e39f8babc292 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:39.899310 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8945630-0fd2-4714-b4a4-e39f8babc292 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:39.950266 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:39.969699 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a03f4d-9ed3-43af-ae2d-8d79d278577a None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:39.979550 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 151/307] 10.222.0.86 () {60 vars in 1134 bytes} [Tue Jun 7 14:20:39 2022] POST /identity/v3/groups => generated 229 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:20:39.980609 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8945630-0fd2-4714-b4a4-e39f8babc292 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:40.015848 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf40dbc-f501-44c7-b576-9ce8dc0a38ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:40.017163 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf40dbc-f501-44c7-b576-9ce8dc0a38ec None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:40.017638 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf40dbc-f501-44c7-b576-9ce8dc0a38ec None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:40.018134 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf40dbc-f501-44c7-b576-9ce8dc0a38ec None admin] PATH_INFO: `/v3/users/af3648f2dc764b07b1e527af6cd443f8` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:40.031816 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:40.034610 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf40dbc-f501-44c7-b576-9ce8dc0a38ec None admin] RBAC: Authorizing `identity:get_user(user_id=af3648f2dc764b07b1e527af6cd443f8)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:40.036452 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf40dbc-f501-44c7-b576-9ce8dc0a38ec None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:40.038652 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 157/308] 10.222.0.86 () {56 vars in 1177 bytes} [Tue Jun 7 14:20:39 2022] GET /identity/v3/users/af3648f2dc764b07b1e527af6cd443f8 => generated 293 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:40.044627 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf40dbc-f501-44c7-b576-9ce8dc0a38ec None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:40.107614 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8945630-0fd2-4714-b4a4-e39f8babc292 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:40.147254 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e8132a-8307-4a82-9816-3b122f5fa632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:40.148173 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e8132a-8307-4a82-9816-3b122f5fa632 None admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:40.148457 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e8132a-8307-4a82-9816-3b122f5fa632 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:40.148733 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e8132a-8307-4a82-9816-3b122f5fa632 None admin] PATH_INFO: `/v3/system/users/92b3fbfe750744f0946cdbfc15841af2/roles/c17acc2a8bb348f59ba7edd22fcf0c47` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:40.150502 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e8132a-8307-4a82-9816-3b122f5fa632 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=92b3fbfe750744f0946cdbfc15841af2, role_id=c17acc2a8bb348f59ba7edd22fcf0c47)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:40.151949 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e8132a-8307-4a82-9816-3b122f5fa632 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:40.160400 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf40dbc-f501-44c7-b576-9ce8dc0a38ec None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:40.202656 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e41d91-3aec-4b42-86cb-8cc74de64bde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:40.202656 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e41d91-3aec-4b42-86cb-8cc74de64bde None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:40.202656 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e41d91-3aec-4b42-86cb-8cc74de64bde None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:40.202656 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e41d91-3aec-4b42-86cb-8cc74de64bde None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:40.203469 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e41d91-3aec-4b42-86cb-8cc74de64bde None admin] RBAC: Adding query filter params (role.id=bce2bd9e8c164e7ca92ba5e110848be0, user.id=af3648f2dc764b07b1e527af6cd443f8, scope.system=all) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:20:40.203872 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e41d91-3aec-4b42-86cb-8cc74de64bde None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:40.205362 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e41d91-3aec-4b42-86cb-8cc74de64bde None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:40.215332 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 158/309] 10.222.0.86 () {56 vars in 1308 bytes} [Tue Jun 7 14:20:40 2022] GET /identity/v3/role_assignments?user.id=af3648f2dc764b07b1e527af6cd443f8&scope.system=all&role.id=bce2bd9e8c164e7ca92ba5e110848be0 => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:40.260478 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 152/310] 10.222.0.86 () {58 vars in 1334 bytes} [Tue Jun 7 14:20:39 2022] PUT /identity/v3/system/users/92b3fbfe750744f0946cdbfc15841af2/roles/c17acc2a8bb348f59ba7edd22fcf0c47 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:20:40.287432 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08f98bc-de1c-49b4-8c13-2d724b0d1af8 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:40.287809 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08f98bc-de1c-49b4-8c13-2d724b0d1af8 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:40.288074 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08f98bc-de1c-49b4-8c13-2d724b0d1af8 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:40.289924 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 159/311] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:20:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:20:40.297065 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a862e65a-75e7-406b-a3b5-6f8717726c6f None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:40.297373 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a862e65a-75e7-406b-a3b5-6f8717726c6f None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:40.297638 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a862e65a-75e7-406b-a3b5-6f8717726c6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:40.317606 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-a862e65a-75e7-406b-a3b5-6f8717726c6f None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:20:40.318852 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-a862e65a-75e7-406b-a3b5-6f8717726c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:20:40.402675 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 153/312] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:20:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 14:20:40.427955 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08f98bc-de1c-49b4-8c13-2d724b0d1af8 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:40.432004 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:40.542722 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08f98bc-de1c-49b4-8c13-2d724b0d1af8 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:40.578627 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318c612d-8d36-4a6d-ba03-f94bc7fe90c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:40.579427 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318c612d-8d36-4a6d-ba03-f94bc7fe90c1 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:40.579710 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318c612d-8d36-4a6d-ba03-f94bc7fe90c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:40.580008 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318c612d-8d36-4a6d-ba03-f94bc7fe90c1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:40.590997 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318c612d-8d36-4a6d-ba03-f94bc7fe90c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:20:40.599617 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-318c612d-8d36-4a6d-ba03-f94bc7fe90c1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 07 14:20:40.599617 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:20:40.599617 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:20:40.599617 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:20:40.599617 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:20:40.599617 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:20:40.599617 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:20:40.599617 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:20:40.599617 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:20:40.599617 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:20:40.599617 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:20:40.599617 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:20:40.599617 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:20:40.599617 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:20:40.599617 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:20:40.599617 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:20:40.600545 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:20:40.600545 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:20:40.600545 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:20:40.600545 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:20:40.600545 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:20:40.600545 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:20:40.600545 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:20:40.600545 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:20:40.600545 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:20:40.600545 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:20:40.600545 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:20:40.600545 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jun 07 14:20:40.600545 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:20:40.600545 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:20:40.600545 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:20:40.600545 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:20:40.601568 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:20:40.601568 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:20:40.601568 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:20:40.601568 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:20:40.601568 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:20:40.601568 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:20:40.601568 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:20:40.601568 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:20:40.601568 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:20:40.601568 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:20:40.601568 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 07 14:20:40.601568 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:20:40.601568 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 160/313] 10.222.0.86 () {56 vars in 1099 bytes} [Tue Jun 7 14:20:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:20:40.606751 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a862e65a-75e7-406b-a3b5-6f8717726c6f None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:40.641675 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:40.711688 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a862e65a-75e7-406b-a3b5-6f8717726c6f None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:40.748220 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f7ec05-b552-43d5-8bef-87b47a6b8fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:40.748891 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f7ec05-b552-43d5-8bef-87b47a6b8fb9 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:40.749175 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f7ec05-b552-43d5-8bef-87b47a6b8fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:40.749479 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f7ec05-b552-43d5-8bef-87b47a6b8fb9 None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:40.750230 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f7ec05-b552-43d5-8bef-87b47a6b8fb9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:20:40.750536 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f7ec05-b552-43d5-8bef-87b47a6b8fb9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:40.751929 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f7ec05-b552-43d5-8bef-87b47a6b8fb9 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:40.760771 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 154/314] 10.222.0.86 () {56 vars in 1101 bytes} [Tue Jun 7 14:20:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:40.765983 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318c612d-8d36-4a6d-ba03-f94bc7fe90c1 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:40.835562 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:40.875975 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318c612d-8d36-4a6d-ba03-f94bc7fe90c1 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:40.960754 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca627df9-b5f3-48d6-97f7-30a27cb7f699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:40.961647 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca627df9-b5f3-48d6-97f7-30a27cb7f699 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:40.961934 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca627df9-b5f3-48d6-97f7-30a27cb7f699 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:40.962215 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca627df9-b5f3-48d6-97f7-30a27cb7f699 None admin] PATH_INFO: `/v3/users/0776ca86f74c47558e89e050470c81b2` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:40.963432 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca627df9-b5f3-48d6-97f7-30a27cb7f699 None admin] RBAC: Authorizing `identity:get_user(user_id=0776ca86f74c47558e89e050470c81b2)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:40.964920 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca627df9-b5f3-48d6-97f7-30a27cb7f699 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:40.966851 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 161/315] 10.222.0.86 () {56 vars in 1177 bytes} [Tue Jun 7 14:20:40 2022] GET /identity/v3/users/0776ca86f74c47558e89e050470c81b2 => generated 297 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:40.972950 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f7ec05-b552-43d5-8bef-87b47a6b8fb9 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:41.070455 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:41.076708 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f7ec05-b552-43d5-8bef-87b47a6b8fb9 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:41.112817 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfe1916-dccc-4bf3-a40b-f9ee5b663aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:41.113801 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfe1916-dccc-4bf3-a40b-f9ee5b663aaa None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:41.114319 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfe1916-dccc-4bf3-a40b-f9ee5b663aaa None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:41.114810 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfe1916-dccc-4bf3-a40b-f9ee5b663aaa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:41.186301 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfe1916-dccc-4bf3-a40b-f9ee5b663aaa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:41.188391 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfe1916-dccc-4bf3-a40b-f9ee5b663aaa None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:41.282124 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:41.288999 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 155/316] 10.222.0.86 () {58 vars in 1282 bytes} [Tue Jun 7 14:20:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 07 14:20:41.294628 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca627df9-b5f3-48d6-97f7-30a27cb7f699 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:41.404623 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca627df9-b5f3-48d6-97f7-30a27cb7f699 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:41.435531 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:41.441338 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5957dcc9-0bfd-4b71-9751-2a62748657fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:41.442269 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5957dcc9-0bfd-4b71-9751-2a62748657fa None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:41.442556 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5957dcc9-0bfd-4b71-9751-2a62748657fa None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:41.442860 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5957dcc9-0bfd-4b71-9751-2a62748657fa None admin] PATH_INFO: `/v3/projects/6c6e558540ce4a0d85d5c0b4a9d24870` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:41.444104 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5957dcc9-0bfd-4b71-9751-2a62748657fa None admin] RBAC: Authorizing `identity:get_project(project_id=6c6e558540ce4a0d85d5c0b4a9d24870)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:41.445586 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5957dcc9-0bfd-4b71-9751-2a62748657fa None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:41.447648 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 162/317] 10.222.0.86 () {56 vars in 1186 bytes} [Tue Jun 7 14:20:41 2022] GET /identity/v3/projects/6c6e558540ce4a0d85d5c0b4a9d24870 => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:41.454192 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfe1916-dccc-4bf3-a40b-f9ee5b663aaa None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:41.560402 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfe1916-dccc-4bf3-a40b-f9ee5b663aaa None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:41.594783 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe2227b-d9b2-4831-8b06-def12ac30a9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:41.595614 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe2227b-d9b2-4831-8b06-def12ac30a9f None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:41.595936 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe2227b-d9b2-4831-8b06-def12ac30a9f None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:41.596220 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe2227b-d9b2-4831-8b06-def12ac30a9f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:41.597068 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe2227b-d9b2-4831-8b06-def12ac30a9f None admin] RBAC: Adding query filter params (role.id=bce2bd9e8c164e7ca92ba5e110848be0, scope.project.id=6c6e558540ce4a0d85d5c0b4a9d24870, user.id=0776ca86f74c47558e89e050470c81b2) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:20:41.597385 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe2227b-d9b2-4831-8b06-def12ac30a9f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:41.598862 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe2227b-d9b2-4831-8b06-def12ac30a9f None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:41.605332 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 156/318] 10.222.0.86 () {56 vars in 1374 bytes} [Tue Jun 7 14:20:41 2022] GET /identity/v3/role_assignments?user.id=0776ca86f74c47558e89e050470c81b2&scope.project.id=6c6e558540ce4a0d85d5c0b4a9d24870&role.id=bce2bd9e8c164e7ca92ba5e110848be0 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:20:42.442970 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0a8c0f-594a-4733-be59-8b8d7a244e5a None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:42.443499 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0a8c0f-594a-4733-be59-8b8d7a244e5a None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:42.443499 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0a8c0f-594a-4733-be59-8b8d7a244e5a None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:42.445108 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 163/319] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:20:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:20:42.450144 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ddc2fd-4e35-4c6c-bc42-8fe2863bac80 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:42.450523 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ddc2fd-4e35-4c6c-bc42-8fe2863bac80 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:42.450777 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ddc2fd-4e35-4c6c-bc42-8fe2863bac80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:42.467350 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-03ddc2fd-4e35-4c6c-bc42-8fe2863bac80 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:20:42.468620 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-03ddc2fd-4e35-4c6c-bc42-8fe2863bac80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:20:42.527072 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:42.538741 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 157/320] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:20:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 14:20:42.561648 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0a8c0f-594a-4733-be59-8b8d7a244e5a None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:42.565429 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7968e020-8793-4862-abac-f5aa7444b7b5 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:42.565715 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7968e020-8793-4862-abac-f5aa7444b7b5 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:42.566002 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7968e020-8793-4862-abac-f5aa7444b7b5 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:42.567401 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 158/321] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:20:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:20:42.572430 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e70313-59f3-4b2d-8ff1-95c9670de0fd None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:42.572722 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e70313-59f3-4b2d-8ff1-95c9670de0fd None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:42.573003 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e70313-59f3-4b2d-8ff1-95c9670de0fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:42.590504 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-d7e70313-59f3-4b2d-8ff1-95c9670de0fd None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:20:42.591696 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-d7e70313-59f3-4b2d-8ff1-95c9670de0fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:20:42.657686 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 159/322] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:20:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 07 14:20:42.659126 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83389178-08a4-4fc2-bf3a-3202cdeeff3f None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:42.659424 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83389178-08a4-4fc2-bf3a-3202cdeeff3f None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:42.659704 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83389178-08a4-4fc2-bf3a-3202cdeeff3f None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:42.661013 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 160/323] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:20:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:20:42.664085 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0a8c0f-594a-4733-be59-8b8d7a244e5a None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:42.667895 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44c5f02-6ece-43ef-8f56-78d1c35c7dc7 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:42.668190 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44c5f02-6ece-43ef-8f56-78d1c35c7dc7 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:42.668476 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44c5f02-6ece-43ef-8f56-78d1c35c7dc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:42.686974 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-b44c5f02-6ece-43ef-8f56-78d1c35c7dc7 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:20:42.688203 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-b44c5f02-6ece-43ef-8f56-78d1c35c7dc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:20:42.698167 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cebf962-d0be-4ee0-b517-09566a3432cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:42.698951 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cebf962-d0be-4ee0-b517-09566a3432cd None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:42.699234 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cebf962-d0be-4ee0-b517-09566a3432cd None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:42.699505 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cebf962-d0be-4ee0-b517-09566a3432cd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:42.700667 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cebf962-d0be-4ee0-b517-09566a3432cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:42.702084 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cebf962-d0be-4ee0-b517-09566a3432cd None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:42.704210 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 164/324] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jun 7 14:20:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:42.704960 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cebf962-d0be-4ee0-b517-09566a3432cd None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:42.756572 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 161/325] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:20:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 07 14:20:42.757382 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44c5f02-6ece-43ef-8f56-78d1c35c7dc7 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:42.776075 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:42.805557 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:42.808472 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cebf962-d0be-4ee0-b517-09566a3432cd None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:42.842795 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1c0ebb-f31b-475c-b7c0-d7640ae8482a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:42.843615 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1c0ebb-f31b-475c-b7c0-d7640ae8482a None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:42.843929 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1c0ebb-f31b-475c-b7c0-d7640ae8482a None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:42.844201 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1c0ebb-f31b-475c-b7c0-d7640ae8482a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:42.853723 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44c5f02-6ece-43ef-8f56-78d1c35c7dc7 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:42.854233 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1c0ebb-f31b-475c-b7c0-d7640ae8482a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:20:42.861997 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-cf1c0ebb-f31b-475c-b7c0-d7640ae8482a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 07 14:20:42.861997 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:20:42.861997 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:20:42.861997 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:20:42.861997 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:20:42.861997 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:20:42.861997 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:20:42.861997 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:20:42.861997 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:20:42.861997 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:20:42.861997 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:20:42.861997 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:20:42.861997 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:20:42.861997 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:20:42.861997 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:20:42.861997 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:20:42.863066 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:20:42.863066 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:20:42.863066 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:20:42.863066 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:20:42.863066 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:20:42.863066 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:20:42.863066 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:20:42.863066 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:20:42.863066 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:20:42.863066 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:20:42.863066 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:20:42.863066 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jun 07 14:20:42.863066 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:20:42.863066 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:20:42.863066 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:20:42.863066 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:20:42.863907 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:20:42.863907 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:20:42.863907 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:20:42.863907 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:20:42.863907 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:20:42.863907 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:20:42.863907 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:20:42.863907 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:20:42.863907 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:20:42.863907 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:20:42.863907 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 07 14:20:42.863907 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:20:42.863907 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 165/326] 10.222.0.86 () {56 vars in 1099 bytes} [Tue Jun 7 14:20:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:20:42.864569 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1c0ebb-f31b-475c-b7c0-d7640ae8482a None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:42.888783 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf42b32-24a5-4cd5-a8c5-6ddc0b091c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:42.889452 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf42b32-24a5-4cd5-a8c5-6ddc0b091c12 None admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:42.889736 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf42b32-24a5-4cd5-a8c5-6ddc0b091c12 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:42.890610 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf42b32-24a5-4cd5-a8c5-6ddc0b091c12 None admin] PATH_INFO: `/v3/groups` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:42.891300 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf42b32-24a5-4cd5-a8c5-6ddc0b091c12 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:42.892803 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf42b32-24a5-4cd5-a8c5-6ddc0b091c12 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:42.961188 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1c0ebb-f31b-475c-b7c0-d7640ae8482a None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:42.985373 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:42.992640 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992add37-1635-49be-bf84-36fb1646b891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:42.993410 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992add37-1635-49be-bf84-36fb1646b891 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:42.993688 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992add37-1635-49be-bf84-36fb1646b891 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:42.993964 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992add37-1635-49be-bf84-36fb1646b891 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:43.004582 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992add37-1635-49be-bf84-36fb1646b891 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:20:43.007238 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 162/327] 10.222.0.86 () {60 vars in 1134 bytes} [Tue Jun 7 14:20:42 2022] POST /identity/v3/groups => generated 226 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:20:43.012352 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-992add37-1635-49be-bf84-36fb1646b891 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 07 14:20:43.012352 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:20:43.012352 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:20:43.012352 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:20:43.012352 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:20:43.012352 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:20:43.012352 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:20:43.012352 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:20:43.012352 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:20:43.012352 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:20:43.012352 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:20:43.012352 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:20:43.012352 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:20:43.012352 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:20:43.012352 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:20:43.012352 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:20:43.020035 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:20:43.020035 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:20:43.020035 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:20:43.020035 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:20:43.020035 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:20:43.020035 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:20:43.020035 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:20:43.020035 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:20:43.020035 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:20:43.020035 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:20:43.020035 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:20:43.020035 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jun 07 14:20:43.020035 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:20:43.020035 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:20:43.020035 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:20:43.020035 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:20:43.021071 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:20:43.021071 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:20:43.021071 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:20:43.021071 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:20:43.021071 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:20:43.021071 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:20:43.021071 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:20:43.021071 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:20:43.021071 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:20:43.021071 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:20:43.021071 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 07 14:20:43.021071 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:20:43.021071 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 166/328] 10.222.0.86 () {56 vars in 1099 bytes} [Tue Jun 7 14:20:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:20:43.021888 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf42b32-24a5-4cd5-a8c5-6ddc0b091c12 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:43.023285 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992add37-1635-49be-bf84-36fb1646b891 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:43.128051 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf42b32-24a5-4cd5-a8c5-6ddc0b091c12 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:43.137976 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992add37-1635-49be-bf84-36fb1646b891 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:43.139742 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:43.167736 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56fb6b3-0af8-43a4-a4bf-8dcfdff21e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:43.168504 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56fb6b3-0af8-43a4-a4bf-8dcfdff21e5f None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:43.168739 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56fb6b3-0af8-43a4-a4bf-8dcfdff21e5f None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:43.169019 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56fb6b3-0af8-43a4-a4bf-8dcfdff21e5f None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:43.169799 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56fb6b3-0af8-43a4-a4bf-8dcfdff21e5f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:20:43.170113 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56fb6b3-0af8-43a4-a4bf-8dcfdff21e5f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:43.172487 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56fb6b3-0af8-43a4-a4bf-8dcfdff21e5f None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:43.181664 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf346758-2ff6-4c74-96c8-2a6d63cb76c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:43.182352 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf346758-2ff6-4c74-96c8-2a6d63cb76c4 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:43.182636 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf346758-2ff6-4c74-96c8-2a6d63cb76c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:43.182950 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf346758-2ff6-4c74-96c8-2a6d63cb76c4 None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:43.183669 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf346758-2ff6-4c74-96c8-2a6d63cb76c4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:20:43.184007 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf346758-2ff6-4c74-96c8-2a6d63cb76c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:43.185406 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf346758-2ff6-4c74-96c8-2a6d63cb76c4 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:43.188555 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 163/329] 10.222.0.86 () {56 vars in 1101 bytes} [Tue Jun 7 14:20:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:43.189785 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56fb6b3-0af8-43a4-a4bf-8dcfdff21e5f None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:43.196798 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 167/330] 10.222.0.86 () {56 vars in 1101 bytes} [Tue Jun 7 14:20:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:43.204249 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf346758-2ff6-4c74-96c8-2a6d63cb76c4 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:43.260379 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:43.323181 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf346758-2ff6-4c74-96c8-2a6d63cb76c4 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:43.323489 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56fb6b3-0af8-43a4-a4bf-8dcfdff21e5f None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:43.361429 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5825a06-3054-4637-abe5-aa65229769b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:43.361651 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99bea99-f700-408e-b3da-7ae3bab53710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:43.362303 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5825a06-3054-4637-abe5-aa65229769b7 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:43.362412 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99bea99-f700-408e-b3da-7ae3bab53710 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:43.362601 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99bea99-f700-408e-b3da-7ae3bab53710 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:43.362711 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5825a06-3054-4637-abe5-aa65229769b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:43.362879 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5825a06-3054-4637-abe5-aa65229769b7 None admin] PATH_INFO: `/v3/users/92b3fbfe750744f0946cdbfc15841af2` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:43.362970 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99bea99-f700-408e-b3da-7ae3bab53710 None admin] PATH_INFO: `/v3/users/af3648f2dc764b07b1e527af6cd443f8` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:43.364076 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5825a06-3054-4637-abe5-aa65229769b7 None admin] RBAC: Authorizing `identity:get_user(user_id=92b3fbfe750744f0946cdbfc15841af2)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:43.364185 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99bea99-f700-408e-b3da-7ae3bab53710 None admin] RBAC: Authorizing `identity:get_user(user_id=af3648f2dc764b07b1e527af6cd443f8)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:43.365525 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5825a06-3054-4637-abe5-aa65229769b7 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:43.365632 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99bea99-f700-408e-b3da-7ae3bab53710 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:43.367308 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 168/332] 10.222.0.86 () {56 vars in 1177 bytes} [Tue Jun 7 14:20:43 2022] GET /identity/v3/users/92b3fbfe750744f0946cdbfc15841af2 => generated 293 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:20:43.367425 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 164/332] 10.222.0.86 () {56 vars in 1177 bytes} [Tue Jun 7 14:20:43 2022] GET /identity/v3/users/af3648f2dc764b07b1e527af6cd443f8 => generated 293 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:43.372776 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99bea99-f700-408e-b3da-7ae3bab53710 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:43.372937 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5825a06-3054-4637-abe5-aa65229769b7 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:43.423078 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:43.502642 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5825a06-3054-4637-abe5-aa65229769b7 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:43.505832 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99bea99-f700-408e-b3da-7ae3bab53710 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:43.527789 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:43.546128 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae954d2-8cd8-4f8c-b092-9297a4348494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:43.547737 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae954d2-8cd8-4f8c-b092-9297a4348494 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:43.548124 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae954d2-8cd8-4f8c-b092-9297a4348494 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:43.548467 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae954d2-8cd8-4f8c-b092-9297a4348494 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:43.549481 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae954d2-8cd8-4f8c-b092-9297a4348494 None admin] RBAC: Adding query filter params (role.id=c17acc2a8bb348f59ba7edd22fcf0c47, user.id=92b3fbfe750744f0946cdbfc15841af2, scope.system=all) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:20:43.549889 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae954d2-8cd8-4f8c-b092-9297a4348494 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:43.551406 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae954d2-8cd8-4f8c-b092-9297a4348494 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:43.553171 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cffbed-c53f-4613-8b69-bf142e6f374d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:43.554042 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cffbed-c53f-4613-8b69-bf142e6f374d None admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:43.554321 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cffbed-c53f-4613-8b69-bf142e6f374d None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:43.554591 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cffbed-c53f-4613-8b69-bf142e6f374d None admin] PATH_INFO: `/v3/system/users/af3648f2dc764b07b1e527af6cd443f8/roles/bce2bd9e8c164e7ca92ba5e110848be0` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:43.557635 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cffbed-c53f-4613-8b69-bf142e6f374d None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=af3648f2dc764b07b1e527af6cd443f8, role_id=bce2bd9e8c164e7ca92ba5e110848be0)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:43.558442 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cffbed-c53f-4613-8b69-bf142e6f374d None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:43.568340 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 169/333] 10.222.0.86 () {56 vars in 1308 bytes} [Tue Jun 7 14:20:43 2022] GET /identity/v3/role_assignments?user.id=92b3fbfe750744f0946cdbfc15841af2&scope.system=all&role.id=c17acc2a8bb348f59ba7edd22fcf0c47 => generated 510 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:43.652299 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 165/334] 10.222.0.86 () {58 vars in 1334 bytes} [Tue Jun 7 14:20:43 2022] PUT /identity/v3/system/users/af3648f2dc764b07b1e527af6cd443f8/roles/bce2bd9e8c164e7ca92ba5e110848be0 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:20:45.799078 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807fad12-40a4-47cb-b6e1-ad2cb0f04bef None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:45.799630 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807fad12-40a4-47cb-b6e1-ad2cb0f04bef None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:45.799630 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807fad12-40a4-47cb-b6e1-ad2cb0f04bef None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:45.801565 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 170/335] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:20:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:20:45.809151 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e718c1-36fa-4855-8064-6dde248460f3 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:45.809663 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e718c1-36fa-4855-8064-6dde248460f3 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:45.809735 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e718c1-36fa-4855-8064-6dde248460f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:45.827890 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-b1e718c1-36fa-4855-8064-6dde248460f3 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:20:45.829124 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-b1e718c1-36fa-4855-8064-6dde248460f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:20:45.909050 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 166/336] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:20:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 07 14:20:45.933499 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807fad12-40a4-47cb-b6e1-ad2cb0f04bef None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:46.043734 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807fad12-40a4-47cb-b6e1-ad2cb0f04bef None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:46.081625 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd522123-3ea4-4f45-9e4e-2e3e3a940007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:46.082463 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd522123-3ea4-4f45-9e4e-2e3e3a940007 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:46.082752 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd522123-3ea4-4f45-9e4e-2e3e3a940007 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:46.083032 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd522123-3ea4-4f45-9e4e-2e3e3a940007 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:46.094180 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd522123-3ea4-4f45-9e4e-2e3e3a940007 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:20:46.104889 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-fd522123-3ea4-4f45-9e4e-2e3e3a940007 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 07 14:20:46.104889 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:20:46.104889 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:20:46.104889 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:20:46.104889 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:20:46.104889 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:20:46.104889 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:20:46.104889 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:20:46.104889 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:20:46.104889 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:20:46.104889 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:20:46.104889 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:20:46.104889 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:20:46.104889 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:20:46.104889 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:20:46.104889 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:20:46.105782 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:20:46.105782 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:20:46.105782 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:20:46.105782 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:20:46.105782 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:20:46.105782 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:20:46.105782 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:20:46.105782 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:20:46.105782 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:20:46.105782 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:20:46.105782 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:20:46.105782 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jun 07 14:20:46.105782 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:20:46.105782 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:20:46.105782 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:20:46.105782 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:20:46.106576 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:20:46.106576 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:20:46.106576 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:20:46.106576 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:20:46.106576 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:20:46.106576 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:20:46.106576 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:20:46.106576 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:20:46.106576 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:20:46.106576 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:20:46.106576 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 07 14:20:46.106576 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:20:46.109063 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 171/337] 10.222.0.86 () {56 vars in 1099 bytes} [Tue Jun 7 14:20:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:20:46.113107 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e718c1-36fa-4855-8064-6dde248460f3 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:46.154553 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:46.229330 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e718c1-36fa-4855-8064-6dde248460f3 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:46.270061 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccd0f71-6ed4-4e07-bd43-f221634db087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:46.270794 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccd0f71-6ed4-4e07-bd43-f221634db087 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:46.271125 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccd0f71-6ed4-4e07-bd43-f221634db087 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:46.271411 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccd0f71-6ed4-4e07-bd43-f221634db087 None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:46.272230 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccd0f71-6ed4-4e07-bd43-f221634db087 None admin] RBAC: Adding query filter params (name=member) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:20:46.272542 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccd0f71-6ed4-4e07-bd43-f221634db087 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:46.273921 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccd0f71-6ed4-4e07-bd43-f221634db087 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:46.287278 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 167/338] 10.222.0.86 () {56 vars in 1101 bytes} [Tue Jun 7 14:20:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:46.288781 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd522123-3ea4-4f45-9e4e-2e3e3a940007 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:46.319322 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d373e13e-e4eb-47f2-89df-fb7b6ef15bd8 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:46.322919 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d373e13e-e4eb-47f2-89df-fb7b6ef15bd8 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:46.322919 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d373e13e-e4eb-47f2-89df-fb7b6ef15bd8 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:46.322919 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 168/339] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:20:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 07 14:20:46.327873 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb472747-5435-41f9-84c7-a1efdcab94aa None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:46.328166 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb472747-5435-41f9-84c7-a1efdcab94aa None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:46.328447 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb472747-5435-41f9-84c7-a1efdcab94aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:46.360158 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:46.360325 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-eb472747-5435-41f9-84c7-a1efdcab94aa None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:20:46.360325 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-eb472747-5435-41f9-84c7-a1efdcab94aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:20:46.429452 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd522123-3ea4-4f45-9e4e-2e3e3a940007 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:46.469506 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a606cfc-a806-4ca5-a65f-ecb03a4d8a45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:46.470155 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a606cfc-a806-4ca5-a65f-ecb03a4d8a45 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:46.470447 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a606cfc-a806-4ca5-a65f-ecb03a4d8a45 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:46.470730 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a606cfc-a806-4ca5-a65f-ecb03a4d8a45 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:46.545108 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 169/340] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:20:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 07 14:20:46.547026 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677bf620-75e6-47fc-8a67-f83cac53b7a5 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:46.547319 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677bf620-75e6-47fc-8a67-f83cac53b7a5 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:46.547597 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677bf620-75e6-47fc-8a67-f83cac53b7a5 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:46.548330 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a606cfc-a806-4ca5-a65f-ecb03a4d8a45 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:46.548931 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 170/341] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:20:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:20:46.549979 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a606cfc-a806-4ca5-a65f-ecb03a4d8a45 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:46.557082 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8264f9b-a70e-4378-90ed-b1f02555d077 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:46.557440 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8264f9b-a70e-4378-90ed-b1f02555d077 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:46.557655 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8264f9b-a70e-4378-90ed-b1f02555d077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:46.596704 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:46.600794 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-c8264f9b-a70e-4378-90ed-b1f02555d077 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:20:46.602009 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-c8264f9b-a70e-4378-90ed-b1f02555d077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:20:46.632169 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:46.669153 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 172/342] 10.222.0.86 () {58 vars in 1282 bytes} [Tue Jun 7 14:20:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 07 14:20:46.670070 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a606cfc-a806-4ca5-a65f-ecb03a4d8a45 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:46.689791 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 171/343] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:20:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 14:20:46.690664 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8264f9b-a70e-4378-90ed-b1f02555d077 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:46.819131 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8264f9b-a70e-4378-90ed-b1f02555d077 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:46.821368 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a606cfc-a806-4ca5-a65f-ecb03a4d8a45 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:46.857563 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58306a2d-f2dd-498b-9cde-e8ee7c825ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:46.858515 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58306a2d-f2dd-498b-9cde-e8ee7c825ad3 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:46.859305 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58306a2d-f2dd-498b-9cde-e8ee7c825ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:46.859585 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58306a2d-f2dd-498b-9cde-e8ee7c825ad3 None admin] PATH_INFO: `/v3/projects/3cd4810e72844bb58991b6fc44dacec5` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:46.862041 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58306a2d-f2dd-498b-9cde-e8ee7c825ad3 None admin] RBAC: Authorizing `identity:get_project(project_id=3cd4810e72844bb58991b6fc44dacec5)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:46.863528 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58306a2d-f2dd-498b-9cde-e8ee7c825ad3 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:46.864395 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53942e3b-0d6e-476d-869d-c4294e2f0efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:46.865263 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53942e3b-0d6e-476d-869d-c4294e2f0efc None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:46.865384 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 172/344] 10.222.0.86 () {56 vars in 1186 bytes} [Tue Jun 7 14:20:46 2022] GET /identity/v3/projects/3cd4810e72844bb58991b6fc44dacec5 => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:46.866123 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58306a2d-f2dd-498b-9cde-e8ee7c825ad3 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:46.867921 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53942e3b-0d6e-476d-869d-c4294e2f0efc None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:46.868267 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53942e3b-0d6e-476d-869d-c4294e2f0efc None admin] PATH_INFO: `/v3/roles/member` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:46.873457 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:46.886418 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53942e3b-0d6e-476d-869d-c4294e2f0efc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:20:46.892721 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-53942e3b-0d6e-476d-869d-c4294e2f0efc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 07 14:20:46.892721 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:20:46.892721 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:20:46.892721 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:20:46.892721 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:20:46.892721 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:20:46.892721 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:20:46.892721 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:20:46.892721 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:20:46.892721 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:20:46.892721 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:20:46.892721 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:20:46.892721 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:20:46.892721 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:20:46.892721 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:20:46.892721 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:20:46.893642 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:20:46.893642 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:20:46.893642 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:20:46.893642 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:20:46.893642 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:20:46.893642 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:20:46.893642 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:20:46.893642 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:20:46.893642 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:20:46.893642 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:20:46.893642 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:20:46.893642 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jun 07 14:20:46.893642 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:20:46.893642 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:20:46.893642 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:20:46.893642 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:20:46.894424 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:20:46.894424 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:20:46.894424 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:20:46.894424 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:20:46.894424 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:20:46.894424 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:20:46.894424 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:20:46.894424 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:20:46.894424 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:20:46.894424 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:20:46.894424 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 07 14:20:46.894424 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:20:46.894424 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 173/345] 10.222.0.86 () {56 vars in 1099 bytes} [Tue Jun 7 14:20:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:20:46.895552 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53942e3b-0d6e-476d-869d-c4294e2f0efc None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:46.897166 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:46.981246 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58306a2d-f2dd-498b-9cde-e8ee7c825ad3 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:47.014575 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53942e3b-0d6e-476d-869d-c4294e2f0efc None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:47.019010 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3edac30-9bff-42c1-8f6b-f063ee40390b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:47.019168 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3edac30-9bff-42c1-8f6b-f063ee40390b None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:47.019352 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3edac30-9bff-42c1-8f6b-f063ee40390b None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:47.019627 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3edac30-9bff-42c1-8f6b-f063ee40390b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:47.030964 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3edac30-9bff-42c1-8f6b-f063ee40390b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:20:47.039929 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-b3edac30-9bff-42c1-8f6b-f063ee40390b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 07 14:20:47.039929 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:20:47.039929 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:20:47.039929 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:20:47.039929 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:20:47.039929 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:20:47.039929 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:20:47.039929 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:20:47.039929 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:20:47.039929 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:20:47.039929 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:20:47.039929 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:20:47.039929 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:20:47.039929 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:20:47.039929 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:20:47.039929 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:20:47.041311 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:20:47.041311 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:20:47.041311 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:20:47.041311 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:20:47.041311 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:20:47.041311 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:20:47.041311 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:20:47.041311 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:20:47.041311 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:20:47.041311 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:20:47.041311 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:20:47.041311 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jun 07 14:20:47.041311 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:20:47.041311 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:20:47.041311 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:20:47.041311 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:20:47.042378 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:20:47.042378 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:20:47.042378 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:20:47.042378 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:20:47.042378 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:20:47.042378 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:20:47.042378 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:20:47.042378 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:20:47.042378 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:20:47.042378 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:20:47.042378 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 07 14:20:47.042378 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:20:47.042378 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 173/346] 10.222.0.86 () {56 vars in 1114 bytes} [Tue Jun 7 14:20:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:20:47.043168 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3edac30-9bff-42c1-8f6b-f063ee40390b None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:47.057733 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc29231-455a-4ab1-875b-db6d4059e7df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:47.058889 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc29231-455a-4ab1-875b-db6d4059e7df None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:47.059377 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc29231-455a-4ab1-875b-db6d4059e7df None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:47.059848 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc29231-455a-4ab1-875b-db6d4059e7df None admin] PATH_INFO: `/v3/groups/81550b2de84140ec960b9d5833400c69` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:47.066935 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc29231-455a-4ab1-875b-db6d4059e7df None admin] RBAC: Authorizing `identity:get_group(group_id=81550b2de84140ec960b9d5833400c69)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:47.068834 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc29231-455a-4ab1-875b-db6d4059e7df None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:47.070786 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 174/347] 10.222.0.86 () {56 vars in 1180 bytes} [Tue Jun 7 14:20:46 2022] GET /identity/v3/groups/81550b2de84140ec960b9d5833400c69 => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:47.072097 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc29231-455a-4ab1-875b-db6d4059e7df None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:47.135556 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:47.141333 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:47.153981 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3edac30-9bff-42c1-8f6b-f063ee40390b None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:47.188194 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc29231-455a-4ab1-875b-db6d4059e7df None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:47.192867 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7da8720-dd93-48f9-b437-56dbdc52770a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:47.193857 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7da8720-dd93-48f9-b437-56dbdc52770a None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:47.194349 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7da8720-dd93-48f9-b437-56dbdc52770a None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:47.194831 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7da8720-dd93-48f9-b437-56dbdc52770a None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:47.195891 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7da8720-dd93-48f9-b437-56dbdc52770a None admin] RBAC: Adding query filter params (name=member) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:20:47.196846 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7da8720-dd93-48f9-b437-56dbdc52770a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:47.198800 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7da8720-dd93-48f9-b437-56dbdc52770a None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:47.211422 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 174/348] 10.222.0.86 () {56 vars in 1101 bytes} [Tue Jun 7 14:20:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:47.212929 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7da8720-dd93-48f9-b437-56dbdc52770a None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:47.234021 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0854401-cecc-4f3d-9262-fa6173d11b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:47.234509 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0854401-cecc-4f3d-9262-fa6173d11b9a None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:47.234912 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0854401-cecc-4f3d-9262-fa6173d11b9a None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:47.235294 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0854401-cecc-4f3d-9262-fa6173d11b9a None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:47.237988 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0854401-cecc-4f3d-9262-fa6173d11b9a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:20:47.237988 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0854401-cecc-4f3d-9262-fa6173d11b9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:47.238982 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0854401-cecc-4f3d-9262-fa6173d11b9a None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:47.252560 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 175/349] 10.222.0.86 () {56 vars in 1111 bytes} [Tue Jun 7 14:20:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:47.253425 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0854401-cecc-4f3d-9262-fa6173d11b9a None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:47.354764 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7da8720-dd93-48f9-b437-56dbdc52770a None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:47.381544 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0854401-cecc-4f3d-9262-fa6173d11b9a None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:47.398011 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907c4067-805f-4c11-b25a-f05e74ebc5bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:47.398610 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907c4067-805f-4c11-b25a-f05e74ebc5bb None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:47.398896 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907c4067-805f-4c11-b25a-f05e74ebc5bb None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:47.399301 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907c4067-805f-4c11-b25a-f05e74ebc5bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:47.400171 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907c4067-805f-4c11-b25a-f05e74ebc5bb None admin] RBAC: Adding query filter params (group.id=81550b2de84140ec960b9d5833400c69, role.id=c17acc2a8bb348f59ba7edd22fcf0c47, scope.project.id=3cd4810e72844bb58991b6fc44dacec5) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:20:47.400489 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907c4067-805f-4c11-b25a-f05e74ebc5bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:47.402024 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907c4067-805f-4c11-b25a-f05e74ebc5bb None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:47.405042 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:47.410273 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 175/350] 10.222.0.86 () {56 vars in 1376 bytes} [Tue Jun 7 14:20:47 2022] GET /identity/v3/role_assignments?group.id=81550b2de84140ec960b9d5833400c69&scope.project.id=3cd4810e72844bb58991b6fc44dacec5&role.id=c17acc2a8bb348f59ba7edd22fcf0c47 => generated 260 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:47.411100 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907c4067-805f-4c11-b25a-f05e74ebc5bb None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:47.425430 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:47.437087 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b322d42-3a16-49c2-b4a7-64738f700159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:47.437780 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b322d42-3a16-49c2-b4a7-64738f700159 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:47.438067 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b322d42-3a16-49c2-b4a7-64738f700159 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:47.438352 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b322d42-3a16-49c2-b4a7-64738f700159 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:47.543001 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907c4067-805f-4c11-b25a-f05e74ebc5bb None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:47.583490 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d54824-384e-4cbe-b4f1-8c14fb17b55a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:47.584469 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d54824-384e-4cbe-b4f1-8c14fb17b55a None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:47.584832 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d54824-384e-4cbe-b4f1-8c14fb17b55a None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:47.585188 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d54824-384e-4cbe-b4f1-8c14fb17b55a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:47.640925 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b322d42-3a16-49c2-b4a7-64738f700159 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:47.642873 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b322d42-3a16-49c2-b4a7-64738f700159 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:47.669628 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d54824-384e-4cbe-b4f1-8c14fb17b55a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:47.671464 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d54824-384e-4cbe-b4f1-8c14fb17b55a None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:47.689795 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:47.767558 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 176/351] 10.222.0.86 () {58 vars in 1282 bytes} [Tue Jun 7 14:20:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 07 14:20:47.770195 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f6b679-3aa5-4a89-bf32-6db4fe1659a6 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:47.770723 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f6b679-3aa5-4a89-bf32-6db4fe1659a6 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:47.771227 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f6b679-3aa5-4a89-bf32-6db4fe1659a6 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:47.773644 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 177/352] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:20:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:20:47.774605 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f6b679-3aa5-4a89-bf32-6db4fe1659a6 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:47.806951 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 176/353] 10.222.0.86 () {58 vars in 1282 bytes} [Tue Jun 7 14:20:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 07 14:20:47.808683 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb2554c-9483-4012-88c5-8f0d04c82301 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:47.809173 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb2554c-9483-4012-88c5-8f0d04c82301 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:47.809641 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb2554c-9483-4012-88c5-8f0d04c82301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:47.813089 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:47.829857 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-5eb2554c-9483-4012-88c5-8f0d04c82301 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:20:47.831690 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-5eb2554c-9483-4012-88c5-8f0d04c82301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:20:47.913182 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 177/354] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:20:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 14:20:47.915030 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7968f730-624c-4270-833f-5c0d7bd6b6d5 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:47.915527 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7968f730-624c-4270-833f-5c0d7bd6b6d5 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:47.916290 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7968f730-624c-4270-833f-5c0d7bd6b6d5 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:47.918262 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 178/355] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:20:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:20:47.918927 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f6b679-3aa5-4a89-bf32-6db4fe1659a6 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:47.919987 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7968f730-624c-4270-833f-5c0d7bd6b6d5 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:47.965355 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb816f4c-67c7-438a-835d-97dfb95b3849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:47.966232 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb816f4c-67c7-438a-835d-97dfb95b3849 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:47.966515 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb816f4c-67c7-438a-835d-97dfb95b3849 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:47.966788 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb816f4c-67c7-438a-835d-97dfb95b3849 None admin] PATH_INFO: `/v3/projects/6c6e558540ce4a0d85d5c0b4a9d24870` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:47.969168 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb816f4c-67c7-438a-835d-97dfb95b3849 None admin] RBAC: Authorizing `identity:get_project(project_id=6c6e558540ce4a0d85d5c0b4a9d24870)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:47.970639 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb816f4c-67c7-438a-835d-97dfb95b3849 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:47.971783 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:47.974274 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 178/356] 10.222.0.86 () {56 vars in 1186 bytes} [Tue Jun 7 14:20:47 2022] GET /identity/v3/projects/6c6e558540ce4a0d85d5c0b4a9d24870 => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:47.975964 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56777809-389d-4f75-b4db-101db3131158 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:47.976256 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56777809-389d-4f75-b4db-101db3131158 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:47.976627 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56777809-389d-4f75-b4db-101db3131158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:47.998602 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-56777809-389d-4f75-b4db-101db3131158 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:20:48.000926 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-56777809-389d-4f75-b4db-101db3131158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:20:48.042052 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7968f730-624c-4270-833f-5c0d7bd6b6d5 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:48.079844 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 179/357] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:20:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 14:20:48.081036 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56777809-389d-4f75-b4db-101db3131158 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:48.084263 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4547ba7d-5f75-448d-8123-28c4c9162d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:48.084678 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4547ba7d-5f75-448d-8123-28c4c9162d0f None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:48.085125 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4547ba7d-5f75-448d-8123-28c4c9162d0f None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:48.085411 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4547ba7d-5f75-448d-8123-28c4c9162d0f None admin] PATH_INFO: `/v3/projects/3cd4810e72844bb58991b6fc44dacec5` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:48.087469 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4547ba7d-5f75-448d-8123-28c4c9162d0f None admin] RBAC: Authorizing `identity:get_project(project_id=3cd4810e72844bb58991b6fc44dacec5)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:48.090066 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4547ba7d-5f75-448d-8123-28c4c9162d0f None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:48.091797 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 179/358] 10.222.0.86 () {56 vars in 1186 bytes} [Tue Jun 7 14:20:47 2022] GET /identity/v3/projects/3cd4810e72844bb58991b6fc44dacec5 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:48.093710 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4547ba7d-5f75-448d-8123-28c4c9162d0f None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:48.125040 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:48.245502 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4547ba7d-5f75-448d-8123-28c4c9162d0f None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:48.248211 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56777809-389d-4f75-b4db-101db3131158 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:48.264994 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:48.291426 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d483f49-4ed7-4bc6-b557-26b6816c15ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:48.292600 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d483f49-4ed7-4bc6-b557-26b6816c15ce None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:48.292996 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb7c11d-be28-4a49-be48-678f8fac5fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:48.293203 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d483f49-4ed7-4bc6-b557-26b6816c15ce None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:48.293683 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d483f49-4ed7-4bc6-b557-26b6816c15ce None admin] PATH_INFO: `/v3/groups/81550b2de84140ec960b9d5833400c69` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:48.294074 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb7c11d-be28-4a49-be48-678f8fac5fbe None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:48.294499 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb7c11d-be28-4a49-be48-678f8fac5fbe None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:48.294912 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb7c11d-be28-4a49-be48-678f8fac5fbe None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:48.295430 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d483f49-4ed7-4bc6-b557-26b6816c15ce None admin] RBAC: Authorizing `identity:get_group(group_id=81550b2de84140ec960b9d5833400c69)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:48.297964 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d483f49-4ed7-4bc6-b557-26b6816c15ce None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:48.300568 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 180/359] 10.222.0.86 () {56 vars in 1180 bytes} [Tue Jun 7 14:20:48 2022] GET /identity/v3/groups/81550b2de84140ec960b9d5833400c69 => generated 226 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:48.301863 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d483f49-4ed7-4bc6-b557-26b6816c15ce None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:48.308515 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb7c11d-be28-4a49-be48-678f8fac5fbe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:20:48.318532 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-adb7c11d-be28-4a49-be48-678f8fac5fbe None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 07 14:20:48.318532 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:20:48.318532 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:20:48.318532 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:20:48.318532 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:20:48.318532 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:20:48.318532 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:20:48.318532 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:20:48.318532 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:20:48.318532 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:20:48.318532 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:20:48.318532 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:20:48.318532 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:20:48.318532 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:20:48.318532 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:20:48.318532 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:20:48.319658 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:20:48.319658 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:20:48.319658 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:20:48.319658 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:20:48.319658 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:20:48.319658 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:20:48.319658 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:20:48.319658 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:20:48.319658 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:20:48.319658 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:20:48.319658 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:20:48.319658 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jun 07 14:20:48.319658 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:20:48.319658 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:20:48.319658 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:20:48.319658 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:20:48.320664 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:20:48.320664 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:20:48.320664 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:20:48.320664 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:20:48.320664 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:20:48.320664 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:20:48.320664 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:20:48.320664 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:20:48.320664 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:20:48.320664 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:20:48.320664 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 07 14:20:48.320664 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:20:48.323386 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 180/360] 10.222.0.86 () {56 vars in 1099 bytes} [Tue Jun 7 14:20:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:20:48.324522 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb7c11d-be28-4a49-be48-678f8fac5fbe None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:48.437422 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:48.438738 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d483f49-4ed7-4bc6-b557-26b6816c15ce None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:48.462331 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb7c11d-be28-4a49-be48-678f8fac5fbe None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:48.496170 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db425765-50c1-400d-85f2-ae4c0f953cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:48.496984 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db425765-50c1-400d-85f2-ae4c0f953cda None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:48.497269 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db425765-50c1-400d-85f2-ae4c0f953cda None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:48.497548 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db425765-50c1-400d-85f2-ae4c0f953cda None admin] PATH_INFO: `/v3/groups/81550b2de84140ec960b9d5833400c69` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:48.500914 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db425765-50c1-400d-85f2-ae4c0f953cda None admin] RBAC: Authorizing `identity:get_group(group_id=81550b2de84140ec960b9d5833400c69)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:48.501508 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db425765-50c1-400d-85f2-ae4c0f953cda None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:48.503745 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 181/361] 10.222.0.86 () {56 vars in 1180 bytes} [Tue Jun 7 14:20:48 2022] GET /identity/v3/groups/81550b2de84140ec960b9d5833400c69 => generated 226 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:48.506732 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db425765-50c1-400d-85f2-ae4c0f953cda None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:48.517536 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5e93d2-44fc-41fc-97df-270c9e6d0d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:48.518692 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5e93d2-44fc-41fc-97df-270c9e6d0d80 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:48.519204 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5e93d2-44fc-41fc-97df-270c9e6d0d80 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:48.521197 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5e93d2-44fc-41fc-97df-270c9e6d0d80 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:48.538028 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5e93d2-44fc-41fc-97df-270c9e6d0d80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:20:48.547496 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-3d5e93d2-44fc-41fc-97df-270c9e6d0d80 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 07 14:20:48.547496 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:20:48.547496 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:20:48.547496 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:20:48.547496 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:20:48.547496 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:20:48.547496 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:20:48.547496 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:20:48.547496 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:20:48.547496 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:20:48.547496 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:20:48.547496 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:20:48.547496 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:20:48.547496 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:20:48.547496 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:20:48.547496 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:20:48.548433 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:20:48.548433 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:20:48.548433 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:20:48.548433 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:20:48.548433 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:20:48.548433 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:20:48.548433 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:20:48.548433 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:20:48.548433 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:20:48.548433 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:20:48.548433 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:20:48.548433 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jun 07 14:20:48.548433 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:20:48.548433 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:20:48.548433 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:20:48.548433 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:20:48.549280 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:20:48.549280 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:20:48.549280 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:20:48.549280 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:20:48.549280 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:20:48.549280 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:20:48.549280 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:20:48.549280 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:20:48.549280 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:20:48.549280 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:20:48.549280 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 07 14:20:48.549280 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:20:48.551732 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 181/362] 10.222.0.86 () {56 vars in 1114 bytes} [Tue Jun 7 14:20:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:20:48.552780 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5e93d2-44fc-41fc-97df-270c9e6d0d80 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:48.562517 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:48.640304 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db425765-50c1-400d-85f2-ae4c0f953cda None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:48.687189 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47645f8-346c-46dd-8004-255bb9852d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:48.687622 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5e93d2-44fc-41fc-97df-270c9e6d0d80 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:48.687946 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47645f8-346c-46dd-8004-255bb9852d6f None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:48.688231 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47645f8-346c-46dd-8004-255bb9852d6f None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:48.688508 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47645f8-346c-46dd-8004-255bb9852d6f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:48.689354 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47645f8-346c-46dd-8004-255bb9852d6f None admin] RBAC: Adding query filter params (group.id=81550b2de84140ec960b9d5833400c69, role.id=c17acc2a8bb348f59ba7edd22fcf0c47, scope.project.id=6c6e558540ce4a0d85d5c0b4a9d24870) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:20:48.689671 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47645f8-346c-46dd-8004-255bb9852d6f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:48.691115 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47645f8-346c-46dd-8004-255bb9852d6f None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:48.700130 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 182/363] 10.222.0.86 () {56 vars in 1376 bytes} [Tue Jun 7 14:20:48 2022] GET /identity/v3/role_assignments?group.id=81550b2de84140ec960b9d5833400c69&scope.project.id=6c6e558540ce4a0d85d5c0b4a9d24870&role.id=c17acc2a8bb348f59ba7edd22fcf0c47 => generated 260 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:48.700946 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47645f8-346c-46dd-8004-255bb9852d6f None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:48.744045 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9cc92f-f23e-4802-8ba5-d7761fada36c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:48.745134 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9cc92f-f23e-4802-8ba5-d7761fada36c None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:48.745632 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9cc92f-f23e-4802-8ba5-d7761fada36c None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:48.746131 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9cc92f-f23e-4802-8ba5-d7761fada36c None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:48.747186 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9cc92f-f23e-4802-8ba5-d7761fada36c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:20:48.747732 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9cc92f-f23e-4802-8ba5-d7761fada36c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:48.749897 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9cc92f-f23e-4802-8ba5-d7761fada36c None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:48.761368 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 182/364] 10.222.0.86 () {56 vars in 1101 bytes} [Tue Jun 7 14:20:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:48.763295 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0265a6-ae98-4815-8c19-b71c10822d62 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:48.763786 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0265a6-ae98-4815-8c19-b71c10822d62 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:48.764274 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0265a6-ae98-4815-8c19-b71c10822d62 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:48.767550 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 183/365] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:20:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:20:48.768666 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0265a6-ae98-4815-8c19-b71c10822d62 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:48.771999 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:48.841755 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47645f8-346c-46dd-8004-255bb9852d6f None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:48.854356 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:48.886125 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50a909e-0c0b-4ede-8b18-8866c77a2ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:48.887998 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50a909e-0c0b-4ede-8b18-8866c77a2ff2 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:48.888528 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50a909e-0c0b-4ede-8b18-8866c77a2ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:48.889266 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50a909e-0c0b-4ede-8b18-8866c77a2ff2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:48.891369 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50a909e-0c0b-4ede-8b18-8866c77a2ff2 None admin] RBAC: Adding query filter params (group.id=81550b2de84140ec960b9d5833400c69, role.id=a2755a2b621b4e969fd366f0035d672b, scope.project.id=3cd4810e72844bb58991b6fc44dacec5) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:20:48.892264 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50a909e-0c0b-4ede-8b18-8866c77a2ff2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:48.894235 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50a909e-0c0b-4ede-8b18-8866c77a2ff2 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:48.894688 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0265a6-ae98-4815-8c19-b71c10822d62 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:48.909823 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 183/366] 10.222.0.86 () {56 vars in 1376 bytes} [Tue Jun 7 14:20:48 2022] GET /identity/v3/role_assignments?group.id=81550b2de84140ec960b9d5833400c69&scope.project.id=3cd4810e72844bb58991b6fc44dacec5&role.id=a2755a2b621b4e969fd366f0035d672b => generated 260 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:48.910718 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50a909e-0c0b-4ede-8b18-8866c77a2ff2 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:48.942702 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fca79d9-b460-4d0b-a566-fd8f151f66ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:48.944647 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fca79d9-b460-4d0b-a566-fd8f151f66ed None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:48.945151 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fca79d9-b460-4d0b-a566-fd8f151f66ed None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:48.945633 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fca79d9-b460-4d0b-a566-fd8f151f66ed None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:48.946599 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fca79d9-b460-4d0b-a566-fd8f151f66ed None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:20:48.947985 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fca79d9-b460-4d0b-a566-fd8f151f66ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:48.949912 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fca79d9-b460-4d0b-a566-fd8f151f66ed None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:48.965163 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 184/367] 10.222.0.86 () {56 vars in 1111 bytes} [Tue Jun 7 14:20:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:48.967062 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e1dd8b-dd93-4bfb-bfe1-d9f1118d3bac None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:48.967569 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e1dd8b-dd93-4bfb-bfe1-d9f1118d3bac None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:48.968587 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e1dd8b-dd93-4bfb-bfe1-d9f1118d3bac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:48.991066 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-49e1dd8b-dd93-4bfb-bfe1-d9f1118d3bac None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:20:48.992989 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-49e1dd8b-dd93-4bfb-bfe1-d9f1118d3bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:20:49.069103 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50a909e-0c0b-4ede-8b18-8866c77a2ff2 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:49.086867 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:49.100448 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 185/368] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:20:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 14:20:49.103347 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e1dd8b-dd93-4bfb-bfe1-d9f1118d3bac None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:49.128247 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c26369-692c-46ef-aead-d0e40b38f8e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:49.129195 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c26369-692c-46ef-aead-d0e40b38f8e1 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:49.129487 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c26369-692c-46ef-aead-d0e40b38f8e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:49.129767 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c26369-692c-46ef-aead-d0e40b38f8e1 None admin] PATH_INFO: `/v3/users/af3648f2dc764b07b1e527af6cd443f8` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:49.136814 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c26369-692c-46ef-aead-d0e40b38f8e1 None admin] RBAC: Authorizing `identity:get_user(user_id=af3648f2dc764b07b1e527af6cd443f8)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:49.138272 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c26369-692c-46ef-aead-d0e40b38f8e1 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:49.140150 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 184/369] 10.222.0.86 () {56 vars in 1177 bytes} [Tue Jun 7 14:20:48 2022] GET /identity/v3/users/af3648f2dc764b07b1e527af6cd443f8 => generated 293 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:49.148133 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c26369-692c-46ef-aead-d0e40b38f8e1 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:49.200452 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:49.257194 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e1dd8b-dd93-4bfb-bfe1-d9f1118d3bac None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:49.262662 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c26369-692c-46ef-aead-d0e40b38f8e1 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:49.293918 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd433db-aeed-456d-8c13-724def1970da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:49.294582 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd433db-aeed-456d-8c13-724def1970da None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:49.294872 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd433db-aeed-456d-8c13-724def1970da None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:49.295154 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd433db-aeed-456d-8c13-724def1970da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:49.302849 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbcdae9-894b-4fc5-9f5e-ab3ba25f3664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:49.303528 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbcdae9-894b-4fc5-9f5e-ab3ba25f3664 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:49.303846 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbcdae9-894b-4fc5-9f5e-ab3ba25f3664 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:49.304434 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbcdae9-894b-4fc5-9f5e-ab3ba25f3664 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:49.305279 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbcdae9-894b-4fc5-9f5e-ab3ba25f3664 None admin] RBAC: Adding query filter params (role.id=bce2bd9e8c164e7ca92ba5e110848be0, user.id=af3648f2dc764b07b1e527af6cd443f8, scope.system=all) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:20:49.305587 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbcdae9-894b-4fc5-9f5e-ab3ba25f3664 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:49.307066 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbcdae9-894b-4fc5-9f5e-ab3ba25f3664 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:49.320533 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 185/370] 10.222.0.86 () {56 vars in 1308 bytes} [Tue Jun 7 14:20:49 2022] GET /identity/v3/role_assignments?user.id=af3648f2dc764b07b1e527af6cd443f8&scope.system=all&role.id=bce2bd9e8c164e7ca92ba5e110848be0 => generated 510 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:20:49.321313 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbcdae9-894b-4fc5-9f5e-ab3ba25f3664 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:49.368487 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:49.371189 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd433db-aeed-456d-8c13-724def1970da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:49.372761 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd433db-aeed-456d-8c13-724def1970da None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:49.482754 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 186/371] 10.222.0.86 () {58 vars in 1282 bytes} [Tue Jun 7 14:20:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 07 14:20:49.489855 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd433db-aeed-456d-8c13-724def1970da None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:49.548123 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:49.555704 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbcdae9-894b-4fc5-9f5e-ab3ba25f3664 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:49.596217 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:49.604064 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd433db-aeed-456d-8c13-724def1970da None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:49.641042 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f678428-bff8-4515-89b9-ff456f2d7a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:49.642027 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f678428-bff8-4515-89b9-ff456f2d7a04 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:49.642259 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc30c518-96e4-49c9-92c6-e67cfb27176f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:49.642383 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f678428-bff8-4515-89b9-ff456f2d7a04 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:49.642565 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f678428-bff8-4515-89b9-ff456f2d7a04 None admin] PATH_INFO: `/v3/projects/6c6e558540ce4a0d85d5c0b4a9d24870` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:49.643666 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc30c518-96e4-49c9-92c6-e67cfb27176f None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:49.643966 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f678428-bff8-4515-89b9-ff456f2d7a04 None admin] RBAC: Authorizing `identity:get_project(project_id=6c6e558540ce4a0d85d5c0b4a9d24870)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:49.644387 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc30c518-96e4-49c9-92c6-e67cfb27176f None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:49.644862 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc30c518-96e4-49c9-92c6-e67cfb27176f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:49.645432 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f678428-bff8-4515-89b9-ff456f2d7a04 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:49.647650 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 187/372] 10.222.0.86 () {56 vars in 1186 bytes} [Tue Jun 7 14:20:49 2022] GET /identity/v3/projects/6c6e558540ce4a0d85d5c0b4a9d24870 => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:20:49.653141 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f678428-bff8-4515-89b9-ff456f2d7a04 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:49.672735 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc30c518-96e4-49c9-92c6-e67cfb27176f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:20:49.681053 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-dc30c518-96e4-49c9-92c6-e67cfb27176f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 14:20:49.681053 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:20:49.681053 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:20:49.681053 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:20:49.681053 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:20:49.681053 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:20:49.681053 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:20:49.681053 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:20:49.681053 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:20:49.681053 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:20:49.681053 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:20:49.681053 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:20:49.681053 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:20:49.681053 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:20:49.681053 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:20:49.681053 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:20:49.681960 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:20:49.681960 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:20:49.681960 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:20:49.681960 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:20:49.681960 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:20:49.681960 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:20:49.681960 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:20:49.681960 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:20:49.681960 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:20:49.681960 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:20:49.681960 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:20:49.681960 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jun 07 14:20:49.681960 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:20:49.681960 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:20:49.681960 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:20:49.681960 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:20:49.682727 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:20:49.682727 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:20:49.682727 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:20:49.682727 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:20:49.682727 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:20:49.682727 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:20:49.682727 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:20:49.682727 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:20:49.682727 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:20:49.682727 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:20:49.682727 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 14:20:49.682727 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:20:49.689782 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 186/373] 10.222.0.86 () {56 vars in 1096 bytes} [Tue Jun 7 14:20:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 369 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:20:49.695666 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc30c518-96e4-49c9-92c6-e67cfb27176f None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:49.765502 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f678428-bff8-4515-89b9-ff456f2d7a04 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:49.801558 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27a541f-2b16-4aed-b38d-b273f28a30d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:49.802530 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27a541f-2b16-4aed-b38d-b273f28a30d9 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:49.802821 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27a541f-2b16-4aed-b38d-b273f28a30d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:49.803099 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27a541f-2b16-4aed-b38d-b273f28a30d9 None admin] PATH_INFO: `/v3/groups/81550b2de84140ec960b9d5833400c69` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:49.804368 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27a541f-2b16-4aed-b38d-b273f28a30d9 None admin] RBAC: Authorizing `identity:get_group(group_id=81550b2de84140ec960b9d5833400c69)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:49.805829 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27a541f-2b16-4aed-b38d-b273f28a30d9 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:49.807967 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 188/374] 10.222.0.86 () {56 vars in 1180 bytes} [Tue Jun 7 14:20:49 2022] GET /identity/v3/groups/81550b2de84140ec960b9d5833400c69 => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:49.815677 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27a541f-2b16-4aed-b38d-b273f28a30d9 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:49.852235 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:49.923590 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27a541f-2b16-4aed-b38d-b273f28a30d9 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:49.925817 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc30c518-96e4-49c9-92c6-e67cfb27176f None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:49.962093 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f9fc40-778a-4dc9-8e23-1d2bd4152599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:49.962757 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f9fc40-778a-4dc9-8e23-1d2bd4152599 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:49.963039 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f9fc40-778a-4dc9-8e23-1d2bd4152599 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:49.963316 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f9fc40-778a-4dc9-8e23-1d2bd4152599 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:49.964194 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f9fc40-778a-4dc9-8e23-1d2bd4152599 None admin] RBAC: Adding query filter params (group.id=81550b2de84140ec960b9d5833400c69, role.id=a2755a2b621b4e969fd366f0035d672b, scope.project.id=6c6e558540ce4a0d85d5c0b4a9d24870) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:20:49.964503 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f9fc40-778a-4dc9-8e23-1d2bd4152599 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:49.966068 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f9fc40-778a-4dc9-8e23-1d2bd4152599 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:49.972950 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 189/375] 10.222.0.86 () {56 vars in 1376 bytes} [Tue Jun 7 14:20:49 2022] GET /identity/v3/role_assignments?group.id=81550b2de84140ec960b9d5833400c69&scope.project.id=6c6e558540ce4a0d85d5c0b4a9d24870&role.id=a2755a2b621b4e969fd366f0035d672b => generated 260 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:49.995334 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc448110-9bae-4386-91ad-c4a0671e785c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:49.996094 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc448110-9bae-4386-91ad-c4a0671e785c None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:49.996378 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc448110-9bae-4386-91ad-c4a0671e785c None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:49.996653 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc448110-9bae-4386-91ad-c4a0671e785c None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:49.997463 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc448110-9bae-4386-91ad-c4a0671e785c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:20:49.997772 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc448110-9bae-4386-91ad-c4a0671e785c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:49.999180 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc448110-9bae-4386-91ad-c4a0671e785c None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:50.008971 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 187/376] 10.222.0.86 () {56 vars in 1099 bytes} [Tue Jun 7 14:20:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:50.016166 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f9fc40-778a-4dc9-8e23-1d2bd4152599 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:50.148763 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:50.156434 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f9fc40-778a-4dc9-8e23-1d2bd4152599 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:50.196820 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d9b143-a927-4882-8db5-b850497084a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:50.197490 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d9b143-a927-4882-8db5-b850497084a2 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:50.197774 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d9b143-a927-4882-8db5-b850497084a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:50.198051 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d9b143-a927-4882-8db5-b850497084a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:50.273937 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d9b143-a927-4882-8db5-b850497084a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:50.275417 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d9b143-a927-4882-8db5-b850497084a2 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:50.376173 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:50.379153 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 190/377] 10.222.0.86 () {58 vars in 1282 bytes} [Tue Jun 7 14:20:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 07 14:20:50.385066 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc448110-9bae-4386-91ad-c4a0671e785c None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:50.408437 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:50.495141 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc448110-9bae-4386-91ad-c4a0671e785c None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:50.536853 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf553a71-9117-4a0b-b6a6-de89d3875712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:50.537772 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf553a71-9117-4a0b-b6a6-de89d3875712 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:50.538057 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf553a71-9117-4a0b-b6a6-de89d3875712 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:50.538330 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf553a71-9117-4a0b-b6a6-de89d3875712 None admin] PATH_INFO: `/v3/projects/7ce15f4da81a4a5c8d99aabf417988bf` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:50.539510 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf553a71-9117-4a0b-b6a6-de89d3875712 None admin] RBAC: Authorizing `identity:get_project(project_id=7ce15f4da81a4a5c8d99aabf417988bf)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:50.541234 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf553a71-9117-4a0b-b6a6-de89d3875712 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:50.542919 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 188/378] 10.222.0.86 () {56 vars in 1186 bytes} [Tue Jun 7 14:20:50 2022] GET /identity/v3/projects/7ce15f4da81a4a5c8d99aabf417988bf => generated 344 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:50.549029 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d9b143-a927-4882-8db5-b850497084a2 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:50.651229 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d11917-c3a1-4327-baf9-c8e63f71ffe8 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:50.651544 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d11917-c3a1-4327-baf9-c8e63f71ffe8 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:50.651818 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d11917-c3a1-4327-baf9-c8e63f71ffe8 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:50.653388 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 189/379] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:20:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 07 14:20:50.661363 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad66c0c-2601-40f9-b728-b4f71786974a None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:50.661614 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad66c0c-2601-40f9-b728-b4f71786974a None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:50.661855 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad66c0c-2601-40f9-b728-b4f71786974a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:50.682134 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d9b143-a927-4882-8db5-b850497084a2 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:50.688062 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-dad66c0c-2601-40f9-b728-b4f71786974a None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:20:50.691409 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-dad66c0c-2601-40f9-b728-b4f71786974a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:20:50.740245 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bb4830-1b7e-4856-b34e-fec17385d5ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:50.741208 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bb4830-1b7e-4856-b34e-fec17385d5ff None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:50.741491 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bb4830-1b7e-4856-b34e-fec17385d5ff None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:50.741764 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bb4830-1b7e-4856-b34e-fec17385d5ff None admin] PATH_INFO: `/v3/groups/af22d3580ec841c3bdfae761c90418d8` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:50.747635 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bb4830-1b7e-4856-b34e-fec17385d5ff None admin] RBAC: Authorizing `identity:get_group(group_id=af22d3580ec841c3bdfae761c90418d8)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:50.749232 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bb4830-1b7e-4856-b34e-fec17385d5ff None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:50.753326 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 191/380] 10.222.0.86 () {56 vars in 1180 bytes} [Tue Jun 7 14:20:50 2022] GET /identity/v3/groups/af22d3580ec841c3bdfae761c90418d8 => generated 229 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:50.760871 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bb4830-1b7e-4856-b34e-fec17385d5ff None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:50.828736 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 190/381] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:20:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 07 14:20:50.856184 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:50.863405 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad66c0c-2601-40f9-b728-b4f71786974a None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:50.893200 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:50.922064 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bb4830-1b7e-4856-b34e-fec17385d5ff None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:50.961324 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbbbecc-bceb-4010-b8cf-b921ca8ee473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:50.961995 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbbbecc-bceb-4010-b8cf-b921ca8ee473 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:50.962277 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbbbecc-bceb-4010-b8cf-b921ca8ee473 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:50.962813 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbbbecc-bceb-4010-b8cf-b921ca8ee473 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:50.963373 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbbbecc-bceb-4010-b8cf-b921ca8ee473 None admin] RBAC: Adding query filter params (group.id=af22d3580ec841c3bdfae761c90418d8, role.id=e3bf6239f5bf477b965704b086786f11, scope.project.id=7ce15f4da81a4a5c8d99aabf417988bf) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:20:50.963694 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbbbecc-bceb-4010-b8cf-b921ca8ee473 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:50.968891 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbbbecc-bceb-4010-b8cf-b921ca8ee473 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:50.976539 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 192/382] 10.222.0.86 () {56 vars in 1376 bytes} [Tue Jun 7 14:20:50 2022] GET /identity/v3/role_assignments?group.id=af22d3580ec841c3bdfae761c90418d8&scope.project.id=7ce15f4da81a4a5c8d99aabf417988bf&role.id=e3bf6239f5bf477b965704b086786f11 => generated 260 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:20:51.038526 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad66c0c-2601-40f9-b728-b4f71786974a None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:51.080485 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdd2c17-4b27-4809-8657-882716f1036e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:51.081372 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdd2c17-4b27-4809-8657-882716f1036e None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:51.081652 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdd2c17-4b27-4809-8657-882716f1036e None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:51.081967 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdd2c17-4b27-4809-8657-882716f1036e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:51.094023 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdd2c17-4b27-4809-8657-882716f1036e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:20:51.102103 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-7bdd2c17-4b27-4809-8657-882716f1036e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 07 14:20:51.102103 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:20:51.102103 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:20:51.102103 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:20:51.102103 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:20:51.102103 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:20:51.102103 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:20:51.102103 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:20:51.102103 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:20:51.102103 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:20:51.102103 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:20:51.102103 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:20:51.102103 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:20:51.102103 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:20:51.102103 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:20:51.102103 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:20:51.103051 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:20:51.103051 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:20:51.103051 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:20:51.103051 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:20:51.103051 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:20:51.103051 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:20:51.103051 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:20:51.103051 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:20:51.103051 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:20:51.103051 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:20:51.103051 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:20:51.103051 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jun 07 14:20:51.103051 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:20:51.103051 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:20:51.103051 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:20:51.103051 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:20:51.103934 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:20:51.103934 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:20:51.103934 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:20:51.103934 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:20:51.103934 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:20:51.103934 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:20:51.103934 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:20:51.103934 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:20:51.103934 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:20:51.103934 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:20:51.103934 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 07 14:20:51.103934 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:20:51.103934 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 191/383] 10.222.0.86 () {56 vars in 1099 bytes} [Tue Jun 7 14:20:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:20:51.110384 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbbbecc-bceb-4010-b8cf-b921ca8ee473 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:51.226993 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbbbecc-bceb-4010-b8cf-b921ca8ee473 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:51.255999 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:51.267477 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da72c4c7-543e-4806-b9ac-bd1ffe73e66a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:51.268425 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da72c4c7-543e-4806-b9ac-bd1ffe73e66a None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:51.268887 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da72c4c7-543e-4806-b9ac-bd1ffe73e66a None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:51.269321 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da72c4c7-543e-4806-b9ac-bd1ffe73e66a None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:51.270226 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da72c4c7-543e-4806-b9ac-bd1ffe73e66a None admin] RBAC: Adding query filter params (name=member) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:20:51.270682 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da72c4c7-543e-4806-b9ac-bd1ffe73e66a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:51.272229 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da72c4c7-543e-4806-b9ac-bd1ffe73e66a None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:51.285850 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 193/384] 10.222.0.86 () {56 vars in 1101 bytes} [Tue Jun 7 14:20:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:51.296873 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdd2c17-4b27-4809-8657-882716f1036e None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:51.390142 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:51.418849 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdd2c17-4b27-4809-8657-882716f1036e None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:51.458157 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c548afb-f1ae-46e3-9266-d2363e2589d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:51.459030 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c548afb-f1ae-46e3-9266-d2363e2589d0 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:51.459312 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c548afb-f1ae-46e3-9266-d2363e2589d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:51.459586 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c548afb-f1ae-46e3-9266-d2363e2589d0 None admin] PATH_INFO: `/v3/groups/81550b2de84140ec960b9d5833400c69` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:51.460786 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c548afb-f1ae-46e3-9266-d2363e2589d0 None admin] RBAC: Authorizing `identity:get_group(group_id=81550b2de84140ec960b9d5833400c69)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:51.462338 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c548afb-f1ae-46e3-9266-d2363e2589d0 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:51.467863 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 192/385] 10.222.0.86 () {56 vars in 1180 bytes} [Tue Jun 7 14:20:51 2022] GET /identity/v3/groups/81550b2de84140ec960b9d5833400c69 => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:51.472865 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da72c4c7-543e-4806-b9ac-bd1ffe73e66a None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:51.622617 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da72c4c7-543e-4806-b9ac-bd1ffe73e66a None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:51.665374 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a908793-dd32-45ff-b37c-4545970c50e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:51.666496 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a908793-dd32-45ff-b37c-4545970c50e2 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:51.666784 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a908793-dd32-45ff-b37c-4545970c50e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:51.667061 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a908793-dd32-45ff-b37c-4545970c50e2 None admin] PATH_INFO: `/v3/projects/3cd4810e72844bb58991b6fc44dacec5` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:51.668303 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a908793-dd32-45ff-b37c-4545970c50e2 None admin] RBAC: Authorizing `identity:get_project(project_id=3cd4810e72844bb58991b6fc44dacec5)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:51.669763 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a908793-dd32-45ff-b37c-4545970c50e2 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:51.672237 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 194/386] 10.222.0.86 () {56 vars in 1186 bytes} [Tue Jun 7 14:20:51 2022] GET /identity/v3/projects/3cd4810e72844bb58991b6fc44dacec5 => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:51.677762 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c548afb-f1ae-46e3-9266-d2363e2589d0 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:51.808666 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c548afb-f1ae-46e3-9266-d2363e2589d0 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:51.850858 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c20177f-acfa-426d-8d50-8ceb0e5fcef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:51.851748 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c20177f-acfa-426d-8d50-8ceb0e5fcef3 None admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:51.852060 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c20177f-acfa-426d-8d50-8ceb0e5fcef3 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:51.852341 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c20177f-acfa-426d-8d50-8ceb0e5fcef3 None admin] PATH_INFO: `/v3/projects/3cd4810e72844bb58991b6fc44dacec5/groups/81550b2de84140ec960b9d5833400c69/roles/c17acc2a8bb348f59ba7edd22fcf0c47` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:51.854362 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c20177f-acfa-426d-8d50-8ceb0e5fcef3 None admin] RBAC: Authorizing `identity:create_grant(project_id=3cd4810e72844bb58991b6fc44dacec5, group_id=81550b2de84140ec960b9d5833400c69, role_id=c17acc2a8bb348f59ba7edd22fcf0c47)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:51.855821 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c20177f-acfa-426d-8d50-8ceb0e5fcef3 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:51.954749 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 193/387] 10.222.0.86 () {58 vars in 1442 bytes} [Tue Jun 7 14:20:51 2022] PUT /identity/v3/projects/3cd4810e72844bb58991b6fc44dacec5/groups/81550b2de84140ec960b9d5833400c69/roles/c17acc2a8bb348f59ba7edd22fcf0c47 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:20:52.088211 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce9fd8c-cdbb-4c60-a06b-443613f4ef4e None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:52.088769 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce9fd8c-cdbb-4c60-a06b-443613f4ef4e None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:52.088769 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce9fd8c-cdbb-4c60-a06b-443613f4ef4e None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:52.090509 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 195/388] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:20:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:20:52.096520 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da6dda9-afef-42d3-81cc-83ffd8f84fc0 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:52.096985 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da6dda9-afef-42d3-81cc-83ffd8f84fc0 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:52.097086 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da6dda9-afef-42d3-81cc-83ffd8f84fc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:52.111432 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:52.125133 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-9da6dda9-afef-42d3-81cc-83ffd8f84fc0 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:20:52.126417 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-9da6dda9-afef-42d3-81cc-83ffd8f84fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:20:52.219598 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 194/389] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:20:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 14:20:52.245054 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce9fd8c-cdbb-4c60-a06b-443613f4ef4e None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:52.307859 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:52.323743 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c09cf8d-7efd-4690-83ea-90e520fcae21 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:52.325019 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c09cf8d-7efd-4690-83ea-90e520fcae21 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:52.325019 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c09cf8d-7efd-4690-83ea-90e520fcae21 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:52.325973 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 195/390] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:20:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:20:52.331018 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd38a79d-7761-4d47-a669-2fc57c28e520 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:52.331311 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd38a79d-7761-4d47-a669-2fc57c28e520 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:52.331598 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd38a79d-7761-4d47-a669-2fc57c28e520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:52.355703 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-bd38a79d-7761-4d47-a669-2fc57c28e520 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:20:52.357121 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-bd38a79d-7761-4d47-a669-2fc57c28e520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:20:52.362570 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce9fd8c-cdbb-4c60-a06b-443613f4ef4e None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:52.399637 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795b54dd-9a6e-4199-a406-a28736f6411c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:52.400467 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795b54dd-9a6e-4199-a406-a28736f6411c None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:52.401233 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795b54dd-9a6e-4199-a406-a28736f6411c None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:52.401522 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795b54dd-9a6e-4199-a406-a28736f6411c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:52.414985 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795b54dd-9a6e-4199-a406-a28736f6411c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:20:52.425358 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-795b54dd-9a6e-4199-a406-a28736f6411c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 07 14:20:52.425358 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:20:52.425358 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:20:52.425358 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:20:52.425358 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:20:52.425358 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:20:52.425358 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:20:52.425358 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:20:52.425358 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:20:52.425358 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:20:52.425358 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:20:52.425358 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:20:52.425358 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:20:52.425358 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:20:52.425358 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:20:52.425358 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:20:52.426492 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:20:52.426492 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:20:52.426492 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:20:52.426492 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:20:52.426492 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:20:52.426492 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:20:52.426492 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:20:52.426492 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:20:52.426492 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:20:52.426492 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:20:52.426492 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:20:52.426492 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jun 07 14:20:52.426492 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:20:52.426492 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:20:52.426492 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:20:52.426492 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:20:52.427614 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:20:52.427614 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:20:52.427614 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:20:52.427614 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:20:52.427614 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:20:52.427614 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:20:52.427614 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:20:52.427614 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:20:52.427614 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:20:52.427614 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:20:52.427614 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 07 14:20:52.427614 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:20:52.427614 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 196/391] 10.222.0.86 () {56 vars in 1099 bytes} [Tue Jun 7 14:20:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:20:52.432200 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795b54dd-9a6e-4199-a406-a28736f6411c None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:52.484402 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 196/392] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:20:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 07 14:20:52.512959 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd38a79d-7761-4d47-a669-2fc57c28e520 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:52.604696 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795b54dd-9a6e-4199-a406-a28736f6411c None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:52.623306 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:52.626771 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:52.666721 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7c2a77-df7b-455b-90b7-c876f23e9a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:52.667450 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7c2a77-df7b-455b-90b7-c876f23e9a9a None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:52.667725 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7c2a77-df7b-455b-90b7-c876f23e9a9a None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:52.668021 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7c2a77-df7b-455b-90b7-c876f23e9a9a None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:52.668778 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7c2a77-df7b-455b-90b7-c876f23e9a9a None admin] RBAC: Adding query filter params (name=member) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:20:52.669088 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7c2a77-df7b-455b-90b7-c876f23e9a9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:52.670457 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7c2a77-df7b-455b-90b7-c876f23e9a9a None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:52.685392 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 197/393] 10.222.0.86 () {56 vars in 1101 bytes} [Tue Jun 7 14:20:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:20:52.686653 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd38a79d-7761-4d47-a669-2fc57c28e520 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:52.693673 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7c2a77-df7b-455b-90b7-c876f23e9a9a None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:52.726988 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e69bd2c-1395-4502-9682-20940e221fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:52.727894 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e69bd2c-1395-4502-9682-20940e221fc8 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:52.728186 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e69bd2c-1395-4502-9682-20940e221fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:52.728474 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e69bd2c-1395-4502-9682-20940e221fc8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:52.741159 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e69bd2c-1395-4502-9682-20940e221fc8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:20:52.749522 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-3e69bd2c-1395-4502-9682-20940e221fc8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 07 14:20:52.749522 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:20:52.749522 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:20:52.749522 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:20:52.749522 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:20:52.749522 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:20:52.749522 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:20:52.749522 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:20:52.749522 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:20:52.749522 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:20:52.749522 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:20:52.749522 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:20:52.749522 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:20:52.749522 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:20:52.749522 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:20:52.749522 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:20:52.750376 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:20:52.750376 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:20:52.750376 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:20:52.750376 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:20:52.750376 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:20:52.750376 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:20:52.750376 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:20:52.750376 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:20:52.750376 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:20:52.750376 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:20:52.750376 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:20:52.750376 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jun 07 14:20:52.750376 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:20:52.750376 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:20:52.750376 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:20:52.750376 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:20:52.751341 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:20:52.751341 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:20:52.751341 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:20:52.751341 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:20:52.751341 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:20:52.751341 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:20:52.751341 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:20:52.751341 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:20:52.751341 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:20:52.751341 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:20:52.751341 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 07 14:20:52.751341 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:20:52.751341 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 197/394] 10.222.0.86 () {56 vars in 1114 bytes} [Tue Jun 7 14:20:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:20:52.756781 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e69bd2c-1395-4502-9682-20940e221fc8 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:52.875403 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e69bd2c-1395-4502-9682-20940e221fc8 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:52.903465 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:52.911778 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7c2a77-df7b-455b-90b7-c876f23e9a9a None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:52.916372 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc133b9b-8072-46b1-81c1-9d92a635c77b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:52.917794 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc133b9b-8072-46b1-81c1-9d92a635c77b None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:52.918464 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc133b9b-8072-46b1-81c1-9d92a635c77b None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:52.919117 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc133b9b-8072-46b1-81c1-9d92a635c77b None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:52.920144 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc133b9b-8072-46b1-81c1-9d92a635c77b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:20:52.920705 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc133b9b-8072-46b1-81c1-9d92a635c77b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:52.922451 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc133b9b-8072-46b1-81c1-9d92a635c77b None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:52.932490 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 198/395] 10.222.0.86 () {56 vars in 1111 bytes} [Tue Jun 7 14:20:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:52.938621 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc133b9b-8072-46b1-81c1-9d92a635c77b None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:52.977231 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1a3273-39b5-4afe-b0f9-3fdd5b6d6a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:52.978653 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1a3273-39b5-4afe-b0f9-3fdd5b6d6a7b None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:52.978653 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1a3273-39b5-4afe-b0f9-3fdd5b6d6a7b None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:52.978824 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1a3273-39b5-4afe-b0f9-3fdd5b6d6a7b None admin] PATH_INFO: `/v3/groups/81550b2de84140ec960b9d5833400c69` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:52.984730 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1a3273-39b5-4afe-b0f9-3fdd5b6d6a7b None admin] RBAC: Authorizing `identity:get_group(group_id=81550b2de84140ec960b9d5833400c69)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:52.986059 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1a3273-39b5-4afe-b0f9-3fdd5b6d6a7b None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:52.987858 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 198/396] 10.222.0.86 () {56 vars in 1180 bytes} [Tue Jun 7 14:20:52 2022] GET /identity/v3/groups/81550b2de84140ec960b9d5833400c69 => generated 226 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:52.993449 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1a3273-39b5-4afe-b0f9-3fdd5b6d6a7b None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:53.050317 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc133b9b-8072-46b1-81c1-9d92a635c77b None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:53.071506 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:53.096478 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4dc591-95c7-4473-ba3c-6d72cb2cdf17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:53.097694 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4dc591-95c7-4473-ba3c-6d72cb2cdf17 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:53.098610 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4dc591-95c7-4473-ba3c-6d72cb2cdf17 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:53.100184 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4dc591-95c7-4473-ba3c-6d72cb2cdf17 None admin] PATH_INFO: `/v3/groups/81550b2de84140ec960b9d5833400c69` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:53.102266 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4dc591-95c7-4473-ba3c-6d72cb2cdf17 None admin] RBAC: Authorizing `identity:get_group(group_id=81550b2de84140ec960b9d5833400c69)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:53.103994 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4dc591-95c7-4473-ba3c-6d72cb2cdf17 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:53.107022 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 199/397] 10.222.0.86 () {56 vars in 1180 bytes} [Tue Jun 7 14:20:52 2022] GET /identity/v3/groups/81550b2de84140ec960b9d5833400c69 => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:53.115251 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4dc591-95c7-4473-ba3c-6d72cb2cdf17 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:53.189942 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1a3273-39b5-4afe-b0f9-3fdd5b6d6a7b None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:53.238113 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:53.261282 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b94797-b994-49dc-be1c-350dbcbae668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:53.262505 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b94797-b994-49dc-be1c-350dbcbae668 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:53.262987 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b94797-b994-49dc-be1c-350dbcbae668 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:53.263426 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b94797-b994-49dc-be1c-350dbcbae668 None admin] PATH_INFO: `/v3/projects/6c6e558540ce4a0d85d5c0b4a9d24870` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:53.265108 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b94797-b994-49dc-be1c-350dbcbae668 None admin] RBAC: Authorizing `identity:get_project(project_id=6c6e558540ce4a0d85d5c0b4a9d24870)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:53.266737 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b94797-b994-49dc-be1c-350dbcbae668 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:53.268915 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 199/398] 10.222.0.86 () {56 vars in 1186 bytes} [Tue Jun 7 14:20:52 2022] GET /identity/v3/projects/6c6e558540ce4a0d85d5c0b4a9d24870 => generated 302 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:53.270329 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b812fc6e-cae7-47c1-a88d-82c9facc8813 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:53.270886 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b812fc6e-cae7-47c1-a88d-82c9facc8813 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:53.271386 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b812fc6e-cae7-47c1-a88d-82c9facc8813 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:53.273379 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 200/399] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:20:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:20:53.279036 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584a93f7-eb27-4fc6-bfc6-3ea698f76b0d None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:53.279564 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584a93f7-eb27-4fc6-bfc6-3ea698f76b0d None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:53.280639 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584a93f7-eb27-4fc6-bfc6-3ea698f76b0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:53.302860 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-584a93f7-eb27-4fc6-bfc6-3ea698f76b0d None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:20:53.305088 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-584a93f7-eb27-4fc6-bfc6-3ea698f76b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:20:53.306589 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4dc591-95c7-4473-ba3c-6d72cb2cdf17 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:53.356121 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e2dc71-c5b5-41cb-9149-6bc3b58f4ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:53.357003 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e2dc71-c5b5-41cb-9149-6bc3b58f4ecc None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:53.357362 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e2dc71-c5b5-41cb-9149-6bc3b58f4ecc None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:53.357676 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e2dc71-c5b5-41cb-9149-6bc3b58f4ecc None admin] PATH_INFO: `/v3/projects/3cd4810e72844bb58991b6fc44dacec5` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:53.359440 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e2dc71-c5b5-41cb-9149-6bc3b58f4ecc None admin] RBAC: Authorizing `identity:get_project(project_id=3cd4810e72844bb58991b6fc44dacec5)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:53.361476 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e2dc71-c5b5-41cb-9149-6bc3b58f4ecc None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:53.364058 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 200/400] 10.222.0.86 () {56 vars in 1186 bytes} [Tue Jun 7 14:20:53 2022] GET /identity/v3/projects/3cd4810e72844bb58991b6fc44dacec5 => generated 298 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:53.369228 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e2dc71-c5b5-41cb-9149-6bc3b58f4ecc None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:53.402740 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 201/401] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:20:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 07 14:20:53.409047 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584a93f7-eb27-4fc6-bfc6-3ea698f76b0d None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:53.475455 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:53.480287 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e2dc71-c5b5-41cb-9149-6bc3b58f4ecc None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:53.507457 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:53.518793 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc594ae0-c129-4ba3-a410-93d486a3cb5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:53.519612 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc594ae0-c129-4ba3-a410-93d486a3cb5a None admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:53.519951 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc594ae0-c129-4ba3-a410-93d486a3cb5a None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:53.520229 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc594ae0-c129-4ba3-a410-93d486a3cb5a None admin] PATH_INFO: `/v3/projects/6c6e558540ce4a0d85d5c0b4a9d24870/groups/81550b2de84140ec960b9d5833400c69/roles/c17acc2a8bb348f59ba7edd22fcf0c47` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:53.522802 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc594ae0-c129-4ba3-a410-93d486a3cb5a None admin] RBAC: Authorizing `identity:create_grant(project_id=6c6e558540ce4a0d85d5c0b4a9d24870, group_id=81550b2de84140ec960b9d5833400c69, role_id=c17acc2a8bb348f59ba7edd22fcf0c47)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:53.524236 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc594ae0-c129-4ba3-a410-93d486a3cb5a None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:53.543686 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584a93f7-eb27-4fc6-bfc6-3ea698f76b0d None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:53.586055 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae20ee04-a5b9-48cc-8589-969859023c6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:53.587050 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae20ee04-a5b9-48cc-8589-969859023c6c None admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:53.587388 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae20ee04-a5b9-48cc-8589-969859023c6c None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:53.587665 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae20ee04-a5b9-48cc-8589-969859023c6c None admin] PATH_INFO: `/v3/projects/3cd4810e72844bb58991b6fc44dacec5/groups/81550b2de84140ec960b9d5833400c69/roles/a2755a2b621b4e969fd366f0035d672b` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:53.590043 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae20ee04-a5b9-48cc-8589-969859023c6c None admin] RBAC: Authorizing `identity:create_grant(project_id=3cd4810e72844bb58991b6fc44dacec5, group_id=81550b2de84140ec960b9d5833400c69, role_id=a2755a2b621b4e969fd366f0035d672b)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:53.591518 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae20ee04-a5b9-48cc-8589-969859023c6c None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:53.614226 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 201/402] 10.222.0.86 () {58 vars in 1442 bytes} [Tue Jun 7 14:20:53 2022] PUT /identity/v3/projects/6c6e558540ce4a0d85d5c0b4a9d24870/groups/81550b2de84140ec960b9d5833400c69/roles/c17acc2a8bb348f59ba7edd22fcf0c47 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:20:53.615073 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc594ae0-c129-4ba3-a410-93d486a3cb5a None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:53.715982 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 202/403] 10.222.0.86 () {58 vars in 1442 bytes} [Tue Jun 7 14:20:53 2022] PUT /identity/v3/projects/3cd4810e72844bb58991b6fc44dacec5/groups/81550b2de84140ec960b9d5833400c69/roles/a2755a2b621b4e969fd366f0035d672b => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:20:53.749548 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc594ae0-c129-4ba3-a410-93d486a3cb5a None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:53.791827 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d947c87-e3be-4e73-9b7c-ff497097db06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:53.793101 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d947c87-e3be-4e73-9b7c-ff497097db06 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:53.793638 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d947c87-e3be-4e73-9b7c-ff497097db06 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:53.794117 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d947c87-e3be-4e73-9b7c-ff497097db06 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:53.807112 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d947c87-e3be-4e73-9b7c-ff497097db06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:20:53.816159 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-5d947c87-e3be-4e73-9b7c-ff497097db06 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 07 14:20:53.816159 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:20:53.816159 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:20:53.816159 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:20:53.816159 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:20:53.816159 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:20:53.816159 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:20:53.816159 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:20:53.816159 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:20:53.816159 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:20:53.816159 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:20:53.816159 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:20:53.816159 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:20:53.816159 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:20:53.816159 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:20:53.816159 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:20:53.817138 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:20:53.817138 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:20:53.817138 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:20:53.817138 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:20:53.817138 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:20:53.817138 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:20:53.817138 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:20:53.817138 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:20:53.817138 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:20:53.817138 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:20:53.817138 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:20:53.817138 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jun 07 14:20:53.817138 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:20:53.817138 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:20:53.817138 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:20:53.817138 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:20:53.817911 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:20:53.817911 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:20:53.817911 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:20:53.817911 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:20:53.817911 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:20:53.817911 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:20:53.817911 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:20:53.817911 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:20:53.817911 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:20:53.817911 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:20:53.817911 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 07 14:20:53.817911 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:20:53.820951 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 202/404] 10.222.0.86 () {56 vars in 1114 bytes} [Tue Jun 7 14:20:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:20:53.828926 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae20ee04-a5b9-48cc-8589-969859023c6c None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:53.839219 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2c44d8-6c3b-44a6-bade-53bfd06ef11d None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:53.839536 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2c44d8-6c3b-44a6-bade-53bfd06ef11d None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:53.839839 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2c44d8-6c3b-44a6-bade-53bfd06ef11d None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:53.841693 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 203/405] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:20:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:20:53.848275 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff26e3b-2b37-469b-881b-da78c6d83b77 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:53.848568 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff26e3b-2b37-469b-881b-da78c6d83b77 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:53.848864 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff26e3b-2b37-469b-881b-da78c6d83b77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:53.884925 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-5ff26e3b-2b37-469b-881b-da78c6d83b77 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:20:53.886207 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-5ff26e3b-2b37-469b-881b-da78c6d83b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:20:53.961618 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:53.987224 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:53.991001 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae20ee04-a5b9-48cc-8589-969859023c6c None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:53.994545 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 204/406] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:20:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 14:20:54.018933 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff26e3b-2b37-469b-881b-da78c6d83b77 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:54.030552 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae382765-19f6-4bfa-b940-d51f1e5de573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:54.031227 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae382765-19f6-4bfa-b940-d51f1e5de573 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:54.031520 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae382765-19f6-4bfa-b940-d51f1e5de573 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:54.031826 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae382765-19f6-4bfa-b940-d51f1e5de573 None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:54.033171 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae382765-19f6-4bfa-b940-d51f1e5de573 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:20:54.033171 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae382765-19f6-4bfa-b940-d51f1e5de573 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:54.034250 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae382765-19f6-4bfa-b940-d51f1e5de573 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:54.048265 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 203/407] 10.222.0.86 () {56 vars in 1111 bytes} [Tue Jun 7 14:20:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:54.049153 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae382765-19f6-4bfa-b940-d51f1e5de573 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:54.157367 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff26e3b-2b37-469b-881b-da78c6d83b77 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:54.193464 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae382765-19f6-4bfa-b940-d51f1e5de573 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:54.221364 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad43c806-4eaf-4c04-beb2-3e93aacab153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:54.224282 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad43c806-4eaf-4c04-beb2-3e93aacab153 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:54.224573 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad43c806-4eaf-4c04-beb2-3e93aacab153 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:54.224854 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad43c806-4eaf-4c04-beb2-3e93aacab153 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:54.248515 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad43c806-4eaf-4c04-beb2-3e93aacab153 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:20:54.261701 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf883e01-2e6d-42ad-a8e3-f7e74e00fe42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:54.262568 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf883e01-2e6d-42ad-a8e3-f7e74e00fe42 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:54.262854 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf883e01-2e6d-42ad-a8e3-f7e74e00fe42 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:54.263131 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf883e01-2e6d-42ad-a8e3-f7e74e00fe42 None admin] PATH_INFO: `/v3/groups/81550b2de84140ec960b9d5833400c69` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:54.266673 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-ad43c806-4eaf-4c04-beb2-3e93aacab153 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 14:20:54.266673 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:20:54.266673 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:20:54.266673 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:20:54.266673 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:20:54.266673 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:20:54.266673 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:20:54.266673 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:20:54.266673 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:20:54.266673 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:20:54.266673 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:20:54.266673 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:20:54.266673 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:20:54.266673 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:20:54.266673 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:20:54.266673 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:20:54.267527 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:20:54.267527 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:20:54.267527 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:20:54.267527 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:20:54.267527 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:20:54.267527 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:20:54.267527 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:20:54.267527 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:20:54.267527 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:20:54.267527 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:20:54.267527 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:20:54.267527 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jun 07 14:20:54.267527 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:20:54.267527 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:20:54.267527 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:20:54.267527 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:20:54.268342 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:20:54.268342 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:20:54.268342 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:20:54.268342 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:20:54.268342 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:20:54.268342 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:20:54.268342 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:20:54.268342 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:20:54.268342 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:20:54.268342 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:20:54.268342 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 14:20:54.268342 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:20:54.268931 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf883e01-2e6d-42ad-a8e3-f7e74e00fe42 None admin] RBAC: Authorizing `identity:get_group(group_id=81550b2de84140ec960b9d5833400c69)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:54.269484 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf883e01-2e6d-42ad-a8e3-f7e74e00fe42 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:54.275910 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 204/408] 10.222.0.86 () {56 vars in 1180 bytes} [Tue Jun 7 14:20:54 2022] GET /identity/v3/groups/81550b2de84140ec960b9d5833400c69 => generated 226 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:54.276543 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 205/409] 10.222.0.86 () {56 vars in 1096 bytes} [Tue Jun 7 14:20:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 14:20:54.277941 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf883e01-2e6d-42ad-a8e3-f7e74e00fe42 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:54.282024 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad43c806-4eaf-4c04-beb2-3e93aacab153 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:54.340205 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:54.352178 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:54.447735 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf883e01-2e6d-42ad-a8e3-f7e74e00fe42 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:54.484943 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad43c806-4eaf-4c04-beb2-3e93aacab153 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:54.516816 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a360ab01-ffeb-42bd-8bdf-2f1c268214d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:54.517689 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a360ab01-ffeb-42bd-8bdf-2f1c268214d8 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:54.517971 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a360ab01-ffeb-42bd-8bdf-2f1c268214d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:54.518245 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a360ab01-ffeb-42bd-8bdf-2f1c268214d8 None admin] PATH_INFO: `/v3/projects/6c6e558540ce4a0d85d5c0b4a9d24870` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:54.523304 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a360ab01-ffeb-42bd-8bdf-2f1c268214d8 None admin] RBAC: Authorizing `identity:get_project(project_id=6c6e558540ce4a0d85d5c0b4a9d24870)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:54.525473 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a360ab01-ffeb-42bd-8bdf-2f1c268214d8 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:54.527188 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 205/410] 10.222.0.86 () {56 vars in 1186 bytes} [Tue Jun 7 14:20:54 2022] GET /identity/v3/projects/6c6e558540ce4a0d85d5c0b4a9d24870 => generated 302 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:20:54.533348 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a360ab01-ffeb-42bd-8bdf-2f1c268214d8 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:54.559449 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd74e49-b23b-4269-bd7f-a07969216436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:54.560139 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd74e49-b23b-4269-bd7f-a07969216436 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:54.560422 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd74e49-b23b-4269-bd7f-a07969216436 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:54.560695 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd74e49-b23b-4269-bd7f-a07969216436 None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:54.562096 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd74e49-b23b-4269-bd7f-a07969216436 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:20:54.562410 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd74e49-b23b-4269-bd7f-a07969216436 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:54.563807 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd74e49-b23b-4269-bd7f-a07969216436 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:54.574074 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 206/411] 10.222.0.86 () {56 vars in 1099 bytes} [Tue Jun 7 14:20:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:54.580632 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd74e49-b23b-4269-bd7f-a07969216436 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:54.696658 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:54.704058 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd74e49-b23b-4269-bd7f-a07969216436 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:54.734283 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:54.741107 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a360ab01-ffeb-42bd-8bdf-2f1c268214d8 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:54.743046 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef36eab2-2ff6-4633-9339-f22cf5442f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:54.744162 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef36eab2-2ff6-4633-9339-f22cf5442f0e None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:54.744610 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef36eab2-2ff6-4633-9339-f22cf5442f0e None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:54.745072 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef36eab2-2ff6-4633-9339-f22cf5442f0e None admin] PATH_INFO: `/v3/groups/af22d3580ec841c3bdfae761c90418d8` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:54.746434 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef36eab2-2ff6-4633-9339-f22cf5442f0e None admin] RBAC: Authorizing `identity:get_group(group_id=af22d3580ec841c3bdfae761c90418d8)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:54.748073 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef36eab2-2ff6-4633-9339-f22cf5442f0e None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:54.750889 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 207/412] 10.222.0.86 () {56 vars in 1180 bytes} [Tue Jun 7 14:20:54 2022] GET /identity/v3/groups/af22d3580ec841c3bdfae761c90418d8 => generated 229 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:54.757642 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef36eab2-2ff6-4633-9339-f22cf5442f0e None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:54.790927 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e546ea-9409-4cb7-9b63-454f39352959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:54.792191 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e546ea-9409-4cb7-9b63-454f39352959 None admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:54.792687 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e546ea-9409-4cb7-9b63-454f39352959 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:54.793152 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e546ea-9409-4cb7-9b63-454f39352959 None admin] PATH_INFO: `/v3/projects/6c6e558540ce4a0d85d5c0b4a9d24870/groups/81550b2de84140ec960b9d5833400c69/roles/a2755a2b621b4e969fd366f0035d672b` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:54.799025 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e546ea-9409-4cb7-9b63-454f39352959 None admin] RBAC: Authorizing `identity:create_grant(project_id=6c6e558540ce4a0d85d5c0b4a9d24870, group_id=81550b2de84140ec960b9d5833400c69, role_id=a2755a2b621b4e969fd366f0035d672b)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:54.800762 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e546ea-9409-4cb7-9b63-454f39352959 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:54.888192 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 206/413] 10.222.0.86 () {58 vars in 1442 bytes} [Tue Jun 7 14:20:54 2022] PUT /identity/v3/projects/6c6e558540ce4a0d85d5c0b4a9d24870/groups/81550b2de84140ec960b9d5833400c69/roles/a2755a2b621b4e969fd366f0035d672b => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:20:54.892850 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef36eab2-2ff6-4633-9339-f22cf5442f0e None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:54.937344 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb823fe-8c0a-4c2e-a782-a37a615e23e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:54.938561 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb823fe-8c0a-4c2e-a782-a37a615e23e6 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:54.939097 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb823fe-8c0a-4c2e-a782-a37a615e23e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:54.939562 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb823fe-8c0a-4c2e-a782-a37a615e23e6 None admin] PATH_INFO: `/v3/projects/7ce15f4da81a4a5c8d99aabf417988bf` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:54.943714 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb823fe-8c0a-4c2e-a782-a37a615e23e6 None admin] RBAC: Authorizing `identity:get_project(project_id=7ce15f4da81a4a5c8d99aabf417988bf)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:54.945477 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb823fe-8c0a-4c2e-a782-a37a615e23e6 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:54.947914 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 208/414] 10.222.0.86 () {56 vars in 1186 bytes} [Tue Jun 7 14:20:54 2022] GET /identity/v3/projects/7ce15f4da81a4a5c8d99aabf417988bf => generated 344 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:54.954048 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e546ea-9409-4cb7-9b63-454f39352959 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:54.994583 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bd97db-9b57-44db-8e03-6c032014e74a None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:54.995202 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bd97db-9b57-44db-8e03-6c032014e74a None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:54.995668 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bd97db-9b57-44db-8e03-6c032014e74a None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:54.997384 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 209/415] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:20:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 07 14:20:55.009449 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2889c1e-2324-4631-a1fb-f9d7574d7816 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:55.009754 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2889c1e-2324-4631-a1fb-f9d7574d7816 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:55.010018 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2889c1e-2324-4631-a1fb-f9d7574d7816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:55.041356 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-e2889c1e-2324-4631-a1fb-f9d7574d7816 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:20:55.042627 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-e2889c1e-2324-4631-a1fb-f9d7574d7816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:20:55.085850 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:55.104021 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e546ea-9409-4cb7-9b63-454f39352959 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:55.171081 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 210/416] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:20:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 07 14:20:55.173528 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e0e352-2eba-448c-9493-30062a13bb92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:55.174430 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e0e352-2eba-448c-9493-30062a13bb92 None admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:55.174719 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e0e352-2eba-448c-9493-30062a13bb92 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:55.175000 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e0e352-2eba-448c-9493-30062a13bb92 None admin] PATH_INFO: `/v3/projects/7ce15f4da81a4a5c8d99aabf417988bf/groups/af22d3580ec841c3bdfae761c90418d8/roles/e3bf6239f5bf477b965704b086786f11` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:55.177033 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e0e352-2eba-448c-9493-30062a13bb92 None admin] RBAC: Authorizing `identity:create_grant(project_id=7ce15f4da81a4a5c8d99aabf417988bf, group_id=af22d3580ec841c3bdfae761c90418d8, role_id=e3bf6239f5bf477b965704b086786f11)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:55.178545 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e0e352-2eba-448c-9493-30062a13bb92 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:55.198831 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2889c1e-2324-4631-a1fb-f9d7574d7816 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:55.260153 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 207/417] 10.222.0.86 () {58 vars in 1442 bytes} [Tue Jun 7 14:20:54 2022] PUT /identity/v3/projects/7ce15f4da81a4a5c8d99aabf417988bf/groups/af22d3580ec841c3bdfae761c90418d8/roles/e3bf6239f5bf477b965704b086786f11 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:20:55.363015 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2889c1e-2324-4631-a1fb-f9d7574d7816 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:55.399939 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71d3f1c-666d-4676-824e-b2dcae9ccf39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:55.400752 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71d3f1c-666d-4676-824e-b2dcae9ccf39 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:55.401036 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71d3f1c-666d-4676-824e-b2dcae9ccf39 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:55.401315 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71d3f1c-666d-4676-824e-b2dcae9ccf39 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:55.412504 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71d3f1c-666d-4676-824e-b2dcae9ccf39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:20:55.420805 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-b71d3f1c-666d-4676-824e-b2dcae9ccf39 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 07 14:20:55.420805 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:20:55.420805 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:20:55.420805 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:20:55.420805 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:20:55.420805 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:20:55.420805 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:20:55.420805 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:20:55.420805 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:20:55.420805 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:20:55.420805 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:20:55.420805 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:20:55.420805 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:20:55.420805 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:20:55.420805 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:20:55.420805 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:20:55.421721 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:20:55.421721 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:20:55.421721 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:20:55.421721 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:20:55.421721 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:20:55.421721 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:20:55.421721 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:20:55.421721 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:20:55.421721 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:20:55.421721 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:20:55.421721 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:20:55.421721 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jun 07 14:20:55.421721 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:20:55.421721 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:20:55.421721 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:20:55.421721 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:20:55.422500 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:20:55.422500 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:20:55.422500 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:20:55.422500 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:20:55.422500 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:20:55.422500 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:20:55.422500 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:20:55.422500 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:20:55.422500 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:20:55.422500 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:20:55.422500 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 07 14:20:55.422500 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:20:55.422500 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 211/418] 10.222.0.86 () {56 vars in 1099 bytes} [Tue Jun 7 14:20:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 14:20:55.429231 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e0e352-2eba-448c-9493-30062a13bb92 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:55.482301 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:55.565898 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e0e352-2eba-448c-9493-30062a13bb92 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:55.605266 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f14542-0383-4c06-ad66-0486a641c9cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:55.606286 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f14542-0383-4c06-ad66-0486a641c9cb None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:55.606737 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f14542-0383-4c06-ad66-0486a641c9cb None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:55.607176 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f14542-0383-4c06-ad66-0486a641c9cb None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:55.608206 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f14542-0383-4c06-ad66-0486a641c9cb None admin] RBAC: Adding query filter params (name=member) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:20:55.608680 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f14542-0383-4c06-ad66-0486a641c9cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:55.610274 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f14542-0383-4c06-ad66-0486a641c9cb None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:55.619975 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 208/419] 10.222.0.86 () {56 vars in 1101 bytes} [Tue Jun 7 14:20:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:55.626348 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71d3f1c-666d-4676-824e-b2dcae9ccf39 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:55.670881 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:55.768452 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71d3f1c-666d-4676-824e-b2dcae9ccf39 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:55.814555 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48e9b90-89fb-45e3-b562-a830619ee75d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:55.815218 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48e9b90-89fb-45e3-b562-a830619ee75d None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:55.815502 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48e9b90-89fb-45e3-b562-a830619ee75d None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:55.815796 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48e9b90-89fb-45e3-b562-a830619ee75d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:55.913853 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48e9b90-89fb-45e3-b562-a830619ee75d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:55.915385 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48e9b90-89fb-45e3-b562-a830619ee75d None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:55.946769 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:56.058126 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 212/420] 10.222.0.86 () {58 vars in 1282 bytes} [Tue Jun 7 14:20:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 07 14:20:56.063928 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f14542-0383-4c06-ad66-0486a641c9cb None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:56.173611 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:56.190072 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f14542-0383-4c06-ad66-0486a641c9cb None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:56.229226 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6b3e42-e08f-4850-86e6-083cc6a61133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:56.230113 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6b3e42-e08f-4850-86e6-083cc6a61133 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:56.230395 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6b3e42-e08f-4850-86e6-083cc6a61133 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:56.230667 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6b3e42-e08f-4850-86e6-083cc6a61133 None admin] PATH_INFO: `/v3/projects/3cd4810e72844bb58991b6fc44dacec5` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:56.231969 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6b3e42-e08f-4850-86e6-083cc6a61133 None admin] RBAC: Authorizing `identity:get_project(project_id=3cd4810e72844bb58991b6fc44dacec5)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:56.234212 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6b3e42-e08f-4850-86e6-083cc6a61133 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:56.237202 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 209/421] 10.222.0.86 () {56 vars in 1186 bytes} [Tue Jun 7 14:20:56 2022] GET /identity/v3/projects/3cd4810e72844bb58991b6fc44dacec5 => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:56.242263 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48e9b90-89fb-45e3-b562-a830619ee75d None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:56.414619 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48e9b90-89fb-45e3-b562-a830619ee75d None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:56.449612 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:56.466851 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8e6b0b-951d-494c-bccc-a46222a12c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:56.467779 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8e6b0b-951d-494c-bccc-a46222a12c07 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:56.468066 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8e6b0b-951d-494c-bccc-a46222a12c07 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:56.468338 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8e6b0b-951d-494c-bccc-a46222a12c07 None admin] PATH_INFO: `/v3/groups/81550b2de84140ec960b9d5833400c69` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:56.469552 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8e6b0b-951d-494c-bccc-a46222a12c07 None admin] RBAC: Authorizing `identity:get_group(group_id=81550b2de84140ec960b9d5833400c69)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:56.470995 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8e6b0b-951d-494c-bccc-a46222a12c07 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:56.473043 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 213/422] 10.222.0.86 () {56 vars in 1180 bytes} [Tue Jun 7 14:20:56 2022] GET /identity/v3/groups/81550b2de84140ec960b9d5833400c69 => generated 226 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:56.475448 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ea3422-87b5-426f-9582-49b2e9b36df3 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:56.475919 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ea3422-87b5-426f-9582-49b2e9b36df3 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:56.476051 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ea3422-87b5-426f-9582-49b2e9b36df3 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:56.478409 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 210/423] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:20:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:20:56.479456 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8e6b0b-951d-494c-bccc-a46222a12c07 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:56.483447 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48b88cb-397b-4782-9130-07d34ef96d3b None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:56.483744 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48b88cb-397b-4782-9130-07d34ef96d3b None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:56.484053 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48b88cb-397b-4782-9130-07d34ef96d3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:56.524129 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-f48b88cb-397b-4782-9130-07d34ef96d3b None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:20:56.525459 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-f48b88cb-397b-4782-9130-07d34ef96d3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:20:56.608469 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 211/424] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:20:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 07 14:20:56.625329 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48b88cb-397b-4782-9130-07d34ef96d3b None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:56.641262 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8e6b0b-951d-494c-bccc-a46222a12c07 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:56.678914 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426ce24b-33fd-4d36-8e79-551e8bac9247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:56.679498 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426ce24b-33fd-4d36-8e79-551e8bac9247 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:56.679808 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426ce24b-33fd-4d36-8e79-551e8bac9247 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:56.680092 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426ce24b-33fd-4d36-8e79-551e8bac9247 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:56.680928 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426ce24b-33fd-4d36-8e79-551e8bac9247 None admin] RBAC: Adding query filter params (group.id=81550b2de84140ec960b9d5833400c69, role.id=c17acc2a8bb348f59ba7edd22fcf0c47, scope.project.id=3cd4810e72844bb58991b6fc44dacec5) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:20:56.681240 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426ce24b-33fd-4d36-8e79-551e8bac9247 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:56.682678 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426ce24b-33fd-4d36-8e79-551e8bac9247 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:56.689451 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 214/425] 10.222.0.86 () {56 vars in 1376 bytes} [Tue Jun 7 14:20:56 2022] GET /identity/v3/role_assignments?group.id=81550b2de84140ec960b9d5833400c69&scope.project.id=3cd4810e72844bb58991b6fc44dacec5&role.id=c17acc2a8bb348f59ba7edd22fcf0c47 => generated 611 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:20:56.709359 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:56.734284 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48b88cb-397b-4782-9130-07d34ef96d3b None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:56.738756 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea20b9fe-b38f-46d6-8d05-624732fbea20 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:56.739123 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea20b9fe-b38f-46d6-8d05-624732fbea20 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:56.739473 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea20b9fe-b38f-46d6-8d05-624732fbea20 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:56.741259 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 215/426] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:20:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 07 14:20:56.746854 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d149aa-d9a1-4397-8622-1211e816d6f7 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:56.747244 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d149aa-d9a1-4397-8622-1211e816d6f7 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:56.747589 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d149aa-d9a1-4397-8622-1211e816d6f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:56.766212 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-85d149aa-d9a1-4397-8622-1211e816d6f7 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:20:56.767631 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-85d149aa-d9a1-4397-8622-1211e816d6f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:20:56.773362 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba4c9a2-3084-414a-a424-def338f7c2ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:56.774240 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba4c9a2-3084-414a-a424-def338f7c2ff None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:56.774525 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba4c9a2-3084-414a-a424-def338f7c2ff None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:56.774806 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba4c9a2-3084-414a-a424-def338f7c2ff None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:56.789000 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba4c9a2-3084-414a-a424-def338f7c2ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:20:56.799897 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-2ba4c9a2-3084-414a-a424-def338f7c2ff None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 07 14:20:56.799897 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:20:56.799897 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:20:56.799897 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:20:56.799897 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:20:56.799897 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:20:56.799897 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:20:56.799897 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:20:56.799897 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:20:56.799897 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:20:56.799897 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:20:56.799897 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:20:56.799897 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:20:56.799897 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:20:56.799897 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:20:56.799897 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:20:56.800873 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:20:56.800873 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:20:56.800873 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:20:56.800873 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:20:56.800873 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:20:56.800873 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:20:56.800873 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:20:56.800873 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:20:56.800873 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:20:56.800873 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:20:56.800873 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:20:56.800873 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jun 07 14:20:56.800873 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:20:56.800873 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:20:56.800873 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:20:56.800873 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:20:56.802198 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:20:56.802198 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:20:56.802198 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:20:56.802198 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:20:56.802198 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:20:56.802198 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:20:56.802198 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:20:56.802198 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:20:56.802198 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:20:56.802198 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:20:56.802198 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 07 14:20:56.802198 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:20:56.802198 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 212/427] 10.222.0.86 () {56 vars in 1114 bytes} [Tue Jun 7 14:20:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 14:20:56.808456 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba4c9a2-3084-414a-a424-def338f7c2ff None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:56.868074 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:56.900033 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 216/428] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:20:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 07 14:20:56.927410 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d149aa-d9a1-4397-8622-1211e816d6f7 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:56.980411 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba4c9a2-3084-414a-a424-def338f7c2ff None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:57.016479 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c257e2-bbce-4ea1-9611-a8486e1330ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:57.017153 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c257e2-bbce-4ea1-9611-a8486e1330ed None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:57.017438 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c257e2-bbce-4ea1-9611-a8486e1330ed None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:57.017721 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c257e2-bbce-4ea1-9611-a8486e1330ed None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:57.018482 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c257e2-bbce-4ea1-9611-a8486e1330ed None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:20:57.018793 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c257e2-bbce-4ea1-9611-a8486e1330ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:57.020195 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c257e2-bbce-4ea1-9611-a8486e1330ed None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:57.025653 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:57.030517 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 213/429] 10.222.0.86 () {56 vars in 1111 bytes} [Tue Jun 7 14:20:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:20:57.035957 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c257e2-bbce-4ea1-9611-a8486e1330ed None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:57.065543 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d149aa-d9a1-4397-8622-1211e816d6f7 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:57.104092 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f77ef2d-7247-4665-a63f-14a6b502f8e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:57.104902 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f77ef2d-7247-4665-a63f-14a6b502f8e4 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:57.105189 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f77ef2d-7247-4665-a63f-14a6b502f8e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:57.105470 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f77ef2d-7247-4665-a63f-14a6b502f8e4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:57.116669 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f77ef2d-7247-4665-a63f-14a6b502f8e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:20:57.125540 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-1f77ef2d-7247-4665-a63f-14a6b502f8e4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 07 14:20:57.125540 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:20:57.125540 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:20:57.125540 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:20:57.125540 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:20:57.125540 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:20:57.125540 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:20:57.125540 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:20:57.125540 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:20:57.125540 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:20:57.125540 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:20:57.125540 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:20:57.125540 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:20:57.125540 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:20:57.125540 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:20:57.125540 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:20:57.127522 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:20:57.127522 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:20:57.127522 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:20:57.127522 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:20:57.127522 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:20:57.127522 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:20:57.127522 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:20:57.127522 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:20:57.127522 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:20:57.127522 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:20:57.127522 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:20:57.127522 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jun 07 14:20:57.127522 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:20:57.127522 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:20:57.127522 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:20:57.127522 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:20:57.128643 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:20:57.128643 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:20:57.128643 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:20:57.128643 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:20:57.128643 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:20:57.128643 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:20:57.128643 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:20:57.128643 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:20:57.128643 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:20:57.128643 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:20:57.128643 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 07 14:20:57.128643 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:20:57.128643 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 217/430] 10.222.0.86 () {56 vars in 1099 bytes} [Tue Jun 7 14:20:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 14:20:57.133868 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f77ef2d-7247-4665-a63f-14a6b502f8e4 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:57.157154 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c257e2-bbce-4ea1-9611-a8486e1330ed None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:57.194617 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:57.214706 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1244acba-781c-4754-b91e-ac9b684690d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:57.215354 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1244acba-781c-4754-b91e-ac9b684690d2 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:57.215815 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1244acba-781c-4754-b91e-ac9b684690d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:57.216098 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1244acba-781c-4754-b91e-ac9b684690d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:57.271308 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f77ef2d-7247-4665-a63f-14a6b502f8e4 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:57.315036 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:57.318760 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1244acba-781c-4754-b91e-ac9b684690d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:57.320642 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1244acba-781c-4754-b91e-ac9b684690d2 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:57.323129 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e410b0-ac26-4c6f-8575-2621d53a1e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:57.323880 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e410b0-ac26-4c6f-8575-2621d53a1e04 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:57.324167 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e410b0-ac26-4c6f-8575-2621d53a1e04 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:57.324443 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e410b0-ac26-4c6f-8575-2621d53a1e04 None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:57.326285 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e410b0-ac26-4c6f-8575-2621d53a1e04 None admin] RBAC: Adding query filter params (name=member) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:20:57.326683 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e410b0-ac26-4c6f-8575-2621d53a1e04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:57.329915 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e410b0-ac26-4c6f-8575-2621d53a1e04 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:57.339203 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 218/431] 10.222.0.86 () {56 vars in 1101 bytes} [Tue Jun 7 14:20:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:20:57.345992 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e410b0-ac26-4c6f-8575-2621d53a1e04 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:57.454490 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 214/432] 10.222.0.86 () {58 vars in 1282 bytes} [Tue Jun 7 14:20:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 07 14:20:57.460776 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1244acba-781c-4754-b91e-ac9b684690d2 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:57.469379 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e410b0-ac26-4c6f-8575-2621d53a1e04 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:57.503615 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:57.509044 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7c37cc-2611-40bf-b54c-599e4e752a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:57.509905 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7c37cc-2611-40bf-b54c-599e4e752a6b None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:57.510369 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7c37cc-2611-40bf-b54c-599e4e752a6b None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:57.510746 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7c37cc-2611-40bf-b54c-599e4e752a6b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:57.564571 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:57.567973 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1244acba-781c-4754-b91e-ac9b684690d2 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:57.588157 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7c37cc-2611-40bf-b54c-599e4e752a6b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:57.589787 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7c37cc-2611-40bf-b54c-599e4e752a6b None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:57.603482 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c18c23-f9ee-4c08-82f9-662306fab805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:57.604371 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c18c23-f9ee-4c08-82f9-662306fab805 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:57.604654 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c18c23-f9ee-4c08-82f9-662306fab805 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:57.604929 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c18c23-f9ee-4c08-82f9-662306fab805 None admin] PATH_INFO: `/v3/projects/3cd4810e72844bb58991b6fc44dacec5` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:57.606143 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c18c23-f9ee-4c08-82f9-662306fab805 None admin] RBAC: Authorizing `identity:get_project(project_id=3cd4810e72844bb58991b6fc44dacec5)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:57.607583 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c18c23-f9ee-4c08-82f9-662306fab805 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:57.611266 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 215/433] 10.222.0.86 () {56 vars in 1186 bytes} [Tue Jun 7 14:20:57 2022] GET /identity/v3/projects/3cd4810e72844bb58991b6fc44dacec5 => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:57.617647 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c18c23-f9ee-4c08-82f9-662306fab805 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:57.722352 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 219/434] 10.222.0.86 () {58 vars in 1282 bytes} [Tue Jun 7 14:20:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 07 14:20:57.723839 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ab3d51-1d7f-4a0c-b90d-5dd821067ea5 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:57.724144 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ab3d51-1d7f-4a0c-b90d-5dd821067ea5 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:57.724428 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ab3d51-1d7f-4a0c-b90d-5dd821067ea5 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:57.727838 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 220/435] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:20:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:20:57.728898 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ab3d51-1d7f-4a0c-b90d-5dd821067ea5 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:57.744137 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:57.763742 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c18c23-f9ee-4c08-82f9-662306fab805 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:57.803030 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fcf36d-cb1d-422e-aab5-3bb3f72c9151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:57.803933 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fcf36d-cb1d-422e-aab5-3bb3f72c9151 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:57.804216 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fcf36d-cb1d-422e-aab5-3bb3f72c9151 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:57.804490 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fcf36d-cb1d-422e-aab5-3bb3f72c9151 None admin] PATH_INFO: `/v3/groups/81550b2de84140ec960b9d5833400c69` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:57.805748 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fcf36d-cb1d-422e-aab5-3bb3f72c9151 None admin] RBAC: Authorizing `identity:get_group(group_id=81550b2de84140ec960b9d5833400c69)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:57.807250 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fcf36d-cb1d-422e-aab5-3bb3f72c9151 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:57.808951 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 216/436] 10.222.0.86 () {56 vars in 1180 bytes} [Tue Jun 7 14:20:57 2022] GET /identity/v3/groups/81550b2de84140ec960b9d5833400c69 => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:20:57.810161 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053f2ff0-7ed2-4dd6-995b-876d6d4347e7 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:57.810443 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053f2ff0-7ed2-4dd6-995b-876d6d4347e7 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:57.810715 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053f2ff0-7ed2-4dd6-995b-876d6d4347e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:57.832030 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-053f2ff0-7ed2-4dd6-995b-876d6d4347e7 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:20:57.832030 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-053f2ff0-7ed2-4dd6-995b-876d6d4347e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:20:57.852867 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ab3d51-1d7f-4a0c-b90d-5dd821067ea5 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:57.860260 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:57.893379 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0f7382-3973-4806-be86-e90fb8bd5fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:57.894240 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0f7382-3973-4806-be86-e90fb8bd5fb7 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:57.894524 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0f7382-3973-4806-be86-e90fb8bd5fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:57.894861 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0f7382-3973-4806-be86-e90fb8bd5fb7 None admin] PATH_INFO: `/v3/projects/6c6e558540ce4a0d85d5c0b4a9d24870` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:57.896157 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0f7382-3973-4806-be86-e90fb8bd5fb7 None admin] RBAC: Authorizing `identity:get_project(project_id=6c6e558540ce4a0d85d5c0b4a9d24870)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:57.897589 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0f7382-3973-4806-be86-e90fb8bd5fb7 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:57.898638 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 217/437] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:20:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 14:20:57.903912 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 221/438] 10.222.0.86 () {56 vars in 1186 bytes} [Tue Jun 7 14:20:57 2022] GET /identity/v3/projects/6c6e558540ce4a0d85d5c0b4a9d24870 => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:57.904037 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053f2ff0-7ed2-4dd6-995b-876d6d4347e7 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:57.905144 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0f7382-3973-4806-be86-e90fb8bd5fb7 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:57.991288 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:58.007240 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053f2ff0-7ed2-4dd6-995b-876d6d4347e7 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:58.016096 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0f7382-3973-4806-be86-e90fb8bd5fb7 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:58.046800 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850030f2-0744-4c75-a411-cf1c986cc4ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:58.047684 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850030f2-0744-4c75-a411-cf1c986cc4ba None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:58.047988 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850030f2-0744-4c75-a411-cf1c986cc4ba None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:58.048273 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850030f2-0744-4c75-a411-cf1c986cc4ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:58.049096 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850030f2-0744-4c75-a411-cf1c986cc4ba None admin] RBAC: Adding query filter params (group.id=81550b2de84140ec960b9d5833400c69, role.id=a2755a2b621b4e969fd366f0035d672b, scope.project.id=3cd4810e72844bb58991b6fc44dacec5) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:20:58.049405 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850030f2-0744-4c75-a411-cf1c986cc4ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:58.050828 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850030f2-0744-4c75-a411-cf1c986cc4ba None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:58.052545 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfff650-9f50-45ae-bc2b-cf341adfd3fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:58.053408 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfff650-9f50-45ae-bc2b-cf341adfd3fd None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:58.053688 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfff650-9f50-45ae-bc2b-cf341adfd3fd None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:58.053960 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfff650-9f50-45ae-bc2b-cf341adfd3fd None admin] PATH_INFO: `/v3/groups/81550b2de84140ec960b9d5833400c69` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:58.055141 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfff650-9f50-45ae-bc2b-cf341adfd3fd None admin] RBAC: Authorizing `identity:get_group(group_id=81550b2de84140ec960b9d5833400c69)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:58.056580 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfff650-9f50-45ae-bc2b-cf341adfd3fd None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:58.057883 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 218/439] 10.222.0.86 () {56 vars in 1376 bytes} [Tue Jun 7 14:20:57 2022] GET /identity/v3/role_assignments?group.id=81550b2de84140ec960b9d5833400c69&scope.project.id=3cd4810e72844bb58991b6fc44dacec5&role.id=a2755a2b621b4e969fd366f0035d672b => generated 611 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:58.059800 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 222/440] 10.222.0.86 () {56 vars in 1180 bytes} [Tue Jun 7 14:20:57 2022] GET /identity/v3/groups/81550b2de84140ec960b9d5833400c69 => generated 226 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:20:58.063749 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850030f2-0744-4c75-a411-cf1c986cc4ba None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:58.064265 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfff650-9f50-45ae-bc2b-cf341adfd3fd None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:58.102645 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:58.182379 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfff650-9f50-45ae-bc2b-cf341adfd3fd None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:58.184900 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850030f2-0744-4c75-a411-cf1c986cc4ba None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:58.224239 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84165fec-0c9c-4914-a3f1-0d507aa05dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:58.224951 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84165fec-0c9c-4914-a3f1-0d507aa05dbd None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:58.225279 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84165fec-0c9c-4914-a3f1-0d507aa05dbd None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:58.226603 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b959ca-278e-4054-86e5-350b6543ee0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:58.227432 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b959ca-278e-4054-86e5-350b6543ee0d None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:58.227716 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b959ca-278e-4054-86e5-350b6543ee0d None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:58.228023 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b959ca-278e-4054-86e5-350b6543ee0d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:58.228291 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84165fec-0c9c-4914-a3f1-0d507aa05dbd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:58.229335 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84165fec-0c9c-4914-a3f1-0d507aa05dbd None admin] RBAC: Adding query filter params (group.id=81550b2de84140ec960b9d5833400c69, role.id=c17acc2a8bb348f59ba7edd22fcf0c47, scope.project.id=6c6e558540ce4a0d85d5c0b4a9d24870) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:20:58.229658 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84165fec-0c9c-4914-a3f1-0d507aa05dbd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:58.231140 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84165fec-0c9c-4914-a3f1-0d507aa05dbd None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:58.239260 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 223/441] 10.222.0.86 () {56 vars in 1376 bytes} [Tue Jun 7 14:20:58 2022] GET /identity/v3/role_assignments?group.id=81550b2de84140ec960b9d5833400c69&scope.project.id=6c6e558540ce4a0d85d5c0b4a9d24870&role.id=c17acc2a8bb348f59ba7edd22fcf0c47 => generated 611 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:58.240728 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0918be72-1838-4e2e-955c-5fd871ab54f2 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:58.241020 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0918be72-1838-4e2e-955c-5fd871ab54f2 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:58.241304 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0918be72-1838-4e2e-955c-5fd871ab54f2 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:58.246883 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 224/442] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:20:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:20:58.248490 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b959ca-278e-4054-86e5-350b6543ee0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:20:58.249502 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ba2da6-a35c-46d6-9413-249167684082 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:58.249788 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ba2da6-a35c-46d6-9413-249167684082 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:58.250066 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ba2da6-a35c-46d6-9413-249167684082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:58.258959 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-67b959ca-278e-4054-86e5-350b6543ee0d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 07 14:20:58.258959 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:20:58.258959 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:20:58.258959 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:20:58.258959 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:20:58.258959 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:20:58.258959 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:20:58.258959 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:20:58.258959 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:20:58.258959 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:20:58.258959 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:20:58.258959 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:20:58.258959 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:20:58.258959 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:20:58.258959 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:20:58.258959 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:20:58.260016 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:20:58.260016 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:20:58.260016 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:20:58.260016 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:20:58.260016 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:20:58.260016 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:20:58.260016 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:20:58.260016 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:20:58.260016 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:20:58.260016 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:20:58.260016 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:20:58.260016 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jun 07 14:20:58.260016 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:20:58.260016 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:20:58.260016 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:20:58.260016 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:20:58.263737 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:20:58.263737 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:20:58.263737 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:20:58.263737 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:20:58.263737 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:20:58.263737 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:20:58.263737 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:20:58.263737 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:20:58.263737 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:20:58.263737 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:20:58.263737 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 07 14:20:58.263737 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:20:58.263737 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 219/443] 10.222.0.86 () {56 vars in 1114 bytes} [Tue Jun 7 14:20:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:20:58.264477 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:58.268841 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b959ca-278e-4054-86e5-350b6543ee0d None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:58.270335 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-f9ba2da6-a35c-46d6-9413-249167684082 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:20:58.271323 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-f9ba2da6-a35c-46d6-9413-249167684082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:20:58.379537 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 225/444] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:20:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 07 14:20:58.390168 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:58.405142 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b959ca-278e-4054-86e5-350b6543ee0d None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:58.406920 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ba2da6-a35c-46d6-9413-249167684082 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:58.449846 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5a1c98-c5c5-4aba-9be5-34c86e588714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:58.450522 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5a1c98-c5c5-4aba-9be5-34c86e588714 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:58.450809 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5a1c98-c5c5-4aba-9be5-34c86e588714 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:58.451089 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5a1c98-c5c5-4aba-9be5-34c86e588714 None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:58.451915 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5a1c98-c5c5-4aba-9be5-34c86e588714 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:20:58.452231 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5a1c98-c5c5-4aba-9be5-34c86e588714 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:58.453608 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5a1c98-c5c5-4aba-9be5-34c86e588714 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:58.466290 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 220/445] 10.222.0.86 () {56 vars in 1111 bytes} [Tue Jun 7 14:20:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:58.472319 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5a1c98-c5c5-4aba-9be5-34c86e588714 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:58.549179 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ba2da6-a35c-46d6-9413-249167684082 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:58.588659 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096197dd-2ed5-4e1e-848d-5012fd160b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:58.589461 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096197dd-2ed5-4e1e-848d-5012fd160b9a None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:58.589739 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096197dd-2ed5-4e1e-848d-5012fd160b9a None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:58.590006 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096197dd-2ed5-4e1e-848d-5012fd160b9a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:58.591150 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5a1c98-c5c5-4aba-9be5-34c86e588714 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:58.593254 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:58.602269 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096197dd-2ed5-4e1e-848d-5012fd160b9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:20:58.611335 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-096197dd-2ed5-4e1e-848d-5012fd160b9a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 14:20:58.611335 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:20:58.611335 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:20:58.611335 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:20:58.611335 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:20:58.611335 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:20:58.611335 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:20:58.611335 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:20:58.611335 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:20:58.611335 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:20:58.611335 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:20:58.611335 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:20:58.611335 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:20:58.611335 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:20:58.611335 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:20:58.611335 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:20:58.612571 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:20:58.612571 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:20:58.612571 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:20:58.612571 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:20:58.612571 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:20:58.612571 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:20:58.612571 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:20:58.612571 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:20:58.612571 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:20:58.612571 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:20:58.612571 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:20:58.612571 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jun 07 14:20:58.612571 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:20:58.612571 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:20:58.612571 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:20:58.612571 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:20:58.613343 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:20:58.613343 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:20:58.613343 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:20:58.613343 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:20:58.613343 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:20:58.613343 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:20:58.613343 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:20:58.613343 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:20:58.613343 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:20:58.613343 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:20:58.613343 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 14:20:58.613343 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:20:58.613343 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 226/446] 10.222.0.86 () {56 vars in 1096 bytes} [Tue Jun 7 14:20:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:20:58.618738 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096197dd-2ed5-4e1e-848d-5012fd160b9a None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:58.631859 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38864a3-178d-4aec-bd46-acad933d8225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:58.632457 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38864a3-178d-4aec-bd46-acad933d8225 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:58.632741 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38864a3-178d-4aec-bd46-acad933d8225 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:58.633334 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38864a3-178d-4aec-bd46-acad933d8225 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:58.661614 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:58.712494 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38864a3-178d-4aec-bd46-acad933d8225 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:58.713942 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38864a3-178d-4aec-bd46-acad933d8225 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:58.730988 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096197dd-2ed5-4e1e-848d-5012fd160b9a None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:58.764835 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffc3cee-481d-48f8-b724-5c20f7903bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:58.765509 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffc3cee-481d-48f8-b724-5c20f7903bd7 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:58.765794 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffc3cee-481d-48f8-b724-5c20f7903bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:58.766074 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffc3cee-481d-48f8-b724-5c20f7903bd7 None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:58.766816 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffc3cee-481d-48f8-b724-5c20f7903bd7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:20:58.767123 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffc3cee-481d-48f8-b724-5c20f7903bd7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:58.768536 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffc3cee-481d-48f8-b724-5c20f7903bd7 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:58.776398 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 227/447] 10.222.0.86 () {56 vars in 1099 bytes} [Tue Jun 7 14:20:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:20:58.782473 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffc3cee-481d-48f8-b724-5c20f7903bd7 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:58.809978 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 221/448] 10.222.0.86 () {58 vars in 1282 bytes} [Tue Jun 7 14:20:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 07 14:20:58.815217 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38864a3-178d-4aec-bd46-acad933d8225 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:58.843293 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:58.866306 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:58.882730 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffc3cee-481d-48f8-b724-5c20f7903bd7 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:58.910931 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38864a3-178d-4aec-bd46-acad933d8225 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:58.917091 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388ece7f-d350-4723-8907-dda335464f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:58.917779 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388ece7f-d350-4723-8907-dda335464f9c None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:58.918070 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388ece7f-d350-4723-8907-dda335464f9c None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:58.918350 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388ece7f-d350-4723-8907-dda335464f9c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:58.944175 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e393ea02-e6ca-41c8-8b32-1f708a44ae7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:58.945028 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e393ea02-e6ca-41c8-8b32-1f708a44ae7c None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:58.945310 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e393ea02-e6ca-41c8-8b32-1f708a44ae7c None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:58.945585 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e393ea02-e6ca-41c8-8b32-1f708a44ae7c None admin] PATH_INFO: `/v3/projects/6c6e558540ce4a0d85d5c0b4a9d24870` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:58.946811 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e393ea02-e6ca-41c8-8b32-1f708a44ae7c None admin] RBAC: Authorizing `identity:get_project(project_id=6c6e558540ce4a0d85d5c0b4a9d24870)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:58.948281 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e393ea02-e6ca-41c8-8b32-1f708a44ae7c None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:58.949967 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 222/449] 10.222.0.86 () {56 vars in 1186 bytes} [Tue Jun 7 14:20:58 2022] GET /identity/v3/projects/6c6e558540ce4a0d85d5c0b4a9d24870 => generated 302 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:20:58.955732 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e393ea02-e6ca-41c8-8b32-1f708a44ae7c None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:58.984535 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388ece7f-d350-4723-8907-dda335464f9c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:58.985992 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388ece7f-d350-4723-8907-dda335464f9c None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:59.040966 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:59.052351 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e393ea02-e6ca-41c8-8b32-1f708a44ae7c None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:59.072467 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:59.081089 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 228/450] 10.222.0.86 () {58 vars in 1282 bytes} [Tue Jun 7 14:20:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 07 14:20:59.086494 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6380ec01-3d00-44d5-96e3-4d66c8667d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:59.086665 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388ece7f-d350-4723-8907-dda335464f9c None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:59.087341 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6380ec01-3d00-44d5-96e3-4d66c8667d81 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:59.087628 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6380ec01-3d00-44d5-96e3-4d66c8667d81 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:59.087950 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6380ec01-3d00-44d5-96e3-4d66c8667d81 None admin] PATH_INFO: `/v3/groups/81550b2de84140ec960b9d5833400c69` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:59.089301 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6380ec01-3d00-44d5-96e3-4d66c8667d81 None admin] RBAC: Authorizing `identity:get_group(group_id=81550b2de84140ec960b9d5833400c69)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:59.090748 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6380ec01-3d00-44d5-96e3-4d66c8667d81 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:59.092394 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 223/451] 10.222.0.86 () {56 vars in 1180 bytes} [Tue Jun 7 14:20:58 2022] GET /identity/v3/groups/81550b2de84140ec960b9d5833400c69 => generated 226 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:20:59.097769 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6380ec01-3d00-44d5-96e3-4d66c8667d81 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:59.182308 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388ece7f-d350-4723-8907-dda335464f9c None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:59.195602 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6380ec01-3d00-44d5-96e3-4d66c8667d81 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:59.216398 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805958ec-e607-4512-b16c-449b2ffb0676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:59.217269 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805958ec-e607-4512-b16c-449b2ffb0676 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:59.217543 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805958ec-e607-4512-b16c-449b2ffb0676 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:59.217823 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805958ec-e607-4512-b16c-449b2ffb0676 None admin] PATH_INFO: `/v3/projects/7ce15f4da81a4a5c8d99aabf417988bf` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:59.219014 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805958ec-e607-4512-b16c-449b2ffb0676 None admin] RBAC: Authorizing `identity:get_project(project_id=7ce15f4da81a4a5c8d99aabf417988bf)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:59.220514 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805958ec-e607-4512-b16c-449b2ffb0676 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:59.222382 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 229/452] 10.222.0.86 () {56 vars in 1186 bytes} [Tue Jun 7 14:20:59 2022] GET /identity/v3/projects/7ce15f4da81a4a5c8d99aabf417988bf => generated 344 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:20:59.228384 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbc62be-7b37-40e0-8e66-ae2943a617a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:59.228850 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805958ec-e607-4512-b16c-449b2ffb0676 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:59.229042 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbc62be-7b37-40e0-8e66-ae2943a617a6 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:59.229330 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbc62be-7b37-40e0-8e66-ae2943a617a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:59.229658 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbc62be-7b37-40e0-8e66-ae2943a617a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:59.230442 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbc62be-7b37-40e0-8e66-ae2943a617a6 None admin] RBAC: Adding query filter params (group.id=81550b2de84140ec960b9d5833400c69, role.id=a2755a2b621b4e969fd366f0035d672b, scope.project.id=6c6e558540ce4a0d85d5c0b4a9d24870) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:20:59.230757 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbc62be-7b37-40e0-8e66-ae2943a617a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:59.232206 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbc62be-7b37-40e0-8e66-ae2943a617a6 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:59.238590 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 224/453] 10.222.0.86 () {56 vars in 1376 bytes} [Tue Jun 7 14:20:59 2022] GET /identity/v3/role_assignments?group.id=81550b2de84140ec960b9d5833400c69&scope.project.id=6c6e558540ce4a0d85d5c0b4a9d24870&role.id=a2755a2b621b4e969fd366f0035d672b => generated 611 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:59.258838 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:59.335839 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805958ec-e607-4512-b16c-449b2ffb0676 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:59.371786 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f8074c-9b50-4d63-833d-41470c79df00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:59.372647 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f8074c-9b50-4d63-833d-41470c79df00 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:59.372927 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f8074c-9b50-4d63-833d-41470c79df00 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:59.373200 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f8074c-9b50-4d63-833d-41470c79df00 None admin] PATH_INFO: `/v3/groups/af22d3580ec841c3bdfae761c90418d8` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:59.374486 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f8074c-9b50-4d63-833d-41470c79df00 None admin] RBAC: Authorizing `identity:get_group(group_id=af22d3580ec841c3bdfae761c90418d8)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:59.376028 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f8074c-9b50-4d63-833d-41470c79df00 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:59.377699 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 230/454] 10.222.0.86 () {56 vars in 1180 bytes} [Tue Jun 7 14:20:59 2022] GET /identity/v3/groups/af22d3580ec841c3bdfae761c90418d8 => generated 229 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:20:59.383841 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbc62be-7b37-40e0-8e66-ae2943a617a6 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:59.438715 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:59.485653 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbc62be-7b37-40e0-8e66-ae2943a617a6 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:59.519996 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7372df7-5ee4-414b-b274-54ec5e252e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:59.520660 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7372df7-5ee4-414b-b274-54ec5e252e0c None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:59.520950 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7372df7-5ee4-414b-b274-54ec5e252e0c None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:59.521234 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7372df7-5ee4-414b-b274-54ec5e252e0c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:59.522076 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7372df7-5ee4-414b-b274-54ec5e252e0c None admin] RBAC: Adding query filter params (group.id=af22d3580ec841c3bdfae761c90418d8, role.id=e3bf6239f5bf477b965704b086786f11, scope.project.id=7ce15f4da81a4a5c8d99aabf417988bf) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:20:59.522399 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7372df7-5ee4-414b-b274-54ec5e252e0c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:59.523867 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7372df7-5ee4-414b-b274-54ec5e252e0c None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:59.530241 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 225/455] 10.222.0.86 () {56 vars in 1376 bytes} [Tue Jun 7 14:20:59 2022] GET /identity/v3/role_assignments?group.id=af22d3580ec841c3bdfae761c90418d8&scope.project.id=7ce15f4da81a4a5c8d99aabf417988bf&role.id=e3bf6239f5bf477b965704b086786f11 => generated 611 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:02.130421 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35724deb-fa6d-49a5-860f-c976295e460e None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:02.130938 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35724deb-fa6d-49a5-860f-c976295e460e None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:02.131047 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35724deb-fa6d-49a5-860f-c976295e460e None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:02.132594 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 231/456] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:21:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:21:02.138019 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8777e6-543f-4077-bff6-49f383eba447 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:02.139384 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8777e6-543f-4077-bff6-49f383eba447 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:02.139900 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8777e6-543f-4077-bff6-49f383eba447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:02.164785 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-6d8777e6-543f-4077-bff6-49f383eba447 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:21:02.167928 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-6d8777e6-543f-4077-bff6-49f383eba447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:21:02.261611 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 226/457] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:21:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 14:21:02.313332 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35724deb-fa6d-49a5-860f-c976295e460e None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:02.413656 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b56025-6467-46f2-80be-5183ea6ed51a None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:02.413848 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b56025-6467-46f2-80be-5183ea6ed51a None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:02.414122 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b56025-6467-46f2-80be-5183ea6ed51a None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:02.416089 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 227/458] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:21:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:21:02.422218 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d63138-7add-4002-b543-91dbb622404f None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:02.422862 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d63138-7add-4002-b543-91dbb622404f None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:02.423150 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d63138-7add-4002-b543-91dbb622404f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:02.456762 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-03d63138-7add-4002-b543-91dbb622404f None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:21:02.460081 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:02.461239 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-03d63138-7add-4002-b543-91dbb622404f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:21:02.474695 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35724deb-fa6d-49a5-860f-c976295e460e None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:02.537334 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302bdb1b-9aa4-4632-a3f0-02d80c5a990b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:02.538470 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302bdb1b-9aa4-4632-a3f0-02d80c5a990b None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:02.538749 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302bdb1b-9aa4-4632-a3f0-02d80c5a990b None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:02.539021 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302bdb1b-9aa4-4632-a3f0-02d80c5a990b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:02.541674 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:02.561628 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302bdb1b-9aa4-4632-a3f0-02d80c5a990b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:02.564373 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302bdb1b-9aa4-4632-a3f0-02d80c5a990b None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:02.586573 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 228/459] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:21:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 14:21:02.598356 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-302bdb1b-9aa4-4632-a3f0-02d80c5a990b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:21:02.598356 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:02.598356 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:02.598356 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:02.598356 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:02.598356 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:02.598356 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:02.598356 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:02.598356 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:02.598356 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:02.598356 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:02.598356 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:02.598356 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:21:02.598356 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:21:02.598356 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:21:02.599194 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:21:02.599194 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:02.599194 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:02.599194 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:02.599194 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:02.599194 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:02.599194 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:02.599194 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:02.599194 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:02.599194 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:02.599194 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:02.599194 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:02.599194 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:02.599194 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:02.599194 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:02.599194 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:02.599194 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:02.600074 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:21:02.600074 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:21:02.600074 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:21:02.600074 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:21:02.601962 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 232/460] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jun 7 14:21:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:21:02.608769 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d63138-7add-4002-b543-91dbb622404f None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:02.648753 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302bdb1b-9aa4-4632-a3f0-02d80c5a990b None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:02.758295 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d63138-7add-4002-b543-91dbb622404f None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:02.767059 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302bdb1b-9aa4-4632-a3f0-02d80c5a990b None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:02.795544 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65974ee-6ba5-4f47-8bb6-86d39e2a6351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:02.796527 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65974ee-6ba5-4f47-8bb6-86d39e2a6351 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:02.797023 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65974ee-6ba5-4f47-8bb6-86d39e2a6351 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:02.797391 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65974ee-6ba5-4f47-8bb6-86d39e2a6351 None admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:02.798311 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65974ee-6ba5-4f47-8bb6-86d39e2a6351 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:02.798845 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65974ee-6ba5-4f47-8bb6-86d39e2a6351 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:02.800344 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65974ee-6ba5-4f47-8bb6-86d39e2a6351 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:02.802487 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f158de2f-8968-4548-a7a4-038af79bc3be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:02.803277 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f158de2f-8968-4548-a7a4-038af79bc3be None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:02.803560 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f158de2f-8968-4548-a7a4-038af79bc3be None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:02.803857 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f158de2f-8968-4548-a7a4-038af79bc3be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:02.814284 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f158de2f-8968-4548-a7a4-038af79bc3be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:02.815731 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f158de2f-8968-4548-a7a4-038af79bc3be None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:02.820469 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 229/461] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jun 7 14:21:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:02.821628 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fab123-cde6-4bec-8541-f0bc69551a75 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:02.821919 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fab123-cde6-4bec-8541-f0bc69551a75 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:02.822198 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fab123-cde6-4bec-8541-f0bc69551a75 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:02.827558 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:02.827922 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 230/462] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:21:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:21:02.827922 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a246ba-5096-4c98-bee8-b1136b34a260 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:02.827922 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a246ba-5096-4c98-bee8-b1136b34a260 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:02.827922 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a246ba-5096-4c98-bee8-b1136b34a260 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:02.827922 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 231/463] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:21:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:21:02.829178 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a246ba-5096-4c98-bee8-b1136b34a260 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:02.839982 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-f158de2f-8968-4548-a7a4-038af79bc3be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:21:02.839982 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:02.839982 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:02.839982 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:02.839982 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:02.839982 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:02.839982 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:02.839982 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:02.839982 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:02.839982 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:02.839982 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:02.839982 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:02.839982 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:21:02.839982 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:21:02.839982 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:21:02.840900 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:21:02.840900 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:02.840900 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:02.840900 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:02.840900 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:02.840900 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:02.840900 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:02.840900 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:02.840900 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:02.840900 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:02.840900 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:02.840900 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:02.840900 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:02.840900 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:02.840900 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:02.840900 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:02.840900 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:02.841797 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:21:02.841797 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:21:02.841797 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:21:02.841797 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:21:02.841797 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 233/464] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jun 7 14:21:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:21:02.842640 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4311d6-d2ab-4ba6-a770-0efb26b12ae9 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:02.842736 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4311d6-d2ab-4ba6-a770-0efb26b12ae9 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:02.842990 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4311d6-d2ab-4ba6-a770-0efb26b12ae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:02.860893 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-5e4311d6-d2ab-4ba6-a770-0efb26b12ae9 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:21:02.862185 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-5e4311d6-d2ab-4ba6-a770-0efb26b12ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:21:02.871329 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:02.938118 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 234/465] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:21:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 14:21:02.939530 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e73782a-ba77-4db5-a198-a57fa6329b62 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:02.939919 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e73782a-ba77-4db5-a198-a57fa6329b62 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:02.940204 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e73782a-ba77-4db5-a198-a57fa6329b62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:02.952431 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a246ba-5096-4c98-bee8-b1136b34a260 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:02.966012 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-8e73782a-ba77-4db5-a198-a57fa6329b62 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:21:02.967305 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-8e73782a-ba77-4db5-a198-a57fa6329b62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:21:02.988197 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b96f4f-54f1-4405-9a96-bf3ea2876d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:02.988954 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b96f4f-54f1-4405-9a96-bf3ea2876d37 None admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:02.989242 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b96f4f-54f1-4405-9a96-bf3ea2876d37 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:02.989522 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b96f4f-54f1-4405-9a96-bf3ea2876d37 None admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:02.990230 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b96f4f-54f1-4405-9a96-bf3ea2876d37 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:02.991670 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b96f4f-54f1-4405-9a96-bf3ea2876d37 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:03.034867 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 235/466] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:21:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 14:21:03.035704 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e73782a-ba77-4db5-a198-a57fa6329b62 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:03.091507 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:03.105194 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 232/467] 10.222.0.86 () {60 vars in 1132 bytes} [Tue Jun 7 14:21:02 2022] POST /identity/v3/users => generated 246 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:21:03.106354 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b96f4f-54f1-4405-9a96-bf3ea2876d37 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:03.157799 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e73782a-ba77-4db5-a198-a57fa6329b62 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:03.199226 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaa8492-8a02-46f8-832a-09d447faae0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:03.200321 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaa8492-8a02-46f8-832a-09d447faae0c None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:03.200808 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaa8492-8a02-46f8-832a-09d447faae0c None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:03.201353 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaa8492-8a02-46f8-832a-09d447faae0c None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:03.202329 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaa8492-8a02-46f8-832a-09d447faae0c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:03.202855 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaa8492-8a02-46f8-832a-09d447faae0c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:03.204582 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaa8492-8a02-46f8-832a-09d447faae0c None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:03.218418 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 236/468] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jun 7 14:21:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:03.219935 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaa8492-8a02-46f8-832a-09d447faae0c None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:03.248352 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:03.261838 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b96f4f-54f1-4405-9a96-bf3ea2876d37 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:03.306896 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aabd34c-46cb-4c63-915a-e4c3ab7ff7a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:03.308503 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aabd34c-46cb-4c63-915a-e4c3ab7ff7a1 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:03.308809 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aabd34c-46cb-4c63-915a-e4c3ab7ff7a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:03.309675 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aabd34c-46cb-4c63-915a-e4c3ab7ff7a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:03.324949 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aabd34c-46cb-4c63-915a-e4c3ab7ff7a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:03.326499 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aabd34c-46cb-4c63-915a-e4c3ab7ff7a1 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:03.346438 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-5aabd34c-46cb-4c63-915a-e4c3ab7ff7a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:21:03.346438 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:03.346438 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:03.346438 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:03.346438 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:03.346438 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:03.346438 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:03.346438 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:03.346438 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:03.346438 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:03.346438 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:03.346438 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:03.346438 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:21:03.346438 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:21:03.346438 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:21:03.347321 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:21:03.347321 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:03.347321 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:03.347321 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:03.347321 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:03.347321 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:03.347321 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:03.347321 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:03.347321 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:03.347321 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:03.347321 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:03.347321 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:03.347321 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:03.347321 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:03.347321 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:03.347321 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:03.347321 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:03.348397 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:21:03.348397 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:21:03.348397 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:21:03.348397 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:21:03.348397 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 233/469] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jun 7 14:21:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:21:03.349180 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aabd34c-46cb-4c63-915a-e4c3ab7ff7a1 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:03.352230 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaa8492-8a02-46f8-832a-09d447faae0c None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:03.373804 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:03.393027 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668820b5-147d-4bcc-86cd-f1131d9f7bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:03.394692 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668820b5-147d-4bcc-86cd-f1131d9f7bff None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:03.395184 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668820b5-147d-4bcc-86cd-f1131d9f7bff None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:03.395662 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668820b5-147d-4bcc-86cd-f1131d9f7bff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:03.412889 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668820b5-147d-4bcc-86cd-f1131d9f7bff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:03.414348 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668820b5-147d-4bcc-86cd-f1131d9f7bff None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:03.438944 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-668820b5-147d-4bcc-86cd-f1131d9f7bff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:21:03.438944 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:03.438944 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:03.438944 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:03.438944 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:03.438944 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:03.438944 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:03.438944 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:03.438944 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:03.438944 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:03.438944 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:03.438944 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:03.438944 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:21:03.438944 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:21:03.438944 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:21:03.439875 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:21:03.439875 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:03.439875 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:03.439875 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:03.439875 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:03.439875 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:03.439875 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:03.439875 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:03.439875 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:03.439875 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:03.439875 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:03.439875 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:03.439875 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:03.439875 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:03.439875 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:03.439875 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:03.439875 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:03.440744 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:21:03.440744 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:21:03.440744 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:21:03.440744 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:21:03.440744 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 237/470] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jun 7 14:21:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:21:03.441362 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668820b5-147d-4bcc-86cd-f1131d9f7bff None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:03.468755 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aabd34c-46cb-4c63-915a-e4c3ab7ff7a1 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:03.504430 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fbf7f9-77ad-4a66-96f9-81b73689b312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:03.505399 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fbf7f9-77ad-4a66-96f9-81b73689b312 None admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:03.505895 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fbf7f9-77ad-4a66-96f9-81b73689b312 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:03.506349 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fbf7f9-77ad-4a66-96f9-81b73689b312 None admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:03.507341 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fbf7f9-77ad-4a66-96f9-81b73689b312 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:03.509093 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fbf7f9-77ad-4a66-96f9-81b73689b312 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:03.565550 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668820b5-147d-4bcc-86cd-f1131d9f7bff None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:03.599859 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec409b88-900f-4816-b091-e6280bfb2360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:03.600528 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec409b88-900f-4816-b091-e6280bfb2360 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:03.600810 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec409b88-900f-4816-b091-e6280bfb2360 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:03.601803 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec409b88-900f-4816-b091-e6280bfb2360 None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:03.601803 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec409b88-900f-4816-b091-e6280bfb2360 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:03.602104 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec409b88-900f-4816-b091-e6280bfb2360 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:03.603439 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec409b88-900f-4816-b091-e6280bfb2360 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:03.620643 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 238/471] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jun 7 14:21:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:03.620643 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec409b88-900f-4816-b091-e6280bfb2360 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:03.626855 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:03.633835 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 234/472] 10.222.0.86 () {60 vars in 1132 bytes} [Tue Jun 7 14:21:03 2022] POST /identity/v3/users => generated 248 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:21:03.641492 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fbf7f9-77ad-4a66-96f9-81b73689b312 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:03.676819 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:03.763548 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fbf7f9-77ad-4a66-96f9-81b73689b312 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:03.802770 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc88083a-6d18-4837-9e99-07a303df4804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:03.803855 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc88083a-6d18-4837-9e99-07a303df4804 None admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:03.804343 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc88083a-6d18-4837-9e99-07a303df4804 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:03.804888 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc88083a-6d18-4837-9e99-07a303df4804 None admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:03.805803 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc88083a-6d18-4837-9e99-07a303df4804 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:03.807489 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc88083a-6d18-4837-9e99-07a303df4804 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:03.813799 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec409b88-900f-4816-b091-e6280bfb2360 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:03.855589 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f6c877-9129-4666-a27e-be083f234848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:03.856688 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f6c877-9129-4666-a27e-be083f234848 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:03.857290 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f6c877-9129-4666-a27e-be083f234848 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:03.858307 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f6c877-9129-4666-a27e-be083f234848 None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:03.859296 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f6c877-9129-4666-a27e-be083f234848 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:03.859870 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f6c877-9129-4666-a27e-be083f234848 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:03.861470 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f6c877-9129-4666-a27e-be083f234848 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:03.874780 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 239/473] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jun 7 14:21:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:03.880849 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f6c877-9129-4666-a27e-be083f234848 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:03.986351 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:03.996252 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f6c877-9129-4666-a27e-be083f234848 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:04.008642 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 235/474] 10.222.0.86 () {60 vars in 1132 bytes} [Tue Jun 7 14:21:03 2022] POST /identity/v3/users => generated 248 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:21:04.010119 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de44ac0-5519-4b89-81e1-9b9dd84d82d5 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:04.010410 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de44ac0-5519-4b89-81e1-9b9dd84d82d5 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:04.010688 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de44ac0-5519-4b89-81e1-9b9dd84d82d5 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:04.012299 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 236/475] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:21:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:21:04.019273 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf581390-90fc-4265-9eb8-959432a7100f None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:04.019569 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf581390-90fc-4265-9eb8-959432a7100f None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:04.019904 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf581390-90fc-4265-9eb8-959432a7100f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:04.039718 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e034feb9-1db8-4635-9b04-46705c808c28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:04.047937 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e034feb9-1db8-4635-9b04-46705c808c28 None admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:04.047937 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e034feb9-1db8-4635-9b04-46705c808c28 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:04.047937 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e034feb9-1db8-4635-9b04-46705c808c28 None admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:04.048190 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-bf581390-90fc-4265-9eb8-959432a7100f None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:21:04.048263 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e034feb9-1db8-4635-9b04-46705c808c28 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:04.048345 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-bf581390-90fc-4265-9eb8-959432a7100f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:21:04.048415 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e034feb9-1db8-4635-9b04-46705c808c28 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:04.106684 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:04.127965 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 240/476] 10.222.0.86 () {60 vars in 1132 bytes} [Tue Jun 7 14:21:03 2022] POST /identity/v3/users => generated 249 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:21:04.131581 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 237/477] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:21:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 07 14:21:04.159042 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e034feb9-1db8-4635-9b04-46705c808c28 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:04.408249 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e034feb9-1db8-4635-9b04-46705c808c28 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:04.443852 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e773f251-4b42-4460-8c20-c667f73c7c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:04.444532 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e773f251-4b42-4460-8c20-c667f73c7c8c None admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:04.444821 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e773f251-4b42-4460-8c20-c667f73c7c8c None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:04.445093 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e773f251-4b42-4460-8c20-c667f73c7c8c None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:04.445849 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e773f251-4b42-4460-8c20-c667f73c7c8c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:04.447245 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e773f251-4b42-4460-8c20-c667f73c7c8c None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:04.499114 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.sql.core [None req-e773f251-4b42-4460-8c20-c667f73c7c8c None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 07 14:21:04.499114 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 07 14:21:04.499114 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [parameters: {'id': '31d8b99904fe40cc880014c146b99b6c', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 07 14:21:04.499114 dv-cinder-844974-1-smb devstack@keystone.service[80419]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80419) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 07 14:21:04.516574 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-e773f251-4b42-4460-8c20-c667f73c7c8c None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 07 14:21:04.516574 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:04.516574 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 07 14:21:04.516574 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 07 14:21:04.516574 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 07 14:21:04.516574 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 07 14:21:04.516574 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 07 14:21:04.516574 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application result = self._query(query) Jun 07 14:21:04.516574 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 07 14:21:04.516574 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application conn.query(q) Jun 07 14:21:04.516574 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 07 14:21:04.516574 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 07 14:21:04.516574 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 07 14:21:04.516574 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application result.read() Jun 07 14:21:04.516574 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 07 14:21:04.517516 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 07 14:21:04.517516 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 07 14:21:04.517516 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 07 14:21:04.517516 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 07 14:21:04.517516 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 07 14:21:04.517516 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 07 14:21:04.517516 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 07 14:21:04.517516 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 07 14:21:04.517516 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:21:04.517516 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 07 14:21:04.517516 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:21:04.517516 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:04.517516 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 07 14:21:04.517516 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 07 14:21:04.517516 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jun 07 14:21:04.517516 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return ref.to_dict() Jun 07 14:21:04.517516 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 07 14:21:04.517516 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application next(self.gen) Jun 07 14:21:04.518412 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 07 14:21:04.518412 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application yield resource Jun 07 14:21:04.518412 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 07 14:21:04.518412 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application next(self.gen) Jun 07 14:21:04.518412 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 07 14:21:04.518412 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self.session.rollback() Jun 07 14:21:04.518412 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 07 14:21:04.518412 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self.force_reraise() Jun 07 14:21:04.518412 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 07 14:21:04.518412 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise self.value Jun 07 14:21:04.518412 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 07 14:21:04.518412 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 07 14:21:04.518412 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 07 14:21:04.518412 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application session.commit() Jun 07 14:21:04.518412 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 07 14:21:04.518412 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 07 14:21:04.518412 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 07 14:21:04.519250 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self._prepare_impl() Jun 07 14:21:04.519250 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 07 14:21:04.519250 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self.session.flush() Jun 07 14:21:04.519250 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 07 14:21:04.519250 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self._flush(objects) Jun 07 14:21:04.519250 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 07 14:21:04.519250 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 07 14:21:04.519250 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 07 14:21:04.519250 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application compat.raise_( Jun 07 14:21:04.519250 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 07 14:21:04.519250 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception Jun 07 14:21:04.519250 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 07 14:21:04.519250 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application flush_context.execute() Jun 07 14:21:04.519250 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 07 14:21:04.519250 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rec.execute(self) Jun 07 14:21:04.519250 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 07 14:21:04.519250 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 07 14:21:04.521327 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 07 14:21:04.521327 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 07 14:21:04.521327 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 07 14:21:04.521327 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 07 14:21:04.521327 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 07 14:21:04.521327 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 07 14:21:04.521327 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 07 14:21:04.521327 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 07 14:21:04.521327 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 07 14:21:04.521327 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 07 14:21:04.521327 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 07 14:21:04.521327 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 07 14:21:04.521327 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 07 14:21:04.521327 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 07 14:21:04.521327 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 07 14:21:04.521327 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception Jun 07 14:21:04.523787 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 07 14:21:04.523787 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 07 14:21:04.523787 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 07 14:21:04.523787 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 07 14:21:04.523787 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 07 14:21:04.523787 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application result = self._query(query) Jun 07 14:21:04.523787 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 07 14:21:04.523787 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application conn.query(q) Jun 07 14:21:04.523787 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 07 14:21:04.523787 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 07 14:21:04.523787 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 07 14:21:04.523787 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application result.read() Jun 07 14:21:04.523787 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 07 14:21:04.523787 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 07 14:21:04.523787 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 07 14:21:04.523787 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 07 14:21:04.525766 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 07 14:21:04.525766 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 07 14:21:04.525766 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 07 14:21:04.525766 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 07 14:21:04.525766 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 07 14:21:04.525766 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 07 14:21:04.525766 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [parameters: {'id': '31d8b99904fe40cc880014c146b99b6c', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 07 14:21:04.525766 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 07 14:21:04.525766 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:21:04.525766 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 07 14:21:04.525766 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:21:04.525766 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:04.525766 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:04.525766 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:04.525766 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:04.525766 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:04.532193 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:04.532193 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:04.532193 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:04.532193 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:04.532193 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:04.532193 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:04.532193 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jun 07 14:21:04.532193 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jun 07 14:21:04.532193 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:04.532193 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:04.532193 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jun 07 14:21:04.532193 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jun 07 14:21:04.532193 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 07 14:21:04.532193 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 07 14:21:04.532193 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 07 14:21:04.532193 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:21:04.534372 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 241/478] 10.222.0.86 () {60 vars in 1131 bytes} [Tue Jun 7 14:21:04 2022] POST /identity/v3/roles => generated 144 bytes in 365 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:21:04.534510 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf581390-90fc-4265-9eb8-959432a7100f None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:04.651273 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf581390-90fc-4265-9eb8-959432a7100f None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:04.688193 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50fcee3-a3ed-4e14-b275-fb1457e59e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:04.688977 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50fcee3-a3ed-4e14-b275-fb1457e59e5f None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:04.689265 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50fcee3-a3ed-4e14-b275-fb1457e59e5f None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:04.689548 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50fcee3-a3ed-4e14-b275-fb1457e59e5f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:04.700425 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50fcee3-a3ed-4e14-b275-fb1457e59e5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:21:04.709434 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-c50fcee3-a3ed-4e14-b275-fb1457e59e5f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 07 14:21:04.709434 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:04.709434 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:04.709434 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:04.709434 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:04.709434 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:04.709434 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:04.709434 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:04.709434 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:04.709434 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:04.709434 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:04.709434 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:04.709434 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:21:04.709434 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:21:04.709434 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:21:04.709434 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:21:04.711465 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:21:04.711465 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:21:04.711465 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:21:04.711465 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:21:04.711465 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:04.711465 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:04.711465 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:04.711465 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:04.711465 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:04.711465 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:04.711465 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:04.711465 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:04.711465 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:04.711465 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:04.711465 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:04.711465 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:04.713448 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:04.713448 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:04.713448 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:04.713448 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:04.713448 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:21:04.713448 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:21:04.713448 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:21:04.713448 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:21:04.713448 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:21:04.713448 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:21:04.713448 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 07 14:21:04.713448 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:21:04.713448 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 238/479] 10.222.0.86 () {56 vars in 1114 bytes} [Tue Jun 7 14:21:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:21:04.721000 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e773f251-4b42-4460-8c20-c667f73c7c8c None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:04.740472 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:04.835655 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e773f251-4b42-4460-8c20-c667f73c7c8c None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:04.871587 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cb163a-8794-4d0a-b2ab-a71bd9516d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:04.872298 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cb163a-8794-4d0a-b2ab-a71bd9516d53 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:04.872588 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cb163a-8794-4d0a-b2ab-a71bd9516d53 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:04.872870 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cb163a-8794-4d0a-b2ab-a71bd9516d53 None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:04.873665 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cb163a-8794-4d0a-b2ab-a71bd9516d53 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:04.873978 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cb163a-8794-4d0a-b2ab-a71bd9516d53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:04.875362 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cb163a-8794-4d0a-b2ab-a71bd9516d53 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:04.884247 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 242/480] 10.222.0.86 () {56 vars in 1111 bytes} [Tue Jun 7 14:21:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:05.909631 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0659a2-0465-42d9-8eee-abb8866dde72 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:05.910329 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0659a2-0465-42d9-8eee-abb8866dde72 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:05.910329 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0659a2-0465-42d9-8eee-abb8866dde72 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:05.911802 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 239/481] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:21:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:21:05.917547 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c484e5aa-9e56-4f35-b614-ba82507acfc9 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:05.918036 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c484e5aa-9e56-4f35-b614-ba82507acfc9 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:05.918192 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c484e5aa-9e56-4f35-b614-ba82507acfc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:05.935537 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-c484e5aa-9e56-4f35-b614-ba82507acfc9 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:21:05.937275 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-c484e5aa-9e56-4f35-b614-ba82507acfc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:21:06.021373 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 243/482] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:21:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 14:21:06.062043 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0659a2-0465-42d9-8eee-abb8866dde72 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:06.236636 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:06.313023 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0659a2-0465-42d9-8eee-abb8866dde72 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:06.348116 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe4b2d1-5d03-435d-85b7-48552c830021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:06.348917 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe4b2d1-5d03-435d-85b7-48552c830021 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:06.349205 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe4b2d1-5d03-435d-85b7-48552c830021 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:06.349479 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe4b2d1-5d03-435d-85b7-48552c830021 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:06.360494 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe4b2d1-5d03-435d-85b7-48552c830021 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:21:06.372694 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-2fe4b2d1-5d03-435d-85b7-48552c830021 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 07 14:21:06.372694 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:06.372694 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:06.372694 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:06.372694 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:06.372694 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:06.372694 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:06.372694 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:06.372694 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:06.372694 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:06.372694 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:06.372694 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:06.372694 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:21:06.372694 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:21:06.372694 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:21:06.372694 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:21:06.374958 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:21:06.374958 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:21:06.374958 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:21:06.374958 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:21:06.374958 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:06.374958 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:06.374958 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:06.374958 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:06.374958 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:06.374958 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:06.374958 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:06.374958 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:06.374958 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:06.374958 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:06.374958 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:06.374958 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:06.376949 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:06.376949 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:06.376949 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:06.376949 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:06.376949 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:21:06.376949 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:21:06.376949 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:21:06.376949 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:21:06.376949 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:21:06.376949 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:21:06.376949 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 07 14:21:06.376949 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:21:06.376949 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 240/483] 10.222.0.86 () {56 vars in 1102 bytes} [Tue Jun 7 14:21:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:21:06.383780 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c484e5aa-9e56-4f35-b614-ba82507acfc9 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:06.384078 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:06.506161 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c484e5aa-9e56-4f35-b614-ba82507acfc9 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:06.551740 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334c9626-9238-4f02-81cb-961ff8f204fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:06.552451 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334c9626-9238-4f02-81cb-961ff8f204fe None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:06.552739 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334c9626-9238-4f02-81cb-961ff8f204fe None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:06.553017 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334c9626-9238-4f02-81cb-961ff8f204fe None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:06.553772 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334c9626-9238-4f02-81cb-961ff8f204fe None admin] RBAC: Adding query filter params (name=service) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:06.554079 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334c9626-9238-4f02-81cb-961ff8f204fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:06.555450 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334c9626-9238-4f02-81cb-961ff8f204fe None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:06.572312 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dee455-e7dc-4e73-8b4c-21112fd34d10 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:06.572612 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dee455-e7dc-4e73-8b4c-21112fd34d10 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:06.572869 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dee455-e7dc-4e73-8b4c-21112fd34d10 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:06.574226 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 241/484] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:21:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:21:06.574487 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 244/485] 10.222.0.86 () {56 vars in 1103 bytes} [Tue Jun 7 14:21:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:06.578517 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dee455-e7dc-4e73-8b4c-21112fd34d10 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:06.585086 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c2a625-21e8-4b30-a907-f74b771a516b None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:06.585086 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c2a625-21e8-4b30-a907-f74b771a516b None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:06.585086 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c2a625-21e8-4b30-a907-f74b771a516b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:06.610883 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-96c2a625-21e8-4b30-a907-f74b771a516b None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:21:06.613743 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-96c2a625-21e8-4b30-a907-f74b771a516b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:21:06.709532 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:06.717736 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 245/486] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:21:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 07 14:21:06.766902 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dee455-e7dc-4e73-8b4c-21112fd34d10 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:06.778398 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:06.779788 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c2a625-21e8-4b30-a907-f74b771a516b None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:06.845865 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c9b4b9-de3f-438f-8827-f6cb27056b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:06.846672 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c9b4b9-de3f-438f-8827-f6cb27056b41 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:06.846959 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c9b4b9-de3f-438f-8827-f6cb27056b41 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:06.847235 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c9b4b9-de3f-438f-8827-f6cb27056b41 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:06.877038 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c9b4b9-de3f-438f-8827-f6cb27056b41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:06.878552 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c9b4b9-de3f-438f-8827-f6cb27056b41 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:06.899178 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c2a625-21e8-4b30-a907-f74b771a516b None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:06.911578 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-d1c9b4b9-de3f-438f-8827-f6cb27056b41 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:21:06.911578 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:06.911578 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:06.911578 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:06.911578 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:06.911578 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:06.911578 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:06.911578 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:06.911578 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:06.911578 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:06.911578 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:06.911578 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:06.911578 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:21:06.911578 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:21:06.911578 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:21:06.912823 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:21:06.912823 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:06.912823 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:06.912823 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:06.912823 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:06.912823 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:06.912823 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:06.912823 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:06.912823 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:06.912823 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:06.912823 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:06.912823 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:06.912823 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:06.912823 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:06.912823 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:06.912823 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:06.912823 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:06.913657 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:21:06.913657 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:21:06.913657 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:21:06.913657 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:21:06.921276 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 242/487] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jun 7 14:21:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:21:06.932737 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c9b4b9-de3f-438f-8827-f6cb27056b41 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:06.941620 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12decb69-25e6-448c-9e59-4c681e8da3c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:06.942425 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12decb69-25e6-448c-9e59-4c681e8da3c2 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:06.942715 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12decb69-25e6-448c-9e59-4c681e8da3c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:06.942994 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12decb69-25e6-448c-9e59-4c681e8da3c2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:06.954034 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12decb69-25e6-448c-9e59-4c681e8da3c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:21:06.962223 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-12decb69-25e6-448c-9e59-4c681e8da3c2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 07 14:21:06.962223 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:06.962223 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:06.962223 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:06.962223 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:06.962223 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:06.962223 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:06.962223 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:06.962223 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:06.962223 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:06.962223 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:06.962223 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:06.962223 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:21:06.962223 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:21:06.962223 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:21:06.962223 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:21:06.963162 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:21:06.963162 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:21:06.963162 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:21:06.963162 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:21:06.963162 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:06.963162 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:06.963162 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:06.963162 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:06.963162 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:06.963162 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:06.963162 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:06.963162 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:06.963162 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:06.963162 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:06.963162 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:06.963162 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:06.964906 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:06.964906 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:06.964906 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:06.964906 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:06.964906 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:21:06.964906 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:21:06.964906 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:21:06.964906 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:21:06.964906 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:21:06.964906 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:21:06.964906 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 07 14:21:06.964906 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:21:06.964906 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 246/488] 10.222.0.86 () {56 vars in 1102 bytes} [Tue Jun 7 14:21:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:21:06.977182 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12decb69-25e6-448c-9e59-4c681e8da3c2 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:07.068406 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:07.096803 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12decb69-25e6-448c-9e59-4c681e8da3c2 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:07.116477 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c9b4b9-de3f-438f-8827-f6cb27056b41 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:07.158277 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1661c33b-9179-4836-8f66-497859550ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:07.158951 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1661c33b-9179-4836-8f66-497859550ddb None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:07.159241 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1661c33b-9179-4836-8f66-497859550ddb None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:07.159517 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1661c33b-9179-4836-8f66-497859550ddb None admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:07.160285 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1661c33b-9179-4836-8f66-497859550ddb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:07.160596 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1661c33b-9179-4836-8f66-497859550ddb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:07.162046 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1661c33b-9179-4836-8f66-497859550ddb None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:07.165588 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61de55f-ee32-4255-b5cc-d9bcb697ae89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:07.166271 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61de55f-ee32-4255-b5cc-d9bcb697ae89 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:07.166558 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61de55f-ee32-4255-b5cc-d9bcb697ae89 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:07.166840 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61de55f-ee32-4255-b5cc-d9bcb697ae89 None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:07.167597 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61de55f-ee32-4255-b5cc-d9bcb697ae89 None admin] RBAC: Adding query filter params (name=service) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:07.167942 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61de55f-ee32-4255-b5cc-d9bcb697ae89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:07.169312 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61de55f-ee32-4255-b5cc-d9bcb697ae89 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:07.177009 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 243/489] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jun 7 14:21:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:07.178327 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546cd6b7-4ac7-4493-a33e-62f06370f0eb None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:07.178704 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 247/490] 10.222.0.86 () {56 vars in 1103 bytes} [Tue Jun 7 14:21:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:21:07.178825 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546cd6b7-4ac7-4493-a33e-62f06370f0eb None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:07.178901 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546cd6b7-4ac7-4493-a33e-62f06370f0eb None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:07.184480 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61de55f-ee32-4255-b5cc-d9bcb697ae89 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:07.185139 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 244/491] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:21:07 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:21:07.187189 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546cd6b7-4ac7-4493-a33e-62f06370f0eb None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:07.209652 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:07.297451 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61de55f-ee32-4255-b5cc-d9bcb697ae89 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:07.303196 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546cd6b7-4ac7-4493-a33e-62f06370f0eb None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:07.320296 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:07.340397 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab61cd4-b82b-4d4d-aedd-8a0edd9b3596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:07.341171 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16a77dd-3cb7-47c6-9d3b-3508be01057d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:07.341302 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab61cd4-b82b-4d4d-aedd-8a0edd9b3596 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:07.341464 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab61cd4-b82b-4d4d-aedd-8a0edd9b3596 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:07.341788 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab61cd4-b82b-4d4d-aedd-8a0edd9b3596 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:07.342566 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16a77dd-3cb7-47c6-9d3b-3508be01057d None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:07.342997 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16a77dd-3cb7-47c6-9d3b-3508be01057d None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:07.343419 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16a77dd-3cb7-47c6-9d3b-3508be01057d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:07.349352 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab61cd4-b82b-4d4d-aedd-8a0edd9b3596 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:07.350772 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab61cd4-b82b-4d4d-aedd-8a0edd9b3596 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:07.356855 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16a77dd-3cb7-47c6-9d3b-3508be01057d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:07.359287 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16a77dd-3cb7-47c6-9d3b-3508be01057d None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:07.367100 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-1ab61cd4-b82b-4d4d-aedd-8a0edd9b3596 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 07 14:21:07.367100 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:07.367100 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:07.367100 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:07.367100 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:07.367100 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:07.367100 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:07.367100 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:07.367100 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:07.367100 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:07.367100 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:07.367100 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:07.367100 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 14:21:07.367100 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 14:21:07.367100 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 14:21:07.367100 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 14:21:07.368160 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:07.368160 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:07.368160 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 14:21:07.368160 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:21:07.368160 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 14:21:07.368160 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:21:07.368160 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:07.368160 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:07.368160 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:07.368160 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:07.368160 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:07.368160 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:07.368160 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:07.368160 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:07.368160 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:07.368160 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:07.368160 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:07.368160 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:07.369045 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:07.369045 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:07.369045 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 14:21:07.369045 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 14:21:07.369045 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 14:21:07.369045 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 14:21:07.369045 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 14:21:07.369045 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 14:21:07.369045 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 07 14:21:07.369045 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:21:07.373627 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 245/492] 10.222.0.86 () {56 vars in 1093 bytes} [Tue Jun 7 14:21:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:21:07.374731 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d71c90b-6096-4fd1-ac3f-078cd82c668b None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:07.375026 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d71c90b-6096-4fd1-ac3f-078cd82c668b None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:07.375310 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d71c90b-6096-4fd1-ac3f-078cd82c668b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:07.378277 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-e16a77dd-3cb7-47c6-9d3b-3508be01057d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:21:07.378277 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:07.378277 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:07.378277 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:07.378277 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:07.378277 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:07.378277 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:07.378277 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:07.378277 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:07.378277 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:07.378277 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:07.378277 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:07.378277 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:21:07.378277 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:21:07.378277 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:21:07.379065 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:21:07.379065 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:07.379065 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:07.379065 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:07.379065 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:07.379065 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:07.379065 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:07.379065 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:07.379065 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:07.379065 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:07.379065 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:07.379065 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:07.379065 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:07.379065 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:07.379065 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:07.379065 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:07.379065 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:07.379906 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:21:07.379906 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:21:07.379906 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:21:07.379906 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:21:07.379906 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 248/493] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jun 7 14:21:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:21:07.380702 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce71b198-6f00-4afe-a8f8-2936161892bb None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:07.380983 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce71b198-6f00-4afe-a8f8-2936161892bb None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:07.381258 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce71b198-6f00-4afe-a8f8-2936161892bb None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:07.382641 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 249/494] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:21:07 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:21:07.383192 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce71b198-6f00-4afe-a8f8-2936161892bb None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:07.400674 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-8d71c90b-6096-4fd1-ac3f-078cd82c668b None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:21:07.402006 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-8d71c90b-6096-4fd1-ac3f-078cd82c668b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:21:07.476802 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 246/495] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:21:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 14:21:07.478182 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d71c90b-6096-4fd1-ac3f-078cd82c668b None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:07.497370 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:07.501039 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce71b198-6f00-4afe-a8f8-2936161892bb None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:07.537381 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014c07b1-e0f4-44f9-9162-441ff99a3507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:07.538055 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014c07b1-e0f4-44f9-9162-441ff99a3507 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:07.538341 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014c07b1-e0f4-44f9-9162-441ff99a3507 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:07.538616 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014c07b1-e0f4-44f9-9162-441ff99a3507 None admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:07.539460 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014c07b1-e0f4-44f9-9162-441ff99a3507 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:07.539786 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014c07b1-e0f4-44f9-9162-441ff99a3507 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:07.541541 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014c07b1-e0f4-44f9-9162-441ff99a3507 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:07.579506 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 250/496] 10.222.0.86 () {56 vars in 1133 bytes} [Tue Jun 7 14:21:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:07.585050 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f0e9b2-3a89-4b1c-a490-3edfc0fdb6ee None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:07.585348 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f0e9b2-3a89-4b1c-a490-3edfc0fdb6ee None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:07.585631 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f0e9b2-3a89-4b1c-a490-3edfc0fdb6ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:07.595839 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d71c90b-6096-4fd1-ac3f-078cd82c668b None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:07.604417 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-50f0e9b2-3a89-4b1c-a490-3edfc0fdb6ee None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:21:07.605829 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-50f0e9b2-3a89-4b1c-a490-3edfc0fdb6ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:21:07.627738 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:07.631662 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eb8e47-54d5-44ec-8e8e-d7ccb94367c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:07.632362 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb8e47-54d5-44ec-8e8e-d7ccb94367c1 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:07.632646 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb8e47-54d5-44ec-8e8e-d7ccb94367c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:07.632927 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb8e47-54d5-44ec-8e8e-d7ccb94367c1 None admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:07.633653 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eb8e47-54d5-44ec-8e8e-d7ccb94367c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:07.633960 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eb8e47-54d5-44ec-8e8e-d7ccb94367c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:07.635315 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eb8e47-54d5-44ec-8e8e-d7ccb94367c1 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:07.646912 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 247/497] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jun 7 14:21:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:07.647709 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eb8e47-54d5-44ec-8e8e-d7ccb94367c1 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:07.676154 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 251/498] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:21:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 14:21:07.676996 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f0e9b2-3a89-4b1c-a490-3edfc0fdb6ee None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:07.723916 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:07.756823 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eb8e47-54d5-44ec-8e8e-d7ccb94367c1 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:07.774885 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f0e9b2-3a89-4b1c-a490-3edfc0fdb6ee None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:07.791478 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b595b181-7b23-4294-a23f-dbc147c0dfcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:07.792313 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b595b181-7b23-4294-a23f-dbc147c0dfcb None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:07.792590 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b595b181-7b23-4294-a23f-dbc147c0dfcb None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:07.792864 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b595b181-7b23-4294-a23f-dbc147c0dfcb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:07.802690 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b595b181-7b23-4294-a23f-dbc147c0dfcb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:21:07.808085 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a7f2fc-5b48-4aae-985a-cf1f5a9eea9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:07.808722 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a7f2fc-5b48-4aae-985a-cf1f5a9eea9b None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:07.809003 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a7f2fc-5b48-4aae-985a-cf1f5a9eea9b None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:07.809272 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a7f2fc-5b48-4aae-985a-cf1f5a9eea9b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:07.810851 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-b595b181-7b23-4294-a23f-dbc147c0dfcb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 07 14:21:07.810851 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:07.810851 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:07.810851 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:07.810851 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:07.810851 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:07.810851 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:07.810851 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:07.810851 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:07.810851 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:07.810851 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:07.810851 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:07.810851 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:21:07.810851 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:21:07.810851 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:21:07.810851 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:21:07.811742 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:21:07.811742 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:21:07.811742 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:21:07.811742 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:21:07.811742 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:07.811742 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:07.811742 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:07.811742 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:07.811742 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:07.811742 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:07.811742 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:07.811742 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:07.811742 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:07.811742 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:07.811742 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:07.811742 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:07.812615 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:07.812615 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:07.812615 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:07.812615 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:07.812615 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:21:07.812615 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:21:07.812615 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:21:07.812615 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:21:07.812615 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:21:07.812615 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:21:07.812615 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 07 14:21:07.812615 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:21:07.812615 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 248/499] 10.222.0.86 () {56 vars in 1102 bytes} [Tue Jun 7 14:21:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:21:07.813312 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86b1fa3-b231-4ea4-a5ef-37e1bc6a7700 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:07.813535 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86b1fa3-b231-4ea4-a5ef-37e1bc6a7700 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:07.813759 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86b1fa3-b231-4ea4-a5ef-37e1bc6a7700 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:07.815120 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 249/500] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:21:07 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:21:07.815662 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86b1fa3-b231-4ea4-a5ef-37e1bc6a7700 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:07.840187 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:07.884804 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a7f2fc-5b48-4aae-985a-cf1f5a9eea9b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:07.886275 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a7f2fc-5b48-4aae-985a-cf1f5a9eea9b None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:07.917253 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86b1fa3-b231-4ea4-a5ef-37e1bc6a7700 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:07.943674 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:07.952002 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2cae18-c51e-47ab-8231-a798838df02e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:07.952796 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2cae18-c51e-47ab-8231-a798838df02e None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:07.953348 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2cae18-c51e-47ab-8231-a798838df02e None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:07.953348 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2cae18-c51e-47ab-8231-a798838df02e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:07.960654 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2cae18-c51e-47ab-8231-a798838df02e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:07.962083 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2cae18-c51e-47ab-8231-a798838df02e None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:07.975989 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-8e2cae18-c51e-47ab-8231-a798838df02e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 07 14:21:07.975989 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:07.975989 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:07.975989 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:07.975989 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:07.975989 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:07.975989 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:07.975989 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:07.975989 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:07.975989 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:07.975989 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:07.975989 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:07.975989 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 14:21:07.975989 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 14:21:07.975989 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 14:21:07.975989 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 14:21:07.976900 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:07.976900 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:07.976900 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 14:21:07.976900 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:21:07.976900 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 14:21:07.976900 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:21:07.976900 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:07.976900 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:07.976900 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:07.976900 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:07.976900 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:07.976900 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:07.976900 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:07.976900 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:07.976900 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:07.976900 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:07.976900 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:07.976900 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:07.977770 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:07.977770 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:07.977770 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 14:21:07.977770 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 14:21:07.977770 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 14:21:07.977770 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 14:21:07.977770 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 14:21:07.977770 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 14:21:07.977770 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 07 14:21:07.977770 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:21:07.978938 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 250/501] 10.222.0.86 () {56 vars in 1099 bytes} [Tue Jun 7 14:21:07 2022] GET /identity/v3/users/cinder => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:21:07.980073 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2cae18-c51e-47ab-8231-a798838df02e None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:07.986515 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 252/502] 10.222.0.86 () {58 vars in 1282 bytes} [Tue Jun 7 14:21:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 07 14:21:07.987351 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a7f2fc-5b48-4aae-985a-cf1f5a9eea9b None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:08.042040 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:08.080169 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2cae18-c51e-47ab-8231-a798838df02e None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:08.086853 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a7f2fc-5b48-4aae-985a-cf1f5a9eea9b None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:08.114519 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5324f4e-bfb3-447c-b2d1-8e496d19f3cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:08.115241 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5324f4e-bfb3-447c-b2d1-8e496d19f3cb None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:08.115532 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5324f4e-bfb3-447c-b2d1-8e496d19f3cb None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:08.115834 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5324f4e-bfb3-447c-b2d1-8e496d19f3cb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:08.119012 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57de7224-fcc4-4144-87a4-1182ed1cff67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:08.119673 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57de7224-fcc4-4144-87a4-1182ed1cff67 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:08.119984 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57de7224-fcc4-4144-87a4-1182ed1cff67 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:08.120269 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57de7224-fcc4-4144-87a4-1182ed1cff67 None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:08.121050 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57de7224-fcc4-4144-87a4-1182ed1cff67 None admin] RBAC: Adding query filter params (name=service) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:08.121415 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57de7224-fcc4-4144-87a4-1182ed1cff67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:08.123473 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57de7224-fcc4-4144-87a4-1182ed1cff67 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:08.126516 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5324f4e-bfb3-447c-b2d1-8e496d19f3cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:21:08.131176 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 253/503] 10.222.0.86 () {56 vars in 1103 bytes} [Tue Jun 7 14:21:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:08.132364 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d005405-ba23-4c83-8ddd-4ca69b046468 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:08.132652 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d005405-ba23-4c83-8ddd-4ca69b046468 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:08.132936 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d005405-ba23-4c83-8ddd-4ca69b046468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:08.134317 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-a5324f4e-bfb3-447c-b2d1-8e496d19f3cb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 07 14:21:08.134317 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:08.134317 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:08.134317 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:08.134317 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:08.134317 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:08.134317 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:08.134317 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:08.134317 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:08.134317 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:08.134317 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:08.134317 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:08.134317 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:21:08.134317 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:21:08.134317 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:21:08.134317 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:21:08.135250 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:21:08.135250 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:21:08.135250 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:21:08.135250 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:21:08.135250 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:08.135250 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:08.135250 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:08.135250 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:08.135250 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:08.135250 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:08.135250 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:08.135250 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:08.135250 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:08.135250 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:08.135250 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:08.135250 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:08.136909 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:08.136909 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:08.136909 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:08.136909 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:08.136909 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:21:08.136909 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:21:08.136909 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:21:08.136909 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:21:08.136909 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:21:08.136909 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:21:08.136909 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 07 14:21:08.136909 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:21:08.136909 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 251/504] 10.222.0.86 () {56 vars in 1102 bytes} [Tue Jun 7 14:21:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:21:08.136909 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5324f4e-bfb3-447c-b2d1-8e496d19f3cb None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:08.150422 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-2d005405-ba23-4c83-8ddd-4ca69b046468 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:21:08.151590 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-2d005405-ba23-4c83-8ddd-4ca69b046468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:21:08.187373 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:08.219260 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 254/505] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:21:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 14:21:08.220129 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d005405-ba23-4c83-8ddd-4ca69b046468 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:08.246919 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5324f4e-bfb3-447c-b2d1-8e496d19f3cb None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:08.268753 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:08.280776 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d420912-b67d-4345-ab7b-426a408850b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:08.281448 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d420912-b67d-4345-ab7b-426a408850b4 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:08.281736 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d420912-b67d-4345-ab7b-426a408850b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:08.282024 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d420912-b67d-4345-ab7b-426a408850b4 None admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:08.282866 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d420912-b67d-4345-ab7b-426a408850b4 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:08.283182 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d420912-b67d-4345-ab7b-426a408850b4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:08.284648 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d420912-b67d-4345-ab7b-426a408850b4 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:08.319217 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d005405-ba23-4c83-8ddd-4ca69b046468 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:08.320821 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 252/506] 10.222.0.86 () {56 vars in 1137 bytes} [Tue Jun 7 14:21:08 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:08.321646 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d420912-b67d-4345-ab7b-426a408850b4 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:08.356425 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d24cb0c-4d3d-4fbb-829b-04cd77d06d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:08.357274 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d24cb0c-4d3d-4fbb-829b-04cd77d06d30 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:08.358043 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d24cb0c-4d3d-4fbb-829b-04cd77d06d30 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:08.358322 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d24cb0c-4d3d-4fbb-829b-04cd77d06d30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:08.369802 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d24cb0c-4d3d-4fbb-829b-04cd77d06d30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:08.371179 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d24cb0c-4d3d-4fbb-829b-04cd77d06d30 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:08.387908 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-0d24cb0c-4d3d-4fbb-829b-04cd77d06d30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:21:08.387908 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:08.387908 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:08.387908 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:08.387908 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:08.387908 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:08.387908 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:08.387908 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:08.387908 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:08.387908 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:08.387908 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:08.387908 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:08.387908 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:21:08.387908 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:21:08.387908 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:21:08.388855 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:21:08.388855 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:08.388855 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:08.388855 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:08.388855 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:08.388855 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:08.388855 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:08.388855 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:08.388855 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:08.388855 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:08.388855 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:08.388855 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:08.388855 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:08.388855 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:08.388855 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:08.388855 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:08.388855 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:08.389746 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:21:08.389746 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:21:08.389746 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:21:08.389746 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:21:08.389746 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 255/507] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jun 7 14:21:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:21:08.390027 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d24cb0c-4d3d-4fbb-829b-04cd77d06d30 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:08.424535 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d420912-b67d-4345-ab7b-426a408850b4 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:08.431248 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:08.457558 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bc64af-a162-451d-963b-2a43d465e207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:08.458349 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bc64af-a162-451d-963b-2a43d465e207 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:08.458635 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bc64af-a162-451d-963b-2a43d465e207 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:08.458916 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bc64af-a162-451d-963b-2a43d465e207 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:08.469557 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bc64af-a162-451d-963b-2a43d465e207 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:08.471002 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bc64af-a162-451d-963b-2a43d465e207 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:08.485261 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:08.488016 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-13bc64af-a162-451d-963b-2a43d465e207 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:21:08.488016 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:08.488016 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:08.488016 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:08.488016 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:08.488016 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:08.488016 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:08.488016 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:08.488016 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:08.488016 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:08.488016 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:08.488016 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:08.488016 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:21:08.488016 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:21:08.488016 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:21:08.488883 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:21:08.488883 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:08.488883 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:08.488883 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:08.488883 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:08.488883 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:08.488883 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:08.488883 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:08.488883 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:08.488883 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:08.488883 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:08.488883 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:08.488883 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:08.488883 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:08.488883 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:08.488883 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:08.488883 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:08.489714 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:21:08.489714 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:21:08.489714 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:21:08.489714 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:21:08.489920 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d24cb0c-4d3d-4fbb-829b-04cd77d06d30 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:08.490048 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 253/508] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jun 7 14:21:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:21:08.490048 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bc64af-a162-451d-963b-2a43d465e207 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:08.522792 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86153656-b383-4721-8d94-bdd5eda441de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:08.523457 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86153656-b383-4721-8d94-bdd5eda441de None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:08.523740 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86153656-b383-4721-8d94-bdd5eda441de None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:08.524050 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86153656-b383-4721-8d94-bdd5eda441de None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:08.524800 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86153656-b383-4721-8d94-bdd5eda441de None admin] RBAC: Adding query filter params (name=service) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:08.525113 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86153656-b383-4721-8d94-bdd5eda441de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:08.526504 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86153656-b383-4721-8d94-bdd5eda441de None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:08.534932 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 256/509] 10.222.0.86 () {56 vars in 1103 bytes} [Tue Jun 7 14:21:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:08.535717 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86153656-b383-4721-8d94-bdd5eda441de None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:08.588822 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bc64af-a162-451d-963b-2a43d465e207 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:08.622027 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8366a294-0424-46f2-9b76-c1dba31160cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:08.622738 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8366a294-0424-46f2-9b76-c1dba31160cc None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:08.623687 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8366a294-0424-46f2-9b76-c1dba31160cc None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:08.623998 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8366a294-0424-46f2-9b76-c1dba31160cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:08.634681 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8366a294-0424-46f2-9b76-c1dba31160cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:08.635406 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86153656-b383-4721-8d94-bdd5eda441de None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:08.636177 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8366a294-0424-46f2-9b76-c1dba31160cc None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:08.653001 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-8366a294-0424-46f2-9b76-c1dba31160cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:21:08.653001 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:08.653001 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:08.653001 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:08.653001 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:08.653001 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:08.653001 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:08.653001 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:08.653001 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:08.653001 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:08.653001 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:08.653001 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:08.653001 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:21:08.653001 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:21:08.653001 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:21:08.654018 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:21:08.654018 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:08.654018 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:08.654018 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:08.654018 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:08.654018 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:08.654018 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:08.654018 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:08.654018 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:08.654018 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:08.654018 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:08.654018 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:08.654018 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:08.654018 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:08.654018 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:08.654018 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:08.654018 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:08.654907 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:21:08.654907 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:21:08.654907 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:21:08.654907 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:21:08.654907 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 254/510] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jun 7 14:21:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:21:08.655511 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8366a294-0424-46f2-9b76-c1dba31160cc None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:08.668594 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:08.674269 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640d4ded-37fc-499c-b414-5f51470d9575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:08.674911 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640d4ded-37fc-499c-b414-5f51470d9575 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:08.675208 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640d4ded-37fc-499c-b414-5f51470d9575 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:08.675465 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640d4ded-37fc-499c-b414-5f51470d9575 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:08.704234 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:08.740633 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640d4ded-37fc-499c-b414-5f51470d9575 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:08.742090 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640d4ded-37fc-499c-b414-5f51470d9575 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:08.756225 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8366a294-0424-46f2-9b76-c1dba31160cc None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:08.788583 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3358f4-a74c-4821-9179-bfe5dd80db42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:08.789235 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3358f4-a74c-4821-9179-bfe5dd80db42 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:08.789521 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3358f4-a74c-4821-9179-bfe5dd80db42 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:08.789799 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3358f4-a74c-4821-9179-bfe5dd80db42 None admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:08.790778 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3358f4-a74c-4821-9179-bfe5dd80db42 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:08.791094 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3358f4-a74c-4821-9179-bfe5dd80db42 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:08.792484 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3358f4-a74c-4821-9179-bfe5dd80db42 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:08.805427 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 255/511] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jun 7 14:21:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:08.806212 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3358f4-a74c-4821-9179-bfe5dd80db42 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:08.838448 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 257/512] 10.222.0.86 () {58 vars in 1282 bytes} [Tue Jun 7 14:21:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 07 14:21:08.839315 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640d4ded-37fc-499c-b414-5f51470d9575 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:08.878429 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:08.957282 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:08.960367 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3358f4-a74c-4821-9179-bfe5dd80db42 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:08.994069 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db78c608-c204-453e-9458-3b155ffa5875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:08.994725 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db78c608-c204-453e-9458-3b155ffa5875 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:08.995012 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db78c608-c204-453e-9458-3b155ffa5875 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:08.995102 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640d4ded-37fc-499c-b414-5f51470d9575 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:08.995500 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db78c608-c204-453e-9458-3b155ffa5875 None admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:08.996025 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db78c608-c204-453e-9458-3b155ffa5875 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:08.996344 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db78c608-c204-453e-9458-3b155ffa5875 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:08.998232 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db78c608-c204-453e-9458-3b155ffa5875 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:09.009337 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 256/513] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jun 7 14:21:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:09.010135 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db78c608-c204-453e-9458-3b155ffa5875 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:09.028600 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d6621f-f147-46ea-a550-eeb00db6f361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:09.029385 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d6621f-f147-46ea-a550-eeb00db6f361 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:09.029665 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d6621f-f147-46ea-a550-eeb00db6f361 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:09.029940 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d6621f-f147-46ea-a550-eeb00db6f361 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:09.040535 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d6621f-f147-46ea-a550-eeb00db6f361 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:09.042147 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d6621f-f147-46ea-a550-eeb00db6f361 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:09.059009 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-b8d6621f-f147-46ea-a550-eeb00db6f361 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:21:09.059009 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:09.059009 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:09.059009 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:09.059009 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:09.059009 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:09.059009 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:09.059009 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:09.059009 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:09.059009 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:09.059009 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:09.059009 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:09.059009 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:21:09.059009 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:21:09.059009 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:21:09.060056 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:21:09.060056 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:09.060056 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:09.060056 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:09.060056 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:09.060056 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:09.060056 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:09.060056 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:09.060056 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:09.060056 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:09.060056 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:09.060056 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:09.060056 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:09.060056 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:09.060056 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:09.060056 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:09.060056 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:09.061478 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:21:09.061478 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:21:09.061478 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:21:09.061478 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:21:09.061478 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 258/514] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jun 7 14:21:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:21:09.061882 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d6621f-f147-46ea-a550-eeb00db6f361 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:09.110761 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db78c608-c204-453e-9458-3b155ffa5875 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:09.140030 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:09.145746 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5b437c-d15a-44ff-b021-07b85536c2b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:09.146406 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5b437c-d15a-44ff-b021-07b85536c2b8 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:09.146688 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5b437c-d15a-44ff-b021-07b85536c2b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:09.146964 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5b437c-d15a-44ff-b021-07b85536c2b8 None admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:09.147689 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5b437c-d15a-44ff-b021-07b85536c2b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:09.148030 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5b437c-d15a-44ff-b021-07b85536c2b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:09.149405 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5b437c-d15a-44ff-b021-07b85536c2b8 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:09.160598 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 257/515] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jun 7 14:21:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:09.160801 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d6621f-f147-46ea-a550-eeb00db6f361 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:09.175983 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5b437c-d15a-44ff-b021-07b85536c2b8 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:09.177985 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:09.197541 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de89f29e-33a3-403b-8f7b-9cf8a9503252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:09.198346 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de89f29e-33a3-403b-8f7b-9cf8a9503252 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:09.198630 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de89f29e-33a3-403b-8f7b-9cf8a9503252 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:09.198906 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de89f29e-33a3-403b-8f7b-9cf8a9503252 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:09.206169 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de89f29e-33a3-403b-8f7b-9cf8a9503252 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:09.207609 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de89f29e-33a3-403b-8f7b-9cf8a9503252 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:09.222318 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-de89f29e-33a3-403b-8f7b-9cf8a9503252 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:21:09.222318 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:09.222318 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:09.222318 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:09.222318 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:09.222318 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:09.222318 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:09.222318 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:09.222318 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:09.222318 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:09.222318 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:09.222318 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:09.222318 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 14:21:09.222318 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 14:21:09.222318 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 14:21:09.223374 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 14:21:09.223374 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:09.223374 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:09.223374 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:09.223374 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:09.223374 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:09.223374 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:09.223374 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:09.223374 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:09.223374 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:09.223374 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:09.223374 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:09.223374 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:09.223374 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:09.223374 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:09.223374 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:09.223374 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:09.224621 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 14:21:09.224621 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 14:21:09.224621 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 14:21:09.224621 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 14:21:09.224621 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 14:21:09.224621 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 14:21:09.224621 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:21:09.224621 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:21:09.224621 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 259/516] 10.222.0.86 () {56 vars in 1111 bytes} [Tue Jun 7 14:21:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:21:09.228846 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de89f29e-33a3-403b-8f7b-9cf8a9503252 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:09.264332 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5b437c-d15a-44ff-b021-07b85536c2b8 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:09.296782 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de42b7bf-ea55-43f8-a1c0-6a45137149d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:09.297569 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de42b7bf-ea55-43f8-a1c0-6a45137149d3 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:09.297861 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de42b7bf-ea55-43f8-a1c0-6a45137149d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:09.298137 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de42b7bf-ea55-43f8-a1c0-6a45137149d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:09.307773 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de42b7bf-ea55-43f8-a1c0-6a45137149d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:09.309210 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de42b7bf-ea55-43f8-a1c0-6a45137149d3 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:09.327222 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-de42b7bf-ea55-43f8-a1c0-6a45137149d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:21:09.327222 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:09.327222 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:09.327222 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:09.327222 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:09.327222 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:09.327222 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:09.327222 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:09.327222 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:09.327222 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:09.327222 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:09.327222 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:09.327222 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:21:09.327222 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:21:09.327222 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:21:09.328082 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:21:09.328082 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:09.328082 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:09.328082 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:09.328082 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:09.328082 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:09.328082 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:09.328082 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:09.328082 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:09.328082 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:09.328082 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:09.328082 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:09.328082 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:09.328082 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:09.328082 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:09.328082 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:09.328082 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:09.328918 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:21:09.328918 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:21:09.328918 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:21:09.328918 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:21:09.329121 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de89f29e-33a3-403b-8f7b-9cf8a9503252 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:09.329197 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 258/517] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jun 7 14:21:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:21:09.329276 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de42b7bf-ea55-43f8-a1c0-6a45137149d3 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:09.365858 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f695890-2504-462d-a9a3-f478b84cb7bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:09.366644 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f695890-2504-462d-a9a3-f478b84cb7bc None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:09.366930 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f695890-2504-462d-a9a3-f478b84cb7bc None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:09.367210 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f695890-2504-462d-a9a3-f478b84cb7bc None admin] PATH_INFO: `/v3/users/glance` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:09.370495 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:09.374789 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f695890-2504-462d-a9a3-f478b84cb7bc None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:09.376302 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f695890-2504-462d-a9a3-f478b84cb7bc None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:09.392216 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-3f695890-2504-462d-a9a3-f478b84cb7bc None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 07 14:21:09.392216 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:09.392216 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:09.392216 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:09.392216 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:09.392216 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:09.392216 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:09.392216 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:09.392216 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:09.392216 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:09.392216 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:09.392216 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:09.392216 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 14:21:09.392216 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 14:21:09.392216 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 14:21:09.392216 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 14:21:09.393241 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:09.393241 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:09.393241 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 14:21:09.393241 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:21:09.393241 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 14:21:09.393241 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:21:09.393241 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:09.393241 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:09.393241 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:09.393241 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:09.393241 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:09.393241 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:09.393241 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:09.393241 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:09.393241 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:09.393241 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:09.393241 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:09.393241 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:09.394114 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:09.394114 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:09.394114 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 14:21:09.394114 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 14:21:09.394114 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 14:21:09.394114 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 14:21:09.394114 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 14:21:09.394114 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 14:21:09.394114 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 07 14:21:09.394114 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:21:09.394114 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 260/518] 10.222.0.86 () {56 vars in 1099 bytes} [Tue Jun 7 14:21:09 2022] GET /identity/v3/users/glance => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:21:09.394114 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f695890-2504-462d-a9a3-f478b84cb7bc None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:09.427524 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:09.430926 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de42b7bf-ea55-43f8-a1c0-6a45137149d3 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:09.465582 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a776a49-0da6-4493-85c5-4da079d5248e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:09.466242 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a776a49-0da6-4493-85c5-4da079d5248e None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:09.466528 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a776a49-0da6-4493-85c5-4da079d5248e None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:09.466802 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a776a49-0da6-4493-85c5-4da079d5248e None admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:09.467522 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a776a49-0da6-4493-85c5-4da079d5248e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:09.467858 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a776a49-0da6-4493-85c5-4da079d5248e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:09.469217 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a776a49-0da6-4493-85c5-4da079d5248e None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:09.480483 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 259/519] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jun 7 14:21:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:09.481314 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a776a49-0da6-4493-85c5-4da079d5248e None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:09.495489 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f695890-2504-462d-a9a3-f478b84cb7bc None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:09.529446 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e134b9-5de5-45fa-8986-03958ac3eeca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:09.530146 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e134b9-5de5-45fa-8986-03958ac3eeca None admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:09.530432 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e134b9-5de5-45fa-8986-03958ac3eeca None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:09.530709 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e134b9-5de5-45fa-8986-03958ac3eeca None admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:09.531452 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e134b9-5de5-45fa-8986-03958ac3eeca None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:09.532911 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e134b9-5de5-45fa-8986-03958ac3eeca None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:09.581318 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a776a49-0da6-4493-85c5-4da079d5248e None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:09.582797 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:09.613256 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67575b12-97b1-4cb0-a554-37f00ce7ee05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:09.613901 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67575b12-97b1-4cb0-a554-37f00ce7ee05 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:09.614186 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67575b12-97b1-4cb0-a554-37f00ce7ee05 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:09.614462 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67575b12-97b1-4cb0-a554-37f00ce7ee05 None admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:09.615243 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67575b12-97b1-4cb0-a554-37f00ce7ee05 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:09.615558 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67575b12-97b1-4cb0-a554-37f00ce7ee05 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:09.617018 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67575b12-97b1-4cb0-a554-37f00ce7ee05 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:09.623996 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 261/520] 10.222.0.86 () {60 vars in 1132 bytes} [Tue Jun 7 14:21:09 2022] POST /identity/v3/users => generated 247 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:21:09.624819 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e134b9-5de5-45fa-8986-03958ac3eeca None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:09.636823 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 260/521] 10.222.0.86 () {56 vars in 1148 bytes} [Tue Jun 7 14:21:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:09.637744 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67575b12-97b1-4cb0-a554-37f00ce7ee05 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:09.739694 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:09.750092 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e134b9-5de5-45fa-8986-03958ac3eeca None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:09.756672 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67575b12-97b1-4cb0-a554-37f00ce7ee05 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:09.787785 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2044d19a-921e-4844-b691-fe01ed8700fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:09.788484 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2044d19a-921e-4844-b691-fe01ed8700fc None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:09.788777 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2044d19a-921e-4844-b691-fe01ed8700fc None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:09.789053 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2044d19a-921e-4844-b691-fe01ed8700fc None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:09.789799 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2044d19a-921e-4844-b691-fe01ed8700fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:09.790366 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2044d19a-921e-4844-b691-fe01ed8700fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:09.791793 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2044d19a-921e-4844-b691-fe01ed8700fc None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:09.797668 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22f588a-7401-4e88-9640-e5e5951067f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:09.798628 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22f588a-7401-4e88-9640-e5e5951067f9 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:09.799065 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22f588a-7401-4e88-9640-e5e5951067f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:09.799594 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22f588a-7401-4e88-9640-e5e5951067f9 None admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:09.800563 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22f588a-7401-4e88-9640-e5e5951067f9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:09.800915 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22f588a-7401-4e88-9640-e5e5951067f9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:09.802392 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22f588a-7401-4e88-9640-e5e5951067f9 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:09.809268 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 262/522] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jun 7 14:21:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:09.809268 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2044d19a-921e-4844-b691-fe01ed8700fc None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:09.828019 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 261/523] 10.222.0.86 () {56 vars in 1137 bytes} [Tue Jun 7 14:21:09 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:09.829554 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22f588a-7401-4e88-9640-e5e5951067f9 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:09.856006 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:09.919948 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2044d19a-921e-4844-b691-fe01ed8700fc None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:09.939406 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22f588a-7401-4e88-9640-e5e5951067f9 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:09.955537 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bcfd2c-a16f-4a54-8c2b-91cae2f0f0ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:09.956373 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bcfd2c-a16f-4a54-8c2b-91cae2f0f0ad None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:09.956658 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bcfd2c-a16f-4a54-8c2b-91cae2f0f0ad None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:09.956926 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bcfd2c-a16f-4a54-8c2b-91cae2f0f0ad None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:09.964633 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bcfd2c-a16f-4a54-8c2b-91cae2f0f0ad None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:09.966072 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bcfd2c-a16f-4a54-8c2b-91cae2f0f0ad None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:09.975102 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f93b00c-3639-4586-b0db-2ee6685a6646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:09.975782 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f93b00c-3639-4586-b0db-2ee6685a6646 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:09.976070 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f93b00c-3639-4586-b0db-2ee6685a6646 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:09.976347 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f93b00c-3639-4586-b0db-2ee6685a6646 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:09.977186 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f93b00c-3639-4586-b0db-2ee6685a6646 None admin] RBAC: Adding query filter params (role.id=28e9b75018ac44c0afe7ab728071f2d5, scope.project.id=e429537b190c4c5ea7e1332ab044ca7a, user.id=b99cfb70f54c45c8870369359da20378) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:09.977502 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f93b00c-3639-4586-b0db-2ee6685a6646 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:09.978913 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f93b00c-3639-4586-b0db-2ee6685a6646 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:09.980910 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-54bcfd2c-a16f-4a54-8c2b-91cae2f0f0ad None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 07 14:21:09.980910 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:09.980910 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:09.980910 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:09.980910 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:09.980910 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:09.980910 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:09.980910 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:09.980910 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:09.980910 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:09.980910 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:09.980910 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:09.980910 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 14:21:09.980910 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 14:21:09.980910 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 14:21:09.980910 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 14:21:09.981769 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:09.981769 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:09.981769 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 14:21:09.981769 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:21:09.981769 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 14:21:09.981769 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:21:09.981769 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:09.981769 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:09.981769 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:09.981769 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:09.981769 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:09.981769 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:09.981769 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:09.981769 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:09.981769 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:09.981769 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:09.981769 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:09.981769 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:09.982927 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:09.982927 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:09.982927 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 14:21:09.982927 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 14:21:09.982927 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 14:21:09.982927 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 14:21:09.982927 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 14:21:09.982927 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 14:21:09.982927 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 07 14:21:09.982927 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:21:09.982927 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 263/524] 10.222.0.86 () {56 vars in 1102 bytes} [Tue Jun 7 14:21:09 2022] GET /identity/v3/users/neutron => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:21:09.984065 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bcfd2c-a16f-4a54-8c2b-91cae2f0f0ad None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:09.996197 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 262/525] 10.222.0.86 () {56 vars in 1374 bytes} [Tue Jun 7 14:21:09 2022] GET /identity/v3/role_assignments?user.id=b99cfb70f54c45c8870369359da20378&scope.project.id=e429537b190c4c5ea7e1332ab044ca7a&role.id=28e9b75018ac44c0afe7ab728071f2d5 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:09.996197 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f93b00c-3639-4586-b0db-2ee6685a6646 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:10.001520 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:10.107852 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:10.129242 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f93b00c-3639-4586-b0db-2ee6685a6646 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:10.138021 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bcfd2c-a16f-4a54-8c2b-91cae2f0f0ad None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:10.169367 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0339aae2-bc7e-4089-a4bc-56aec15d5633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:10.170067 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0339aae2-bc7e-4089-a4bc-56aec15d5633 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:10.170358 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0339aae2-bc7e-4089-a4bc-56aec15d5633 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:10.170644 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0339aae2-bc7e-4089-a4bc-56aec15d5633 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:10.184620 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7884ff9-e169-4a26-9024-68b205c577c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:10.185768 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7884ff9-e169-4a26-9024-68b205c577c7 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:10.186207 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7884ff9-e169-4a26-9024-68b205c577c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:10.186656 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7884ff9-e169-4a26-9024-68b205c577c7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:10.195218 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7884ff9-e169-4a26-9024-68b205c577c7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:10.196709 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7884ff9-e169-4a26-9024-68b205c577c7 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:10.213822 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-a7884ff9-e169-4a26-9024-68b205c577c7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:21:10.213822 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:10.213822 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:10.213822 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:10.213822 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:10.213822 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:10.213822 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:10.213822 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:10.213822 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:10.213822 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:10.213822 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:10.213822 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:10.213822 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 14:21:10.213822 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 14:21:10.213822 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 14:21:10.214717 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 14:21:10.214717 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:10.214717 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:10.214717 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:10.214717 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:10.214717 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:10.214717 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:10.214717 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:10.214717 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:10.214717 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:10.214717 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:10.214717 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:10.214717 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:10.214717 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:10.214717 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:10.214717 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:10.214717 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:10.215578 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 14:21:10.215578 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 14:21:10.215578 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 14:21:10.215578 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 14:21:10.215578 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 14:21:10.215578 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 14:21:10.215578 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:21:10.215578 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:21:10.215578 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 264/526] 10.222.0.86 () {56 vars in 1111 bytes} [Tue Jun 7 14:21:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:21:10.216714 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7884ff9-e169-4a26-9024-68b205c577c7 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:10.252114 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0339aae2-bc7e-4089-a4bc-56aec15d5633 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:10.253892 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0339aae2-bc7e-4089-a4bc-56aec15d5633 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:10.289092 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:10.321530 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7884ff9-e169-4a26-9024-68b205c577c7 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:10.357913 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27592336-d0d3-4ebd-a9a3-4a7e7d69cf5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:10.358596 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27592336-d0d3-4ebd-a9a3-4a7e7d69cf5a None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:10.358882 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27592336-d0d3-4ebd-a9a3-4a7e7d69cf5a None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:10.359159 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27592336-d0d3-4ebd-a9a3-4a7e7d69cf5a None admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:10.360042 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27592336-d0d3-4ebd-a9a3-4a7e7d69cf5a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:10.360392 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27592336-d0d3-4ebd-a9a3-4a7e7d69cf5a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:10.361793 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27592336-d0d3-4ebd-a9a3-4a7e7d69cf5a None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:10.365570 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 263/527] 10.222.0.86 () {58 vars in 1282 bytes} [Tue Jun 7 14:21:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 07 14:21:10.366646 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0339aae2-bc7e-4089-a4bc-56aec15d5633 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:10.370177 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:10.381326 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 265/528] 10.222.0.86 () {56 vars in 1139 bytes} [Tue Jun 7 14:21:10 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:10.382257 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27592336-d0d3-4ebd-a9a3-4a7e7d69cf5a None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:10.472776 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0339aae2-bc7e-4089-a4bc-56aec15d5633 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:10.487073 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27592336-d0d3-4ebd-a9a3-4a7e7d69cf5a None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:10.515596 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:10.519659 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796e1738-bc69-49a6-a179-ea53ed8e1ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:10.520879 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796e1738-bc69-49a6-a179-ea53ed8e1ff8 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:10.521315 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796e1738-bc69-49a6-a179-ea53ed8e1ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:10.521737 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796e1738-bc69-49a6-a179-ea53ed8e1ff8 None admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:10.522695 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796e1738-bc69-49a6-a179-ea53ed8e1ff8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:10.523152 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796e1738-bc69-49a6-a179-ea53ed8e1ff8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:10.524066 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecd2e16-9b64-4dde-8d56-d8d0ed0a4974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:10.525038 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796e1738-bc69-49a6-a179-ea53ed8e1ff8 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:10.525366 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecd2e16-9b64-4dde-8d56-d8d0ed0a4974 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:10.525660 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecd2e16-9b64-4dde-8d56-d8d0ed0a4974 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:10.525939 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecd2e16-9b64-4dde-8d56-d8d0ed0a4974 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:10.537768 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecd2e16-9b64-4dde-8d56-d8d0ed0a4974 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:10.539229 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecd2e16-9b64-4dde-8d56-d8d0ed0a4974 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:10.541435 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 264/529] 10.222.0.86 () {56 vars in 1148 bytes} [Tue Jun 7 14:21:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:10.542895 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796e1738-bc69-49a6-a179-ea53ed8e1ff8 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:10.559878 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-1ecd2e16-9b64-4dde-8d56-d8d0ed0a4974 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:21:10.559878 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:10.559878 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:10.559878 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:10.559878 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:10.559878 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:10.559878 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:10.559878 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:10.559878 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:10.559878 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:10.559878 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:10.559878 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:10.559878 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:21:10.559878 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:21:10.559878 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:21:10.561302 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:21:10.561302 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:10.561302 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:10.561302 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:10.561302 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:10.561302 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:10.561302 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:10.561302 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:10.561302 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:10.561302 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:10.561302 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:10.561302 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:10.561302 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:10.561302 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:10.561302 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:10.561302 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:10.561302 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:10.562132 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:21:10.562132 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:21:10.562132 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:21:10.562132 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:21:10.562132 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 266/530] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jun 7 14:21:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:21:10.562831 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecd2e16-9b64-4dde-8d56-d8d0ed0a4974 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:10.602782 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:10.661316 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796e1738-bc69-49a6-a179-ea53ed8e1ff8 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:10.697387 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e1578c-2ccc-4afe-a0c5-f9d09c2fc111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:10.697988 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e1578c-2ccc-4afe-a0c5-f9d09c2fc111 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:10.698275 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e1578c-2ccc-4afe-a0c5-f9d09c2fc111 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:10.698555 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e1578c-2ccc-4afe-a0c5-f9d09c2fc111 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:10.701674 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecd2e16-9b64-4dde-8d56-d8d0ed0a4974 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:10.751681 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89578bf-f97b-45d0-9d4c-e261580d45d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:10.752736 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89578bf-f97b-45d0-9d4c-e261580d45d5 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:10.753252 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89578bf-f97b-45d0-9d4c-e261580d45d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:10.753772 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89578bf-f97b-45d0-9d4c-e261580d45d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:10.755452 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89578bf-f97b-45d0-9d4c-e261580d45d5 None admin] RBAC: Adding query filter params (role.id=28e9b75018ac44c0afe7ab728071f2d5, scope.project.id=e429537b190c4c5ea7e1332ab044ca7a, user.id=af5a95620a4b43538abfe09eed4bf115) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:10.756048 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89578bf-f97b-45d0-9d4c-e261580d45d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:10.758387 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89578bf-f97b-45d0-9d4c-e261580d45d5 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:10.767584 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 267/531] 10.222.0.86 () {56 vars in 1374 bytes} [Tue Jun 7 14:21:10 2022] GET /identity/v3/role_assignments?user.id=af5a95620a4b43538abfe09eed4bf115&scope.project.id=e429537b190c4c5ea7e1332ab044ca7a&role.id=28e9b75018ac44c0afe7ab728071f2d5 => generated 259 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:10.768873 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89578bf-f97b-45d0-9d4c-e261580d45d5 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:10.772378 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e1578c-2ccc-4afe-a0c5-f9d09c2fc111 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:10.774562 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e1578c-2ccc-4afe-a0c5-f9d09c2fc111 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:10.827658 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:10.836165 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:10.908921 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89578bf-f97b-45d0-9d4c-e261580d45d5 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:10.921221 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 265/532] 10.222.0.86 () {58 vars in 1282 bytes} [Tue Jun 7 14:21:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 07 14:21:10.926950 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e1578c-2ccc-4afe-a0c5-f9d09c2fc111 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:10.954325 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10fe5c1-a523-4d66-af6c-1bd013dc3e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:10.955304 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10fe5c1-a523-4d66-af6c-1bd013dc3e24 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:10.955590 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10fe5c1-a523-4d66-af6c-1bd013dc3e24 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:10.955899 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10fe5c1-a523-4d66-af6c-1bd013dc3e24 None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:10.956932 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10fe5c1-a523-4d66-af6c-1bd013dc3e24 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:10.957411 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10fe5c1-a523-4d66-af6c-1bd013dc3e24 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:10.959221 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10fe5c1-a523-4d66-af6c-1bd013dc3e24 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:10.977105 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 268/533] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jun 7 14:21:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:10.983524 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10fe5c1-a523-4d66-af6c-1bd013dc3e24 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:11.093975 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e1578c-2ccc-4afe-a0c5-f9d09c2fc111 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:11.111181 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10fe5c1-a523-4d66-af6c-1bd013dc3e24 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:11.115268 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:11.141975 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4c400d-123d-49da-8f6d-0b4b3afeec40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:11.143241 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4c400d-123d-49da-8f6d-0b4b3afeec40 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:11.143642 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4c400d-123d-49da-8f6d-0b4b3afeec40 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:11.143952 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4c400d-123d-49da-8f6d-0b4b3afeec40 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:11.156475 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4c400d-123d-49da-8f6d-0b4b3afeec40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:11.158193 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4c400d-123d-49da-8f6d-0b4b3afeec40 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:11.160890 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:11.169007 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a39325-76b1-4c5d-9676-aa6edebbda43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:11.170415 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a39325-76b1-4c5d-9676-aa6edebbda43 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:11.170702 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a39325-76b1-4c5d-9676-aa6edebbda43 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:11.170981 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a39325-76b1-4c5d-9676-aa6edebbda43 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:11.178124 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-db4c400d-123d-49da-8f6d-0b4b3afeec40 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:21:11.178124 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:11.178124 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:11.178124 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:11.178124 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:11.178124 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:11.178124 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:11.178124 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:11.178124 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:11.178124 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:11.178124 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:11.178124 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:11.178124 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:21:11.178124 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:21:11.178124 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:21:11.182487 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:21:11.182487 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:11.182487 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:11.182487 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:11.182487 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:11.182487 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:11.182487 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:11.182487 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:11.182487 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:11.182487 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:11.182487 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:11.182487 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:11.182487 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:11.182487 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:11.182487 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:11.182487 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:11.182487 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:11.184260 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:21:11.184260 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:21:11.184260 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:21:11.184260 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:21:11.184260 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 266/534] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jun 7 14:21:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 14:21:11.184915 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4c400d-123d-49da-8f6d-0b4b3afeec40 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:11.185059 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a39325-76b1-4c5d-9676-aa6edebbda43 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:11.187804 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a39325-76b1-4c5d-9676-aa6edebbda43 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:11.220332 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-c8a39325-76b1-4c5d-9676-aa6edebbda43 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:21:11.220332 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:11.220332 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:11.220332 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:11.220332 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:11.220332 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:11.220332 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:11.220332 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:11.220332 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:11.220332 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:11.220332 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:11.220332 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:11.220332 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 14:21:11.220332 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 14:21:11.220332 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 14:21:11.221226 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 14:21:11.221226 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:11.221226 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:11.221226 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:11.221226 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:11.221226 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:11.221226 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:11.221226 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:11.221226 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:11.221226 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:11.221226 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:11.221226 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:11.221226 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:11.221226 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:11.221226 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:11.221226 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:11.221226 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:11.222490 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 14:21:11.222490 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 14:21:11.222490 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 14:21:11.222490 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 14:21:11.222490 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 14:21:11.222490 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 14:21:11.222490 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:21:11.222490 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:21:11.222490 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 269/535] 10.222.0.86 () {56 vars in 1111 bytes} [Tue Jun 7 14:21:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 14:21:11.233879 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a39325-76b1-4c5d-9676-aa6edebbda43 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:11.303145 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4c400d-123d-49da-8f6d-0b4b3afeec40 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:11.340941 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c01d19-e3d9-4c4c-b4e3-b338cb810047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:11.342182 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c01d19-e3d9-4c4c-b4e3-b338cb810047 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:11.342473 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c01d19-e3d9-4c4c-b4e3-b338cb810047 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:11.342750 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c01d19-e3d9-4c4c-b4e3-b338cb810047 None admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:11.343480 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c01d19-e3d9-4c4c-b4e3-b338cb810047 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:11.343810 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c01d19-e3d9-4c4c-b4e3-b338cb810047 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:11.345842 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c01d19-e3d9-4c4c-b4e3-b338cb810047 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:11.359737 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 267/536] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jun 7 14:21:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:21:11.364778 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c01d19-e3d9-4c4c-b4e3-b338cb810047 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:11.430744 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:11.479934 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c01d19-e3d9-4c4c-b4e3-b338cb810047 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:11.501960 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a39325-76b1-4c5d-9676-aa6edebbda43 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:11.518846 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffd9c43-a1ed-4979-a665-a091ba434337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:11.519650 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffd9c43-a1ed-4979-a665-a091ba434337 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:11.519963 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffd9c43-a1ed-4979-a665-a091ba434337 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:11.520243 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffd9c43-a1ed-4979-a665-a091ba434337 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:11.528367 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffd9c43-a1ed-4979-a665-a091ba434337 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:11.530671 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffd9c43-a1ed-4979-a665-a091ba434337 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:11.548187 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-0ffd9c43-a1ed-4979-a665-a091ba434337 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:21:11.548187 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:11.548187 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:11.548187 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:11.548187 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:11.548187 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:11.548187 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:11.548187 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:11.548187 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:11.548187 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:11.548187 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:11.548187 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:11.548187 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 14:21:11.548187 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 14:21:11.548187 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 14:21:11.549075 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 14:21:11.549075 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:11.549075 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:11.549075 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:11.549075 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:11.549075 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:11.549075 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:11.549075 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:11.549075 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:11.549075 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:11.549075 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:11.549075 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:11.549075 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:11.549075 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:11.549075 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:11.549075 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:11.549075 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:11.550133 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 14:21:11.550133 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 14:21:11.550133 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 14:21:11.550133 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 14:21:11.550133 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 14:21:11.550133 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 14:21:11.550133 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:21:11.550133 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:21:11.550133 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 268/537] 10.222.0.86 () {56 vars in 1111 bytes} [Tue Jun 7 14:21:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 14:21:11.555053 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffd9c43-a1ed-4979-a665-a091ba434337 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:11.584184 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe34828f-ca72-41fc-abf2-a0b47b655456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:11.584852 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe34828f-ca72-41fc-abf2-a0b47b655456 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:11.585134 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe34828f-ca72-41fc-abf2-a0b47b655456 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:11.585411 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe34828f-ca72-41fc-abf2-a0b47b655456 None admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:11.586201 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe34828f-ca72-41fc-abf2-a0b47b655456 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:11.586509 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe34828f-ca72-41fc-abf2-a0b47b655456 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:11.587970 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe34828f-ca72-41fc-abf2-a0b47b655456 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:11.624703 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 270/538] 10.222.0.86 () {56 vars in 1148 bytes} [Tue Jun 7 14:21:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 392 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:11.631217 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe34828f-ca72-41fc-abf2-a0b47b655456 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:11.660996 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:11.743939 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe34828f-ca72-41fc-abf2-a0b47b655456 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:11.781838 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181eda0e-cf32-431e-aa3a-4627c004e913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:11.782520 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181eda0e-cf32-431e-aa3a-4627c004e913 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:11.782805 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181eda0e-cf32-431e-aa3a-4627c004e913 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:11.783084 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181eda0e-cf32-431e-aa3a-4627c004e913 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:11.784988 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181eda0e-cf32-431e-aa3a-4627c004e913 None admin] RBAC: Adding query filter params (role.id=28e9b75018ac44c0afe7ab728071f2d5, scope.project.id=e429537b190c4c5ea7e1332ab044ca7a, user.id=b910435e5585436996ba5b5aeb7184bb) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:11.786059 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181eda0e-cf32-431e-aa3a-4627c004e913 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:11.787798 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181eda0e-cf32-431e-aa3a-4627c004e913 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:11.798311 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffd9c43-a1ed-4979-a665-a091ba434337 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:11.804016 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 271/539] 10.222.0.86 () {56 vars in 1374 bytes} [Tue Jun 7 14:21:11 2022] GET /identity/v3/role_assignments?user.id=b910435e5585436996ba5b5aeb7184bb&scope.project.id=e429537b190c4c5ea7e1332ab044ca7a&role.id=28e9b75018ac44c0afe7ab728071f2d5 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:21:11.827088 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:11.857303 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bedb7d-e04e-4616-a1a4-d43d228b7d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:11.858031 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bedb7d-e04e-4616-a1a4-d43d228b7d37 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:11.858318 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bedb7d-e04e-4616-a1a4-d43d228b7d37 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:11.858595 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bedb7d-e04e-4616-a1a4-d43d228b7d37 None admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:11.859560 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bedb7d-e04e-4616-a1a4-d43d228b7d37 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:11.859927 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bedb7d-e04e-4616-a1a4-d43d228b7d37 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:11.861375 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bedb7d-e04e-4616-a1a4-d43d228b7d37 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:11.879249 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 269/540] 10.222.0.86 () {56 vars in 1148 bytes} [Tue Jun 7 14:21:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:11.884791 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181eda0e-cf32-431e-aa3a-4627c004e913 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:12.004088 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:12.017147 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181eda0e-cf32-431e-aa3a-4627c004e913 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:12.056354 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b2281e-1994-4330-822c-70e6eb594349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:12.057022 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b2281e-1994-4330-822c-70e6eb594349 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:12.057310 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b2281e-1994-4330-822c-70e6eb594349 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:12.057589 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b2281e-1994-4330-822c-70e6eb594349 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:12.058434 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b2281e-1994-4330-822c-70e6eb594349 None admin] RBAC: Adding query filter params (role.id=28e9b75018ac44c0afe7ab728071f2d5, scope.project.id=e429537b190c4c5ea7e1332ab044ca7a, user.id=dda603ec5517460a83c333db2af804d4) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:12.058751 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b2281e-1994-4330-822c-70e6eb594349 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:12.060274 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b2281e-1994-4330-822c-70e6eb594349 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:12.066945 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 272/541] 10.222.0.86 () {56 vars in 1374 bytes} [Tue Jun 7 14:21:11 2022] GET /identity/v3/role_assignments?user.id=dda603ec5517460a83c333db2af804d4&scope.project.id=e429537b190c4c5ea7e1332ab044ca7a&role.id=28e9b75018ac44c0afe7ab728071f2d5 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:12.216273 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e7e15b-cc5f-4296-abc4-c833a9850e25 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:12.217303 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e7e15b-cc5f-4296-abc4-c833a9850e25 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:12.217303 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e7e15b-cc5f-4296-abc4-c833a9850e25 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:12.218742 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 270/542] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:21:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:21:12.224824 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13587d70-8413-4451-a8e9-be7a57bc91f8 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:12.225396 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13587d70-8413-4451-a8e9-be7a57bc91f8 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:12.225396 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13587d70-8413-4451-a8e9-be7a57bc91f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:12.244607 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-13587d70-8413-4451-a8e9-be7a57bc91f8 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:21:12.245826 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-13587d70-8413-4451-a8e9-be7a57bc91f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:21:12.340560 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 273/543] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:21:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 14:21:12.366316 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e7e15b-cc5f-4296-abc4-c833a9850e25 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:12.472609 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e7e15b-cc5f-4296-abc4-c833a9850e25 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:12.525641 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548aaf3a-9a3c-4903-bcae-9e78ed328238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:12.526826 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548aaf3a-9a3c-4903-bcae-9e78ed328238 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:12.527347 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548aaf3a-9a3c-4903-bcae-9e78ed328238 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:12.527909 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548aaf3a-9a3c-4903-bcae-9e78ed328238 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:12.538208 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12c90c9-e03e-4fbd-86d3-131a339dc806 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:12.538497 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12c90c9-e03e-4fbd-86d3-131a339dc806 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:12.538774 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12c90c9-e03e-4fbd-86d3-131a339dc806 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:12.540678 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 274/544] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:21:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:21:12.548682 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548aaf3a-9a3c-4903-bcae-9e78ed328238 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:21:12.550536 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd3273d-3507-44dc-9a91-e6aae051068c None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:12.550827 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd3273d-3507-44dc-9a91-e6aae051068c None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:12.551110 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd3273d-3507-44dc-9a91-e6aae051068c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:12.556794 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-548aaf3a-9a3c-4903-bcae-9e78ed328238 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 07 14:21:12.556794 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:12.556794 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:12.556794 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:12.556794 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:12.556794 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:12.556794 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:12.556794 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:12.556794 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:12.556794 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:12.556794 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:12.556794 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:12.556794 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:21:12.556794 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:21:12.556794 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:21:12.556794 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:21:12.557673 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:21:12.557673 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:21:12.557673 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:21:12.557673 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:21:12.557673 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:12.557673 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:12.557673 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:12.557673 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:12.557673 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:12.557673 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:12.557673 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:12.557673 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:12.557673 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:12.557673 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:12.557673 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:12.557673 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:12.559057 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:12.559057 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:12.559057 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:12.559057 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:12.559057 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:21:12.559057 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:21:12.559057 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:21:12.559057 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:21:12.559057 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:21:12.559057 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:21:12.559057 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 07 14:21:12.559057 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:21:12.559057 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 271/545] 10.222.0.86 () {56 vars in 1102 bytes} [Tue Jun 7 14:21:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:21:12.564382 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548aaf3a-9a3c-4903-bcae-9e78ed328238 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:12.596814 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-dbd3273d-3507-44dc-9a91-e6aae051068c None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:21:12.598016 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-dbd3273d-3507-44dc-9a91-e6aae051068c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:21:12.602366 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:12.669379 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548aaf3a-9a3c-4903-bcae-9e78ed328238 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:12.704000 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a609d627-1f85-4a64-a75d-361414b5d26a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:12.705016 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a609d627-1f85-4a64-a75d-361414b5d26a None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:12.705380 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a609d627-1f85-4a64-a75d-361414b5d26a None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:12.705759 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a609d627-1f85-4a64-a75d-361414b5d26a None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:12.706647 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a609d627-1f85-4a64-a75d-361414b5d26a None admin] RBAC: Adding query filter params (name=service) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:12.709552 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a609d627-1f85-4a64-a75d-361414b5d26a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:12.709552 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a609d627-1f85-4a64-a75d-361414b5d26a None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:12.717804 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 272/546] 10.222.0.86 () {56 vars in 1103 bytes} [Tue Jun 7 14:21:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:21:12.723328 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a609d627-1f85-4a64-a75d-361414b5d26a None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:12.743438 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 275/547] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:21:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 14:21:12.780958 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd3273d-3507-44dc-9a91-e6aae051068c None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:12.807709 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:12.909787 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:12.918128 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a609d627-1f85-4a64-a75d-361414b5d26a None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:12.945773 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd3273d-3507-44dc-9a91-e6aae051068c None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:12.989226 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e295556-4616-4f7a-8486-3f8b91ef0020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:12.990357 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e295556-4616-4f7a-8486-3f8b91ef0020 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:12.990930 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e295556-4616-4f7a-8486-3f8b91ef0020 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:12.992419 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e295556-4616-4f7a-8486-3f8b91ef0020 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:13.007875 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e295556-4616-4f7a-8486-3f8b91ef0020 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:13.009773 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e295556-4616-4f7a-8486-3f8b91ef0020 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:13.028643 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-5e295556-4616-4f7a-8486-3f8b91ef0020 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:21:13.028643 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:13.028643 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:13.028643 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:13.028643 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:13.028643 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:13.028643 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:13.028643 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:13.028643 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:13.028643 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:13.028643 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:13.028643 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:13.028643 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:21:13.028643 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:21:13.028643 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:21:13.030065 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:21:13.030065 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:13.030065 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:13.030065 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:13.030065 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:13.030065 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:13.030065 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:13.030065 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:13.030065 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:13.030065 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:13.030065 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:13.030065 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:13.030065 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:13.030065 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:13.030065 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:13.030065 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:13.030065 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:13.031428 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:21:13.031428 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:21:13.031428 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:21:13.031428 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:21:13.031650 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df3eed5-115d-48c9-99a5-81e9381009b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:13.031650 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df3eed5-115d-48c9-99a5-81e9381009b7 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:13.031650 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df3eed5-115d-48c9-99a5-81e9381009b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:13.031650 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df3eed5-115d-48c9-99a5-81e9381009b7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:13.034418 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 273/548] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jun 7 14:21:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:21:13.048801 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e295556-4616-4f7a-8486-3f8b91ef0020 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:13.064767 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df3eed5-115d-48c9-99a5-81e9381009b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:21:13.080456 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-2df3eed5-115d-48c9-99a5-81e9381009b7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 07 14:21:13.080456 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:13.080456 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:13.080456 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:13.080456 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:13.080456 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:13.080456 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:13.080456 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:13.080456 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:13.080456 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:13.080456 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:13.080456 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:13.080456 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:21:13.080456 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:21:13.080456 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:21:13.080456 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:21:13.081432 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:21:13.081432 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:21:13.081432 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:21:13.081432 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:21:13.081432 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:13.081432 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:13.081432 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:13.081432 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:13.081432 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:13.081432 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:13.081432 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:13.081432 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:13.081432 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:13.081432 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:13.081432 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:13.081432 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:13.086178 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:13.086178 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:13.086178 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:13.086178 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:13.086178 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:21:13.086178 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:21:13.086178 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:21:13.086178 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:21:13.086178 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:21:13.086178 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:21:13.086178 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 07 14:21:13.086178 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:21:13.086178 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 276/549] 10.222.0.86 () {56 vars in 1102 bytes} [Tue Jun 7 14:21:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 14:21:13.098335 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df3eed5-115d-48c9-99a5-81e9381009b7 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:13.176646 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e295556-4616-4f7a-8486-3f8b91ef0020 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:13.223917 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04482c15-3b0c-45d3-ba88-d221809431a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:13.225380 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04482c15-3b0c-45d3-ba88-d221809431a3 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:13.225883 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04482c15-3b0c-45d3-ba88-d221809431a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:13.226392 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04482c15-3b0c-45d3-ba88-d221809431a3 None admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:13.227325 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04482c15-3b0c-45d3-ba88-d221809431a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:13.227862 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04482c15-3b0c-45d3-ba88-d221809431a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:13.230269 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04482c15-3b0c-45d3-ba88-d221809431a3 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:13.244005 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 274/550] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jun 7 14:21:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:13.250075 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04482c15-3b0c-45d3-ba88-d221809431a3 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:13.266988 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:13.281645 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:13.305517 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df3eed5-115d-48c9-99a5-81e9381009b7 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:13.349705 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a085c5d-8bee-4e93-86ff-c65533292df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:13.350380 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a085c5d-8bee-4e93-86ff-c65533292df8 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:13.350917 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a085c5d-8bee-4e93-86ff-c65533292df8 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:13.351201 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a085c5d-8bee-4e93-86ff-c65533292df8 None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:13.352045 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a085c5d-8bee-4e93-86ff-c65533292df8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:13.352361 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a085c5d-8bee-4e93-86ff-c65533292df8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:13.354707 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a085c5d-8bee-4e93-86ff-c65533292df8 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:13.364608 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 277/551] 10.222.0.86 () {56 vars in 1103 bytes} [Tue Jun 7 14:21:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:21:13.373339 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a085c5d-8bee-4e93-86ff-c65533292df8 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:13.478304 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04482c15-3b0c-45d3-ba88-d221809431a3 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:13.539048 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a085c5d-8bee-4e93-86ff-c65533292df8 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:13.559282 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc35e63-261b-4154-addb-dd1fb1de8d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:13.560143 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc35e63-261b-4154-addb-dd1fb1de8d46 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:13.560428 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc35e63-261b-4154-addb-dd1fb1de8d46 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:13.560704 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc35e63-261b-4154-addb-dd1fb1de8d46 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:13.571648 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc35e63-261b-4154-addb-dd1fb1de8d46 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:13.573125 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc35e63-261b-4154-addb-dd1fb1de8d46 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:13.603423 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c09711b-cad5-499c-bbaf-fb5329d93210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:13.604240 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c09711b-cad5-499c-bbaf-fb5329d93210 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:13.604517 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c09711b-cad5-499c-bbaf-fb5329d93210 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:13.604790 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c09711b-cad5-499c-bbaf-fb5329d93210 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:13.605599 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-fbc35e63-261b-4154-addb-dd1fb1de8d46 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 07 14:21:13.605599 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:13.605599 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:13.605599 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:13.605599 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:13.605599 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:13.605599 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:13.605599 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:13.605599 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:13.605599 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:13.605599 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:13.605599 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:13.605599 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 14:21:13.605599 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 14:21:13.605599 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 14:21:13.605599 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 14:21:13.608776 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:13.608776 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:13.608776 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 14:21:13.608776 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:21:13.608776 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 14:21:13.608776 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:21:13.608776 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:13.608776 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:13.608776 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:13.608776 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:13.608776 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:13.608776 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:13.608776 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:13.608776 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:13.608776 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:13.608776 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:13.608776 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:13.608776 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:13.611034 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:13.611034 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:13.611034 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 14:21:13.611034 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 14:21:13.611034 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 14:21:13.611034 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 14:21:13.611034 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 14:21:13.611034 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 14:21:13.611034 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 07 14:21:13.611034 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:21:13.612250 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:13.612402 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 275/552] 10.222.0.86 () {56 vars in 1096 bytes} [Tue Jun 7 14:21:13 2022] GET /identity/v3/users/swift => generated 83 bytes in 359 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:21:13.618082 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc35e63-261b-4154-addb-dd1fb1de8d46 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:13.632671 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c09711b-cad5-499c-bbaf-fb5329d93210 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:13.634147 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c09711b-cad5-499c-bbaf-fb5329d93210 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:13.665232 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-9c09711b-cad5-499c-bbaf-fb5329d93210 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:21:13.665232 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:13.665232 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:13.665232 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:13.665232 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:13.665232 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:13.665232 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:13.665232 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:13.665232 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:13.665232 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:13.665232 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:13.665232 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:13.665232 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:21:13.665232 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:21:13.665232 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:21:13.667330 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:21:13.667330 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:13.667330 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:13.667330 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:13.667330 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:13.667330 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:13.667330 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:13.667330 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:13.667330 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:13.667330 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:13.667330 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:13.667330 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:13.667330 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:13.667330 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:13.667330 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:13.667330 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:13.667330 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:13.670136 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:21:13.670136 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:21:13.670136 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:21:13.670136 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:21:13.670136 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 278/553] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jun 7 14:21:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:21:13.678538 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab97ca3-57b1-4649-82bc-6fd00fe1fd0a None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:13.678538 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab97ca3-57b1-4649-82bc-6fd00fe1fd0a None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:13.678538 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab97ca3-57b1-4649-82bc-6fd00fe1fd0a None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:13.678538 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 279/554] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:21:13 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:21:13.678538 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab97ca3-57b1-4649-82bc-6fd00fe1fd0a None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:13.705154 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:13.737610 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc35e63-261b-4154-addb-dd1fb1de8d46 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:13.780330 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efee200f-5f3c-44a8-bc60-ff6d19e770b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:13.781006 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efee200f-5f3c-44a8-bc60-ff6d19e770b7 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:13.781299 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efee200f-5f3c-44a8-bc60-ff6d19e770b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:13.782088 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efee200f-5f3c-44a8-bc60-ff6d19e770b7 None admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:13.783331 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efee200f-5f3c-44a8-bc60-ff6d19e770b7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:13.783654 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efee200f-5f3c-44a8-bc60-ff6d19e770b7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:13.785799 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efee200f-5f3c-44a8-bc60-ff6d19e770b7 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:13.795772 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab97ca3-57b1-4649-82bc-6fd00fe1fd0a None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:13.809334 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 276/555] 10.222.0.86 () {56 vars in 1135 bytes} [Tue Jun 7 14:21:13 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:13.811453 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7b55e2-f978-4ddc-a5eb-4fa0714a7fee None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:13.811902 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7b55e2-f978-4ddc-a5eb-4fa0714a7fee None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:13.812185 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7b55e2-f978-4ddc-a5eb-4fa0714a7fee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:13.830106 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-6c7b55e2-f978-4ddc-a5eb-4fa0714a7fee None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:21:13.831367 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-6c7b55e2-f978-4ddc-a5eb-4fa0714a7fee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:21:13.831928 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f6cbd6-7dc5-4c5e-bae7-3793728cb352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:13.832715 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f6cbd6-7dc5-4c5e-bae7-3793728cb352 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:13.833098 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f6cbd6-7dc5-4c5e-bae7-3793728cb352 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:13.833474 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f6cbd6-7dc5-4c5e-bae7-3793728cb352 None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:13.834337 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f6cbd6-7dc5-4c5e-bae7-3793728cb352 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:13.834747 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f6cbd6-7dc5-4c5e-bae7-3793728cb352 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:13.836240 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f6cbd6-7dc5-4c5e-bae7-3793728cb352 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:13.853838 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 280/556] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jun 7 14:21:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:13.854856 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f6cbd6-7dc5-4c5e-bae7-3793728cb352 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:13.903618 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 277/557] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:21:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 14:21:13.905152 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7b55e2-f978-4ddc-a5eb-4fa0714a7fee None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:13.905328 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:13.962644 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f6cbd6-7dc5-4c5e-bae7-3793728cb352 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:13.967476 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:13.999900 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0b0e3e-b135-42bb-8221-0dd636030d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:14.000899 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b0e3e-b135-42bb-8221-0dd636030d0b None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:14.001385 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b0e3e-b135-42bb-8221-0dd636030d0b None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:14.001926 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b0e3e-b135-42bb-8221-0dd636030d0b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:14.011840 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7b55e2-f978-4ddc-a5eb-4fa0714a7fee None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:14.050163 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9183af-654c-477a-8dde-ce12a1a0437d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:14.050802 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9183af-654c-477a-8dde-ce12a1a0437d None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:14.051227 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9183af-654c-477a-8dde-ce12a1a0437d None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:14.051527 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9183af-654c-477a-8dde-ce12a1a0437d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:14.059434 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9183af-654c-477a-8dde-ce12a1a0437d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:14.060937 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9183af-654c-477a-8dde-ce12a1a0437d None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:14.077669 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-3b9183af-654c-477a-8dde-ce12a1a0437d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 07 14:21:14.077669 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:14.077669 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:14.077669 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:14.077669 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:14.077669 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:14.077669 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:14.077669 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:14.077669 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:14.077669 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:14.077669 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:14.077669 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:14.077669 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 14:21:14.077669 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 14:21:14.077669 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 14:21:14.077669 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 14:21:14.079217 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:14.079217 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:14.079217 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 14:21:14.079217 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:21:14.079217 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 14:21:14.079217 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:21:14.079217 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:14.079217 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:14.079217 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:14.079217 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:14.079217 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:14.079217 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:14.079217 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:14.079217 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:14.079217 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:14.079217 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:14.079217 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:14.079217 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:14.080176 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:14.080176 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:14.080176 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 14:21:14.080176 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 14:21:14.080176 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 14:21:14.080176 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 14:21:14.080176 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 14:21:14.080176 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 14:21:14.080176 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 07 14:21:14.080176 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:21:14.082754 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 278/558] 10.222.0.86 () {56 vars in 1093 bytes} [Tue Jun 7 14:21:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:21:14.082867 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0b0e3e-b135-42bb-8221-0dd636030d0b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:14.083678 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9183af-654c-477a-8dde-ce12a1a0437d None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:14.084752 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0b0e3e-b135-42bb-8221-0dd636030d0b None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:14.135938 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:14.194232 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 281/559] 10.222.0.86 () {58 vars in 1282 bytes} [Tue Jun 7 14:21:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 07 14:21:14.195190 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0b0e3e-b135-42bb-8221-0dd636030d0b None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:14.198046 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9183af-654c-477a-8dde-ce12a1a0437d None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:14.221512 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:14.244525 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af9d61f-0dfb-4773-8bac-9db8b1e2dd1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:14.244525 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af9d61f-0dfb-4773-8bac-9db8b1e2dd1a None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:14.244525 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af9d61f-0dfb-4773-8bac-9db8b1e2dd1a None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:14.244525 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af9d61f-0dfb-4773-8bac-9db8b1e2dd1a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:14.258078 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af9d61f-0dfb-4773-8bac-9db8b1e2dd1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:21:14.266679 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-2af9d61f-0dfb-4773-8bac-9db8b1e2dd1a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 07 14:21:14.266679 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:14.266679 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:14.266679 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:14.266679 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:14.266679 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:14.266679 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:14.266679 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:14.266679 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:14.266679 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:14.266679 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:14.266679 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:14.266679 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:21:14.266679 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:21:14.266679 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:21:14.266679 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:21:14.268795 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:21:14.268795 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:21:14.268795 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:21:14.268795 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:21:14.268795 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:14.268795 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:14.268795 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:14.268795 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:14.268795 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:14.268795 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:14.268795 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:14.268795 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:14.268795 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:14.268795 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:14.268795 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:14.268795 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:14.270199 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:14.270199 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:14.270199 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:14.270199 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:14.270199 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:21:14.270199 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:21:14.270199 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:21:14.270199 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:21:14.270199 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:21:14.270199 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:21:14.270199 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 07 14:21:14.270199 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:21:14.270199 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 279/560] 10.222.0.86 () {56 vars in 1102 bytes} [Tue Jun 7 14:21:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:21:14.270199 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af9d61f-0dfb-4773-8bac-9db8b1e2dd1a None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:14.307315 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0b0e3e-b135-42bb-8221-0dd636030d0b None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:14.343147 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b10fbd3-0106-4866-85a7-76d2917cd124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:14.343848 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b10fbd3-0106-4866-85a7-76d2917cd124 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:14.344133 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b10fbd3-0106-4866-85a7-76d2917cd124 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:14.344414 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b10fbd3-0106-4866-85a7-76d2917cd124 None admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:14.345256 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b10fbd3-0106-4866-85a7-76d2917cd124 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:14.345568 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b10fbd3-0106-4866-85a7-76d2917cd124 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:14.347113 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b10fbd3-0106-4866-85a7-76d2917cd124 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:14.366767 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 282/561] 10.222.0.86 () {56 vars in 1133 bytes} [Tue Jun 7 14:21:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:14.367611 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b10fbd3-0106-4866-85a7-76d2917cd124 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:14.371128 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:14.387586 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af9d61f-0dfb-4773-8bac-9db8b1e2dd1a None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:14.430480 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c6562d-3d45-46c7-b896-1aa21269d9ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:14.431543 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c6562d-3d45-46c7-b896-1aa21269d9ea None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:14.432027 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c6562d-3d45-46c7-b896-1aa21269d9ea None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:14.432547 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c6562d-3d45-46c7-b896-1aa21269d9ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:14.445514 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c6562d-3d45-46c7-b896-1aa21269d9ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:14.447179 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c6562d-3d45-46c7-b896-1aa21269d9ea None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:14.467150 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-10c6562d-3d45-46c7-b896-1aa21269d9ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:21:14.467150 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:14.467150 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:14.467150 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:14.467150 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:14.467150 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:14.467150 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:14.467150 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:14.467150 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:14.467150 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:14.467150 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:14.467150 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:14.467150 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:21:14.467150 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:21:14.467150 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:21:14.468353 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:21:14.468353 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:14.468353 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:14.468353 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:14.468353 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:14.468353 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:14.468353 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:14.468353 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:14.468353 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:14.468353 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:14.468353 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:14.468353 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:14.468353 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:14.468353 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:14.468353 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:14.468353 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:14.468353 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:14.469393 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:21:14.469393 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:21:14.469393 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:21:14.469393 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:21:14.471471 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 280/562] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jun 7 14:21:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:21:14.472616 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c6562d-3d45-46c7-b896-1aa21269d9ea None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:14.476469 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b10fbd3-0106-4866-85a7-76d2917cd124 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:14.506862 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:14.512243 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a642788-39b4-4e0b-8362-6492a65e8199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:14.512922 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a642788-39b4-4e0b-8362-6492a65e8199 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:14.520735 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a642788-39b4-4e0b-8362-6492a65e8199 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:14.520735 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a642788-39b4-4e0b-8362-6492a65e8199 None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:14.520735 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a642788-39b4-4e0b-8362-6492a65e8199 None admin] RBAC: Adding query filter params (name=service) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:14.520735 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a642788-39b4-4e0b-8362-6492a65e8199 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:14.520735 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a642788-39b4-4e0b-8362-6492a65e8199 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:14.525148 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 283/563] 10.222.0.86 () {56 vars in 1103 bytes} [Tue Jun 7 14:21:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:14.526072 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a642788-39b4-4e0b-8362-6492a65e8199 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:14.586842 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c6562d-3d45-46c7-b896-1aa21269d9ea None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:14.599502 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:14.625713 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194506a7-76d3-4e0b-9fe5-8470ce35e2e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:14.627272 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194506a7-76d3-4e0b-9fe5-8470ce35e2e6 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:14.628030 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194506a7-76d3-4e0b-9fe5-8470ce35e2e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:14.628576 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194506a7-76d3-4e0b-9fe5-8470ce35e2e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:14.635094 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a642788-39b4-4e0b-8362-6492a65e8199 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:14.640223 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194506a7-76d3-4e0b-9fe5-8470ce35e2e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:14.641679 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194506a7-76d3-4e0b-9fe5-8470ce35e2e6 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:14.659612 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-194506a7-76d3-4e0b-9fe5-8470ce35e2e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:21:14.659612 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:14.659612 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:14.659612 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:14.659612 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:14.659612 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:14.659612 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:14.659612 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:14.659612 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:14.659612 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:14.659612 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:14.659612 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:14.659612 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:21:14.659612 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:21:14.659612 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:21:14.660530 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:21:14.660530 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:14.660530 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:14.660530 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:14.660530 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:14.660530 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:14.660530 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:14.660530 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:14.660530 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:14.660530 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:14.660530 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:14.660530 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:14.660530 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:14.660530 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:14.660530 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:14.660530 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:14.660530 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:14.661394 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:21:14.661394 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:21:14.661394 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:21:14.661394 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:21:14.661394 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 281/564] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jun 7 14:21:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:21:14.661667 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194506a7-76d3-4e0b-9fe5-8470ce35e2e6 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:14.678019 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b789f79-5832-43bd-b07e-7485051d5c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:14.678689 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b789f79-5832-43bd-b07e-7485051d5c01 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:14.678973 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b789f79-5832-43bd-b07e-7485051d5c01 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:14.679252 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b789f79-5832-43bd-b07e-7485051d5c01 None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:14.680164 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b789f79-5832-43bd-b07e-7485051d5c01 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:14.680476 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b789f79-5832-43bd-b07e-7485051d5c01 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:14.681944 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b789f79-5832-43bd-b07e-7485051d5c01 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:14.699582 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 284/565] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jun 7 14:21:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:14.699582 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a300f475-5dcd-4948-a335-1f7bb47073a7 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:14.699582 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a300f475-5dcd-4948-a335-1f7bb47073a7 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:14.699582 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a300f475-5dcd-4948-a335-1f7bb47073a7 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:14.699582 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 285/566] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:21:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:21:14.699582 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a300f475-5dcd-4948-a335-1f7bb47073a7 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:14.752859 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:14.770975 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194506a7-76d3-4e0b-9fe5-8470ce35e2e6 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:14.801461 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a300f475-5dcd-4948-a335-1f7bb47073a7 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:14.803674 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0808b250-5e4b-4257-b16c-57c03cbb0af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:14.804492 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0808b250-5e4b-4257-b16c-57c03cbb0af2 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:14.804777 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0808b250-5e4b-4257-b16c-57c03cbb0af2 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:14.805052 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0808b250-5e4b-4257-b16c-57c03cbb0af2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:14.815219 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0808b250-5e4b-4257-b16c-57c03cbb0af2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:14.816704 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0808b250-5e4b-4257-b16c-57c03cbb0af2 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:14.826850 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:14.833756 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-0808b250-5e4b-4257-b16c-57c03cbb0af2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:21:14.833756 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:14.833756 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:14.833756 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:14.833756 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:14.833756 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:14.833756 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:14.833756 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:14.833756 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:14.833756 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:14.833756 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:14.833756 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:14.833756 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:21:14.833756 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:21:14.833756 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:21:14.834815 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:21:14.834815 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:14.834815 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:14.834815 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:14.834815 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:14.834815 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:14.834815 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:14.834815 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:14.834815 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:14.834815 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:14.834815 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:14.834815 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:14.834815 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:14.834815 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:14.834815 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:14.834815 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:14.834815 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:14.835918 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:21:14.835918 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:21:14.835918 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:21:14.835918 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:21:14.835918 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 282/567] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jun 7 14:21:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:21:14.835918 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0808b250-5e4b-4257-b16c-57c03cbb0af2 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:14.837564 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b122b8-4409-4e40-90b6-3d11cbc2c1f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:14.838183 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b122b8-4409-4e40-90b6-3d11cbc2c1f1 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:14.838470 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b122b8-4409-4e40-90b6-3d11cbc2c1f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:14.838750 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b122b8-4409-4e40-90b6-3d11cbc2c1f1 None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:14.839847 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b122b8-4409-4e40-90b6-3d11cbc2c1f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:14.839847 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b122b8-4409-4e40-90b6-3d11cbc2c1f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:14.841824 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b122b8-4409-4e40-90b6-3d11cbc2c1f1 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:14.853255 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 286/568] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jun 7 14:21:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:14.854290 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5490c299-585e-4515-b211-0de32e7ad3e5 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:14.854587 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5490c299-585e-4515-b211-0de32e7ad3e5 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:14.854869 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5490c299-585e-4515-b211-0de32e7ad3e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:14.870749 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-5490c299-585e-4515-b211-0de32e7ad3e5 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:21:14.871977 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-5490c299-585e-4515-b211-0de32e7ad3e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:21:14.936486 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0808b250-5e4b-4257-b16c-57c03cbb0af2 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:14.937567 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 287/569] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:21:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 14:21:14.938941 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120b69a4-3d5e-47b2-855a-230a2813aec4 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:14.939226 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120b69a4-3d5e-47b2-855a-230a2813aec4 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:14.939510 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120b69a4-3d5e-47b2-855a-230a2813aec4 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:14.940807 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 288/570] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:21:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:21:14.943655 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120b69a4-3d5e-47b2-855a-230a2813aec4 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:14.974772 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b23a79e-66b4-42f4-8bca-cdb471cc3989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:14.975558 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b23a79e-66b4-42f4-8bca-cdb471cc3989 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:14.975869 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b23a79e-66b4-42f4-8bca-cdb471cc3989 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:14.976147 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b23a79e-66b4-42f4-8bca-cdb471cc3989 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:14.978025 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:14.983192 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b23a79e-66b4-42f4-8bca-cdb471cc3989 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:14.984646 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b23a79e-66b4-42f4-8bca-cdb471cc3989 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:14.999522 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-4b23a79e-66b4-42f4-8bca-cdb471cc3989 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:21:14.999522 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:14.999522 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:14.999522 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:14.999522 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:14.999522 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:14.999522 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:14.999522 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:14.999522 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:14.999522 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:14.999522 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:14.999522 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:14.999522 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 14:21:14.999522 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 14:21:14.999522 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 14:21:15.000587 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 14:21:15.000587 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:15.000587 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:15.000587 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:15.000587 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:15.000587 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:15.000587 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:15.000587 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:15.000587 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:15.000587 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:15.000587 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:15.000587 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:15.000587 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:15.000587 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:15.000587 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:15.000587 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:15.000587 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:15.001656 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 14:21:15.001656 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 14:21:15.001656 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 14:21:15.001656 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 14:21:15.001656 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 14:21:15.001656 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 14:21:15.001656 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:21:15.001656 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:21:15.001656 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 283/571] 10.222.0.86 () {56 vars in 1111 bytes} [Tue Jun 7 14:21:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:21:15.001656 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b23a79e-66b4-42f4-8bca-cdb471cc3989 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:15.049635 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120b69a4-3d5e-47b2-855a-230a2813aec4 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:15.065835 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:15.082878 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f034bd-6573-4b62-976c-fa4ce9a97a27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:15.083531 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f034bd-6573-4b62-976c-fa4ce9a97a27 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:15.085992 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f034bd-6573-4b62-976c-fa4ce9a97a27 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:15.085992 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f034bd-6573-4b62-976c-fa4ce9a97a27 None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:15.085992 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f034bd-6573-4b62-976c-fa4ce9a97a27 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:15.085992 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f034bd-6573-4b62-976c-fa4ce9a97a27 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:15.086452 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f034bd-6573-4b62-976c-fa4ce9a97a27 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:15.097304 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 289/572] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jun 7 14:21:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:15.098218 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b23a79e-66b4-42f4-8bca-cdb471cc3989 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:15.098421 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3002461c-af64-4181-9015-372b8bb2ca8c None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:15.098710 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3002461c-af64-4181-9015-372b8bb2ca8c None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:15.098988 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3002461c-af64-4181-9015-372b8bb2ca8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:15.115851 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-3002461c-af64-4181-9015-372b8bb2ca8c None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:21:15.117032 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-3002461c-af64-4181-9015-372b8bb2ca8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:21:15.134647 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e471b2-9d6c-4a74-8d5b-770110ecb365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:15.135435 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e471b2-9d6c-4a74-8d5b-770110ecb365 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:15.135716 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e471b2-9d6c-4a74-8d5b-770110ecb365 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:15.136022 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e471b2-9d6c-4a74-8d5b-770110ecb365 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:15.143127 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e471b2-9d6c-4a74-8d5b-770110ecb365 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:15.144573 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e471b2-9d6c-4a74-8d5b-770110ecb365 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:15.157873 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-81e471b2-9d6c-4a74-8d5b-770110ecb365 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:21:15.157873 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:15.157873 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:15.157873 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:15.157873 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:15.157873 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:15.157873 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:15.157873 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:15.157873 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:15.157873 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:15.157873 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:15.157873 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:15.157873 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 14:21:15.157873 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 14:21:15.157873 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 14:21:15.158873 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 14:21:15.158873 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:15.158873 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:15.158873 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:15.158873 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:15.158873 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:15.158873 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:15.158873 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:15.158873 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:15.158873 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:15.158873 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:15.158873 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:15.158873 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:15.158873 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:15.158873 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:15.158873 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:15.158873 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:15.160152 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 14:21:15.160152 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 14:21:15.160152 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 14:21:15.160152 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 14:21:15.160152 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 14:21:15.160152 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 14:21:15.160152 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:21:15.160152 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:21:15.160152 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 284/573] 10.222.0.86 () {56 vars in 1111 bytes} [Tue Jun 7 14:21:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:21:15.160152 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e471b2-9d6c-4a74-8d5b-770110ecb365 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:15.187133 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 290/574] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:21:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 14:21:15.188019 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3002461c-af64-4181-9015-372b8bb2ca8c None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:15.218849 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:15.263576 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e471b2-9d6c-4a74-8d5b-770110ecb365 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:15.293439 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3002461c-af64-4181-9015-372b8bb2ca8c None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:15.296512 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16565cb6-810d-4615-84cd-52b440a1b163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:15.297308 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16565cb6-810d-4615-84cd-52b440a1b163 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:15.297596 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16565cb6-810d-4615-84cd-52b440a1b163 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:15.297870 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16565cb6-810d-4615-84cd-52b440a1b163 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:15.301167 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:15.307931 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16565cb6-810d-4615-84cd-52b440a1b163 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:21:15.316290 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-16565cb6-810d-4615-84cd-52b440a1b163 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 07 14:21:15.316290 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:15.316290 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:15.316290 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:15.316290 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:15.316290 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:15.316290 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:15.316290 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:15.316290 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:15.316290 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:15.316290 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:15.316290 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:15.316290 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:21:15.316290 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:21:15.316290 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:21:15.316290 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:21:15.317281 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:21:15.317281 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:21:15.317281 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:21:15.317281 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:21:15.317281 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:15.317281 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:15.317281 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:15.317281 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:15.317281 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:15.317281 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:15.317281 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:15.317281 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:15.317281 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:15.317281 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:15.317281 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:15.317281 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:15.318090 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:15.318090 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:15.318090 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:15.318090 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:15.318090 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:21:15.318090 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:21:15.318090 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:21:15.318090 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:21:15.318090 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:21:15.318090 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:21:15.318090 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 07 14:21:15.318090 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:21:15.318090 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 285/575] 10.222.0.86 () {56 vars in 1102 bytes} [Tue Jun 7 14:21:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:21:15.318755 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16565cb6-810d-4615-84cd-52b440a1b163 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:15.332461 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7802e658-bdda-44d6-bb12-0d8b7535a558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:15.333128 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7802e658-bdda-44d6-bb12-0d8b7535a558 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:15.333782 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7802e658-bdda-44d6-bb12-0d8b7535a558 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:15.334091 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7802e658-bdda-44d6-bb12-0d8b7535a558 None admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:15.334895 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7802e658-bdda-44d6-bb12-0d8b7535a558 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:15.335207 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7802e658-bdda-44d6-bb12-0d8b7535a558 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:15.336687 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7802e658-bdda-44d6-bb12-0d8b7535a558 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:15.348336 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 291/576] 10.222.0.86 () {56 vars in 1148 bytes} [Tue Jun 7 14:21:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:15.349051 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7802e658-bdda-44d6-bb12-0d8b7535a558 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:15.423023 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16565cb6-810d-4615-84cd-52b440a1b163 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:15.436971 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:15.447037 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7802e658-bdda-44d6-bb12-0d8b7535a558 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:15.456441 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0d5725-4686-4887-8e27-4b4dcd218c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:15.457234 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0d5725-4686-4887-8e27-4b4dcd218c3b None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:15.457520 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0d5725-4686-4887-8e27-4b4dcd218c3b None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:15.457798 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0d5725-4686-4887-8e27-4b4dcd218c3b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:15.465320 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0d5725-4686-4887-8e27-4b4dcd218c3b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:15.466813 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0d5725-4686-4887-8e27-4b4dcd218c3b None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:15.479301 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eea6af-be66-4cdf-809c-38a0f7e45b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:15.479985 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eea6af-be66-4cdf-809c-38a0f7e45b70 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:15.480273 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eea6af-be66-4cdf-809c-38a0f7e45b70 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:15.480551 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eea6af-be66-4cdf-809c-38a0f7e45b70 None admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:15.481361 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eea6af-be66-4cdf-809c-38a0f7e45b70 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:15.481674 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eea6af-be66-4cdf-809c-38a0f7e45b70 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:15.482327 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-ef0d5725-4686-4887-8e27-4b4dcd218c3b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 07 14:21:15.482327 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:15.482327 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:15.482327 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:15.482327 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:15.482327 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:15.482327 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:15.482327 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:15.482327 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:15.482327 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:15.482327 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:15.482327 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:15.482327 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 14:21:15.482327 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 14:21:15.482327 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 14:21:15.482327 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 14:21:15.483388 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:15.483388 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:15.483388 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 14:21:15.483388 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:21:15.483388 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 14:21:15.483388 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:21:15.483388 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:15.483388 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:15.483388 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:15.483388 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:15.483388 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:15.483388 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:15.483388 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:15.483388 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:15.483388 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:15.483388 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:15.483388 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:15.483388 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:15.484358 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:15.484358 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:15.484358 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 14:21:15.484358 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 14:21:15.484358 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 14:21:15.484358 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 14:21:15.484358 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 14:21:15.484358 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 14:21:15.484358 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 07 14:21:15.484358 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:21:15.484358 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 286/577] 10.222.0.86 () {56 vars in 1099 bytes} [Tue Jun 7 14:21:15 2022] GET /identity/v3/users/cinder => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:21:15.484921 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eea6af-be66-4cdf-809c-38a0f7e45b70 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:15.484990 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0d5725-4686-4887-8e27-4b4dcd218c3b None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:15.499419 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 292/578] 10.222.0.86 () {56 vars in 1148 bytes} [Tue Jun 7 14:21:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:15.500251 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eea6af-be66-4cdf-809c-38a0f7e45b70 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:15.527070 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:15.587031 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0d5725-4686-4887-8e27-4b4dcd218c3b None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:15.600194 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eea6af-be66-4cdf-809c-38a0f7e45b70 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:15.619502 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064f246e-6d31-4be8-afc7-d72978eae9a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:15.620315 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064f246e-6d31-4be8-afc7-d72978eae9a9 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:15.620599 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064f246e-6d31-4be8-afc7-d72978eae9a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:15.620871 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064f246e-6d31-4be8-afc7-d72978eae9a9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:15.631130 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064f246e-6d31-4be8-afc7-d72978eae9a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:21:15.634438 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcbd600-f75a-4904-9ffd-74a709e4a6d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:15.635101 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcbd600-f75a-4904-9ffd-74a709e4a6d3 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:15.635386 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcbd600-f75a-4904-9ffd-74a709e4a6d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:15.635661 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcbd600-f75a-4904-9ffd-74a709e4a6d3 None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:15.636445 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcbd600-f75a-4904-9ffd-74a709e4a6d3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:15.636753 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcbd600-f75a-4904-9ffd-74a709e4a6d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:15.638117 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcbd600-f75a-4904-9ffd-74a709e4a6d3 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:15.638771 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-064f246e-6d31-4be8-afc7-d72978eae9a9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 07 14:21:15.638771 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:15.638771 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:15.638771 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:15.638771 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:15.638771 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:15.638771 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:15.638771 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:15.638771 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:15.638771 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:15.638771 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:15.638771 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:15.638771 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:21:15.638771 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:21:15.638771 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:21:15.638771 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:21:15.639858 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:21:15.639858 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:21:15.639858 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:21:15.639858 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:21:15.639858 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:15.639858 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:15.639858 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:15.639858 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:15.639858 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:15.639858 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:15.639858 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:15.639858 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:15.639858 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:15.639858 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:15.639858 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:15.639858 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:15.640876 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:15.640876 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:15.640876 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:15.640876 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:15.640876 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:21:15.640876 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:21:15.640876 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:21:15.640876 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:21:15.640876 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:21:15.640876 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:21:15.640876 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 07 14:21:15.640876 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:21:15.640876 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 287/579] 10.222.0.86 () {56 vars in 1102 bytes} [Tue Jun 7 14:21:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:21:15.640876 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064f246e-6d31-4be8-afc7-d72978eae9a9 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:15.650994 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 293/580] 10.222.0.86 () {56 vars in 1103 bytes} [Tue Jun 7 14:21:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:15.651963 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcbd600-f75a-4904-9ffd-74a709e4a6d3 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:15.674669 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:15.737366 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064f246e-6d31-4be8-afc7-d72978eae9a9 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:15.739688 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:15.751838 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcbd600-f75a-4904-9ffd-74a709e4a6d3 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:15.770818 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7addb178-175c-4920-baea-b0338d42b199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:15.771466 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7addb178-175c-4920-baea-b0338d42b199 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:15.771782 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7addb178-175c-4920-baea-b0338d42b199 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:15.772063 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7addb178-175c-4920-baea-b0338d42b199 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:15.772896 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7addb178-175c-4920-baea-b0338d42b199 None admin] RBAC: Adding query filter params (role.id=28e9b75018ac44c0afe7ab728071f2d5, scope.project.id=e429537b190c4c5ea7e1332ab044ca7a, user.id=c9774349dd2b4ec092ef04c3df050a7e) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:15.773213 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7addb178-175c-4920-baea-b0338d42b199 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:15.774640 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7addb178-175c-4920-baea-b0338d42b199 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:15.780493 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 288/581] 10.222.0.86 () {56 vars in 1374 bytes} [Tue Jun 7 14:21:15 2022] GET /identity/v3/role_assignments?user.id=c9774349dd2b4ec092ef04c3df050a7e&scope.project.id=e429537b190c4c5ea7e1332ab044ca7a&role.id=28e9b75018ac44c0afe7ab728071f2d5 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:15.781245 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7addb178-175c-4920-baea-b0338d42b199 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:15.795329 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d33676-6634-4b5c-9bd4-c4f47bbb8185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:15.796311 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d33676-6634-4b5c-9bd4-c4f47bbb8185 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:15.796606 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d33676-6634-4b5c-9bd4-c4f47bbb8185 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:15.796891 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d33676-6634-4b5c-9bd4-c4f47bbb8185 None admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:15.797778 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d33676-6634-4b5c-9bd4-c4f47bbb8185 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:15.798098 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d33676-6634-4b5c-9bd4-c4f47bbb8185 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:15.799642 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d33676-6634-4b5c-9bd4-c4f47bbb8185 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:15.826762 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 294/582] 10.222.0.86 () {56 vars in 1137 bytes} [Tue Jun 7 14:21:15 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:15.826762 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d33676-6634-4b5c-9bd4-c4f47bbb8185 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:15.895450 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:15.898990 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7addb178-175c-4920-baea-b0338d42b199 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:15.937163 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7696f0f-fdf7-4a01-8a37-4d6043fae864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:15.938066 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7696f0f-fdf7-4a01-8a37-4d6043fae864 None admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:15.938352 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7696f0f-fdf7-4a01-8a37-4d6043fae864 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:15.938643 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7696f0f-fdf7-4a01-8a37-4d6043fae864 None admin] PATH_INFO: `/v3/projects/e429537b190c4c5ea7e1332ab044ca7a/users/b99cfb70f54c45c8870369359da20378/roles/28e9b75018ac44c0afe7ab728071f2d5` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:15.944715 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d33676-6634-4b5c-9bd4-c4f47bbb8185 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:15.954256 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7696f0f-fdf7-4a01-8a37-4d6043fae864 None admin] RBAC: Authorizing `identity:create_grant(project_id=e429537b190c4c5ea7e1332ab044ca7a, user_id=b99cfb70f54c45c8870369359da20378, role_id=28e9b75018ac44c0afe7ab728071f2d5)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:15.955735 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7696f0f-fdf7-4a01-8a37-4d6043fae864 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:15.983721 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e223a7-607d-4c36-8d51-d5175787aedd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:15.984421 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e223a7-607d-4c36-8d51-d5175787aedd None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:15.984709 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e223a7-607d-4c36-8d51-d5175787aedd None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:15.984985 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e223a7-607d-4c36-8d51-d5175787aedd None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:15.985736 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e223a7-607d-4c36-8d51-d5175787aedd None admin] RBAC: Adding query filter params (name=service) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:15.986044 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e223a7-607d-4c36-8d51-d5175787aedd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:15.987405 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e223a7-607d-4c36-8d51-d5175787aedd None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:15.995736 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 295/583] 10.222.0.86 () {56 vars in 1103 bytes} [Tue Jun 7 14:21:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:15.996562 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e223a7-607d-4c36-8d51-d5175787aedd None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:16.008317 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:16.051822 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 289/584] 10.222.0.86 () {58 vars in 1439 bytes} [Tue Jun 7 14:21:15 2022] PUT /identity/v3/projects/e429537b190c4c5ea7e1332ab044ca7a/users/b99cfb70f54c45c8870369359da20378/roles/28e9b75018ac44c0afe7ab728071f2d5 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:21:16.051822 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7696f0f-fdf7-4a01-8a37-4d6043fae864 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:16.122255 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e223a7-607d-4c36-8d51-d5175787aedd None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:16.181625 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9c32d0-3c16-4aaa-9694-72163f5d2a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:16.182882 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9c32d0-3c16-4aaa-9694-72163f5d2a76 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:16.183515 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9c32d0-3c16-4aaa-9694-72163f5d2a76 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:16.184100 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9c32d0-3c16-4aaa-9694-72163f5d2a76 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:16.192952 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7696f0f-fdf7-4a01-8a37-4d6043fae864 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:16.210005 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9c32d0-3c16-4aaa-9694-72163f5d2a76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:16.212895 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9c32d0-3c16-4aaa-9694-72163f5d2a76 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:16.242620 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-ce9c32d0-3c16-4aaa-9694-72163f5d2a76 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:21:16.242620 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:16.242620 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:16.242620 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:16.242620 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:16.242620 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:16.242620 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:16.242620 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:16.242620 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:16.242620 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:16.242620 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:16.242620 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:16.242620 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:21:16.242620 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:21:16.242620 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:21:16.243543 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:21:16.243543 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:16.243543 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:16.243543 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:16.243543 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:16.243543 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:16.243543 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:16.243543 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:16.243543 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:16.243543 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:16.243543 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:16.243543 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:16.243543 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:16.243543 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:16.243543 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:16.243543 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:16.243543 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:16.244441 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:21:16.244441 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:21:16.244441 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:21:16.244441 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:21:16.244441 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 296/585] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jun 7 14:21:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:21:16.244441 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9c32d0-3c16-4aaa-9694-72163f5d2a76 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:16.248766 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c528d6-4b5a-4e6f-a431-ec01290aed53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:16.250742 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c528d6-4b5a-4e6f-a431-ec01290aed53 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:16.251032 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c528d6-4b5a-4e6f-a431-ec01290aed53 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:16.251315 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c528d6-4b5a-4e6f-a431-ec01290aed53 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:16.264555 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c528d6-4b5a-4e6f-a431-ec01290aed53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:16.266437 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c528d6-4b5a-4e6f-a431-ec01290aed53 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:16.278097 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:16.289413 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-70c528d6-4b5a-4e6f-a431-ec01290aed53 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:21:16.289413 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:16.289413 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:16.289413 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:16.289413 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:16.289413 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:16.289413 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:16.289413 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:16.289413 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:16.289413 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:16.289413 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:16.289413 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:16.289413 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:21:16.289413 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:21:16.289413 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:21:16.290642 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:21:16.290642 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:16.290642 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:16.290642 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:16.290642 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:16.290642 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:16.290642 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:16.290642 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:16.290642 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:16.290642 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:16.290642 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:16.290642 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:16.290642 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:16.290642 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:16.290642 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:16.290642 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:16.290642 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:16.291503 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:21:16.291503 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:21:16.291503 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:21:16.291503 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:21:16.291503 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 290/586] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jun 7 14:21:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:21:16.291503 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c528d6-4b5a-4e6f-a431-ec01290aed53 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:16.320936 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:16.370785 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9c32d0-3c16-4aaa-9694-72163f5d2a76 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:16.403976 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c528d6-4b5a-4e6f-a431-ec01290aed53 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:16.415300 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f7f6e6-1e69-4a28-a3ce-ed5696254a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:16.416708 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f7f6e6-1e69-4a28-a3ce-ed5696254a9e None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:16.417002 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f7f6e6-1e69-4a28-a3ce-ed5696254a9e None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:16.417287 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f7f6e6-1e69-4a28-a3ce-ed5696254a9e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:16.430171 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f7f6e6-1e69-4a28-a3ce-ed5696254a9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:16.431817 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f7f6e6-1e69-4a28-a3ce-ed5696254a9e None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:16.446148 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dd95dc-7fcb-4977-b7dd-eccc383305c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:16.446814 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dd95dc-7fcb-4977-b7dd-eccc383305c3 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:16.447096 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dd95dc-7fcb-4977-b7dd-eccc383305c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:16.447371 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dd95dc-7fcb-4977-b7dd-eccc383305c3 None admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:16.448120 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dd95dc-7fcb-4977-b7dd-eccc383305c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:16.448431 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dd95dc-7fcb-4977-b7dd-eccc383305c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:16.449780 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dd95dc-7fcb-4977-b7dd-eccc383305c3 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:16.451024 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-23f7f6e6-1e69-4a28-a3ce-ed5696254a9e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:21:16.451024 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:16.451024 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:16.451024 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:16.451024 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:16.451024 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:16.451024 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:16.451024 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:16.451024 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:16.451024 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:16.451024 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:16.451024 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:16.451024 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:21:16.451024 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:21:16.451024 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:21:16.452056 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:21:16.452056 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:16.452056 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:16.452056 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:16.452056 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:16.452056 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:16.452056 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:16.452056 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:16.452056 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:16.452056 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:16.452056 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:16.452056 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:16.452056 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:16.452056 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:16.452056 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:16.452056 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:16.452056 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:16.453164 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:21:16.453164 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:21:16.453164 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:21:16.453164 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:21:16.454539 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 297/587] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jun 7 14:21:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:21:16.455480 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f7f6e6-1e69-4a28-a3ce-ed5696254a9e None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:16.462836 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 291/588] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jun 7 14:21:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:16.463870 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dd95dc-7fcb-4977-b7dd-eccc383305c3 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:16.528426 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:16.557687 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f7f6e6-1e69-4a28-a3ce-ed5696254a9e None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:16.574025 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dd95dc-7fcb-4977-b7dd-eccc383305c3 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:16.580113 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:16.592076 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c7c40c-aa5f-4018-a2fc-7c36688a6392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:16.592756 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c7c40c-aa5f-4018-a2fc-7c36688a6392 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:16.593025 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c7c40c-aa5f-4018-a2fc-7c36688a6392 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:16.593297 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c7c40c-aa5f-4018-a2fc-7c36688a6392 None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:16.594017 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c7c40c-aa5f-4018-a2fc-7c36688a6392 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:16.599595 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c7c40c-aa5f-4018-a2fc-7c36688a6392 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:16.599595 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c7c40c-aa5f-4018-a2fc-7c36688a6392 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:16.613076 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 298/589] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jun 7 14:21:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:16.613076 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c7c40c-aa5f-4018-a2fc-7c36688a6392 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:16.619733 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36899afb-6899-40dd-98f0-26ef4bf9d269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:16.620690 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36899afb-6899-40dd-98f0-26ef4bf9d269 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:16.621158 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36899afb-6899-40dd-98f0-26ef4bf9d269 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:16.621616 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36899afb-6899-40dd-98f0-26ef4bf9d269 None admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:16.622560 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36899afb-6899-40dd-98f0-26ef4bf9d269 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:16.623052 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36899afb-6899-40dd-98f0-26ef4bf9d269 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:16.624637 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36899afb-6899-40dd-98f0-26ef4bf9d269 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:16.638532 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 292/590] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jun 7 14:21:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:16.639804 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36899afb-6899-40dd-98f0-26ef4bf9d269 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:16.712837 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c7c40c-aa5f-4018-a2fc-7c36688a6392 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:16.747585 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a368e5c7-acf4-4102-a22d-81243c5cbbb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:16.748392 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a368e5c7-acf4-4102-a22d-81243c5cbbb8 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:16.748671 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a368e5c7-acf4-4102-a22d-81243c5cbbb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:16.748945 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a368e5c7-acf4-4102-a22d-81243c5cbbb8 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:16.753183 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36899afb-6899-40dd-98f0-26ef4bf9d269 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:16.755987 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a368e5c7-acf4-4102-a22d-81243c5cbbb8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:16.757527 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a368e5c7-acf4-4102-a22d-81243c5cbbb8 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:16.771984 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-a368e5c7-acf4-4102-a22d-81243c5cbbb8 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 07 14:21:16.771984 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:16.771984 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:16.771984 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:16.771984 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:16.771984 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:16.771984 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:16.771984 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:16.771984 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:16.771984 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:16.771984 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:16.771984 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:16.771984 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 14:21:16.771984 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 14:21:16.771984 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 14:21:16.771984 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 14:21:16.772959 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:16.772959 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:16.772959 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 14:21:16.772959 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:21:16.772959 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 14:21:16.772959 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:21:16.772959 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:16.772959 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:16.772959 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:16.772959 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:16.772959 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:16.772959 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:16.772959 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:16.772959 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:16.772959 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:16.772959 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:16.772959 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:16.772959 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:16.774335 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:16.774335 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:16.774335 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 14:21:16.774335 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 14:21:16.774335 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 14:21:16.774335 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 14:21:16.774335 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 14:21:16.774335 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 14:21:16.774335 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 07 14:21:16.774335 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:21:16.774335 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 299/591] 10.222.0.86 () {56 vars in 1099 bytes} [Tue Jun 7 14:21:16 2022] GET /identity/v3/users/glance => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:21:16.774335 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a368e5c7-acf4-4102-a22d-81243c5cbbb8 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:16.784149 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:16.796898 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde77962-755c-4bc2-97e1-6c168e690c36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:16.797957 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde77962-755c-4bc2-97e1-6c168e690c36 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:16.798346 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde77962-755c-4bc2-97e1-6c168e690c36 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:16.798781 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde77962-755c-4bc2-97e1-6c168e690c36 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:16.806678 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde77962-755c-4bc2-97e1-6c168e690c36 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:16.807155 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:16.809263 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde77962-755c-4bc2-97e1-6c168e690c36 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:16.824560 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-cde77962-755c-4bc2-97e1-6c168e690c36 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:21:16.824560 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:16.824560 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:16.824560 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:16.824560 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:16.824560 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:16.824560 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:16.824560 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:16.824560 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:16.824560 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:16.824560 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:16.824560 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:16.824560 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 14:21:16.824560 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 14:21:16.824560 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 14:21:16.825543 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 14:21:16.825543 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:16.825543 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:16.825543 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:16.825543 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:16.825543 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:16.825543 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:16.825543 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:16.825543 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:16.825543 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:16.825543 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:16.825543 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:16.825543 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:16.825543 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:16.825543 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:16.825543 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:16.825543 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:16.826478 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 14:21:16.826478 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 14:21:16.826478 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 14:21:16.826478 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 14:21:16.826478 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 14:21:16.826478 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 14:21:16.826478 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:21:16.826478 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:21:16.829173 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 293/592] 10.222.0.86 () {56 vars in 1111 bytes} [Tue Jun 7 14:21:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:21:16.830325 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde77962-755c-4bc2-97e1-6c168e690c36 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:16.876711 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a368e5c7-acf4-4102-a22d-81243c5cbbb8 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:16.947228 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dce81b-36c6-445d-8374-d9aee6e8b58e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:16.948104 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dce81b-36c6-445d-8374-d9aee6e8b58e None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:16.948387 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dce81b-36c6-445d-8374-d9aee6e8b58e None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:16.948659 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dce81b-36c6-445d-8374-d9aee6e8b58e None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:16.956742 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dce81b-36c6-445d-8374-d9aee6e8b58e None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:16.958344 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dce81b-36c6-445d-8374-d9aee6e8b58e None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:16.974496 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-c8dce81b-36c6-445d-8374-d9aee6e8b58e None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 07 14:21:16.974496 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:16.974496 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:16.974496 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:16.974496 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:16.974496 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:16.974496 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:16.974496 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:16.974496 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:16.974496 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:16.974496 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:16.974496 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:16.974496 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 14:21:16.974496 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 14:21:16.974496 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 14:21:16.974496 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 14:21:16.975452 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:16.975452 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:16.975452 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 14:21:16.975452 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:21:16.975452 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 14:21:16.975452 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:21:16.975452 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:16.975452 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:16.975452 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:16.975452 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:16.975452 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:16.975452 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:16.975452 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:16.975452 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:16.975452 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:16.975452 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:16.975452 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:16.975452 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:16.976384 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:16.976384 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:16.976384 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 14:21:16.976384 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 14:21:16.976384 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 14:21:16.976384 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 14:21:16.976384 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 14:21:16.976384 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 14:21:16.976384 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 07 14:21:16.976384 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:21:16.976384 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 300/593] 10.222.0.86 () {56 vars in 1102 bytes} [Tue Jun 7 14:21:16 2022] GET /identity/v3/users/neutron => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:21:16.976956 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dce81b-36c6-445d-8374-d9aee6e8b58e None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:16.986718 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde77962-755c-4bc2-97e1-6c168e690c36 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:17.021631 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027e4a5e-45fd-4060-81e4-d635449d7e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:17.022647 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027e4a5e-45fd-4060-81e4-d635449d7e0b None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:17.023146 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027e4a5e-45fd-4060-81e4-d635449d7e0b None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:17.023632 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027e4a5e-45fd-4060-81e4-d635449d7e0b None admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:17.024699 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027e4a5e-45fd-4060-81e4-d635449d7e0b None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:17.025206 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027e4a5e-45fd-4060-81e4-d635449d7e0b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:17.026836 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027e4a5e-45fd-4060-81e4-d635449d7e0b None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:17.045774 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 294/594] 10.222.0.86 () {56 vars in 1137 bytes} [Tue Jun 7 14:21:16 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:17.046871 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027e4a5e-45fd-4060-81e4-d635449d7e0b None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:17.078698 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:17.087225 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:17.089159 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dce81b-36c6-445d-8374-d9aee6e8b58e None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:17.125009 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f18ec3-cf92-46e6-bb94-587bfa5514e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:17.125985 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f18ec3-cf92-46e6-bb94-587bfa5514e3 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:17.126473 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f18ec3-cf92-46e6-bb94-587bfa5514e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:17.126926 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f18ec3-cf92-46e6-bb94-587bfa5514e3 None admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:17.127911 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f18ec3-cf92-46e6-bb94-587bfa5514e3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:17.128487 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f18ec3-cf92-46e6-bb94-587bfa5514e3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:17.130313 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f18ec3-cf92-46e6-bb94-587bfa5514e3 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:17.143375 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 301/595] 10.222.0.86 () {56 vars in 1148 bytes} [Tue Jun 7 14:21:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:17.144516 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f18ec3-cf92-46e6-bb94-587bfa5514e3 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:17.148177 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027e4a5e-45fd-4060-81e4-d635449d7e0b None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:17.189581 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216c5186-3bc1-4335-a48f-0b1cb750b029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:17.190432 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216c5186-3bc1-4335-a48f-0b1cb750b029 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:17.190718 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216c5186-3bc1-4335-a48f-0b1cb750b029 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:17.190991 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216c5186-3bc1-4335-a48f-0b1cb750b029 None admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:17.191969 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216c5186-3bc1-4335-a48f-0b1cb750b029 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:17.192283 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216c5186-3bc1-4335-a48f-0b1cb750b029 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:17.193809 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216c5186-3bc1-4335-a48f-0b1cb750b029 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:17.216949 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 295/596] 10.222.0.86 () {56 vars in 1139 bytes} [Tue Jun 7 14:21:17 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:17.217807 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216c5186-3bc1-4335-a48f-0b1cb750b029 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:17.290888 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f18ec3-cf92-46e6-bb94-587bfa5514e3 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:17.328652 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:17.335345 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216c5186-3bc1-4335-a48f-0b1cb750b029 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:17.340265 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fafbd5-7e26-443e-9b08-a15220143f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:17.341832 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fafbd5-7e26-443e-9b08-a15220143f0d None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:17.342130 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fafbd5-7e26-443e-9b08-a15220143f0d None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:17.342409 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fafbd5-7e26-443e-9b08-a15220143f0d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:17.356567 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fafbd5-7e26-443e-9b08-a15220143f0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:17.358680 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fafbd5-7e26-443e-9b08-a15220143f0d None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:17.374825 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d33e124-cefd-4c96-b323-34567067bc19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:17.376070 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d33e124-cefd-4c96-b323-34567067bc19 None admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:17.376583 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d33e124-cefd-4c96-b323-34567067bc19 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:17.377088 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d33e124-cefd-4c96-b323-34567067bc19 None admin] PATH_INFO: `/v3/projects/e429537b190c4c5ea7e1332ab044ca7a/users/af5a95620a4b43538abfe09eed4bf115/roles/28e9b75018ac44c0afe7ab728071f2d5` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:17.382013 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-61fafbd5-7e26-443e-9b08-a15220143f0d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:21:17.382013 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:17.382013 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:17.382013 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:17.382013 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:17.382013 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:17.382013 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:17.382013 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:17.382013 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:17.382013 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:17.382013 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:17.382013 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:17.382013 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:21:17.382013 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:21:17.382013 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:21:17.383195 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:21:17.383195 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:17.383195 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:17.383195 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:17.383195 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:17.383195 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:17.383195 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:17.383195 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:17.383195 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:17.383195 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:17.383195 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:17.383195 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:17.383195 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:17.383195 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:17.383195 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:17.383195 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:17.383195 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:17.384457 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:21:17.384457 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:21:17.384457 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:21:17.384457 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:21:17.384457 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 302/597] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jun 7 14:21:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:21:17.384457 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fafbd5-7e26-443e-9b08-a15220143f0d None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:17.388192 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:17.396265 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d33e124-cefd-4c96-b323-34567067bc19 None admin] RBAC: Authorizing `identity:create_grant(project_id=e429537b190c4c5ea7e1332ab044ca7a, user_id=af5a95620a4b43538abfe09eed4bf115, role_id=28e9b75018ac44c0afe7ab728071f2d5)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:17.398034 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d33e124-cefd-4c96-b323-34567067bc19 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:17.491358 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 296/598] 10.222.0.86 () {58 vars in 1439 bytes} [Tue Jun 7 14:21:17 2022] PUT /identity/v3/projects/e429537b190c4c5ea7e1332ab044ca7a/users/af5a95620a4b43538abfe09eed4bf115/roles/28e9b75018ac44c0afe7ab728071f2d5 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:21:17.493962 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d33e124-cefd-4c96-b323-34567067bc19 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:17.509264 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fafbd5-7e26-443e-9b08-a15220143f0d None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:17.572653 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac0c788-fd44-4023-b2a0-5a91042e0ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:17.573522 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac0c788-fd44-4023-b2a0-5a91042e0ecf None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:17.573813 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac0c788-fd44-4023-b2a0-5a91042e0ecf None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:17.574090 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac0c788-fd44-4023-b2a0-5a91042e0ecf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:17.595199 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac0c788-fd44-4023-b2a0-5a91042e0ecf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:17.597561 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac0c788-fd44-4023-b2a0-5a91042e0ecf None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:17.633559 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-8ac0c788-fd44-4023-b2a0-5a91042e0ecf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:21:17.633559 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:17.633559 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:17.633559 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:17.633559 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:17.633559 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:17.633559 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:17.633559 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:17.633559 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:17.633559 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:17.633559 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:17.633559 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:17.633559 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:21:17.633559 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:21:17.633559 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:21:17.634511 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:21:17.634511 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:17.634511 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:17.634511 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:17.634511 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:17.634511 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:17.634511 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:17.634511 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:17.634511 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:17.634511 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:17.634511 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:17.634511 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:17.634511 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:17.634511 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:17.634511 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:17.634511 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:17.634511 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:17.635361 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:21:17.635361 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:21:17.635361 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:21:17.635361 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:21:17.636201 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 303/599] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jun 7 14:21:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:21:17.647021 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac0c788-fd44-4023-b2a0-5a91042e0ecf None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:17.717838 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d33e124-cefd-4c96-b323-34567067bc19 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:17.754462 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:17.772083 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc98265-d968-4ef4-b106-7d15b27dae75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:17.772918 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc98265-d968-4ef4-b106-7d15b27dae75 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:17.773422 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc98265-d968-4ef4-b106-7d15b27dae75 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:17.773799 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc98265-d968-4ef4-b106-7d15b27dae75 None admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:17.775546 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc98265-d968-4ef4-b106-7d15b27dae75 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:17.776008 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc98265-d968-4ef4-b106-7d15b27dae75 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:17.777596 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc98265-d968-4ef4-b106-7d15b27dae75 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:17.800488 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 297/600] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jun 7 14:21:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:17.808792 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc98265-d968-4ef4-b106-7d15b27dae75 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:17.817826 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac0c788-fd44-4023-b2a0-5a91042e0ecf None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:17.819182 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:17.868478 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eb6881-d6d1-4fdb-a9b5-44921dbf30fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:17.869176 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eb6881-d6d1-4fdb-a9b5-44921dbf30fa None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:17.869497 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eb6881-d6d1-4fdb-a9b5-44921dbf30fa None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:17.869917 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eb6881-d6d1-4fdb-a9b5-44921dbf30fa None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:17.870995 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26eb6881-d6d1-4fdb-a9b5-44921dbf30fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:17.871331 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26eb6881-d6d1-4fdb-a9b5-44921dbf30fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:17.873397 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26eb6881-d6d1-4fdb-a9b5-44921dbf30fa None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:17.890555 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 304/601] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jun 7 14:21:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:21:17.895898 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eb6881-d6d1-4fdb-a9b5-44921dbf30fa None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:17.925610 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc98265-d968-4ef4-b106-7d15b27dae75 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:17.961202 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa3e196-7bac-4f49-a624-893ee416925e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:17.961994 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa3e196-7bac-4f49-a624-893ee416925e None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:17.962270 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa3e196-7bac-4f49-a624-893ee416925e None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:17.962542 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa3e196-7bac-4f49-a624-893ee416925e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:17.969578 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa3e196-7bac-4f49-a624-893ee416925e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:17.971133 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa3e196-7bac-4f49-a624-893ee416925e None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:17.986543 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-dfa3e196-7bac-4f49-a624-893ee416925e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:21:17.986543 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:17.986543 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:17.986543 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:17.986543 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:17.986543 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:17.986543 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:17.986543 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:17.986543 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:17.986543 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:17.986543 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:17.986543 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:17.986543 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 14:21:17.986543 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 14:21:17.986543 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 14:21:17.987479 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 14:21:17.987479 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:17.987479 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:17.987479 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:17.987479 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:17.987479 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:17.987479 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:17.987479 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:17.987479 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:17.987479 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:17.987479 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:17.987479 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:17.987479 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:17.987479 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:17.987479 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:17.987479 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:17.987479 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:17.988837 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 14:21:17.988837 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 14:21:17.988837 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 14:21:17.988837 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 14:21:17.988837 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 14:21:17.988837 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 14:21:17.988837 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:21:17.988837 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:21:17.988837 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 298/602] 10.222.0.86 () {56 vars in 1111 bytes} [Tue Jun 7 14:21:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:21:17.993509 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa3e196-7bac-4f49-a624-893ee416925e None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:18.101083 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eb6881-d6d1-4fdb-a9b5-44921dbf30fa None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:18.137149 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:18.142582 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:18.144545 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0fea29-b378-4835-877f-bf9d180a6ec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:18.145604 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0fea29-b378-4835-877f-bf9d180a6ec5 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:18.146973 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0fea29-b378-4835-877f-bf9d180a6ec5 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:18.147729 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0fea29-b378-4835-877f-bf9d180a6ec5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:18.165370 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0fea29-b378-4835-877f-bf9d180a6ec5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:18.167265 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0fea29-b378-4835-877f-bf9d180a6ec5 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:18.194700 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-dd0fea29-b378-4835-877f-bf9d180a6ec5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:21:18.194700 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:18.194700 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:18.194700 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:18.194700 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:18.194700 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:18.194700 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:18.194700 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:18.194700 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:18.194700 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:18.194700 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:18.194700 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:18.194700 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 14:21:18.194700 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 14:21:18.194700 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 14:21:18.195639 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 14:21:18.195639 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:18.195639 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:18.195639 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:18.195639 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:18.195639 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:18.195639 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:18.195639 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:18.195639 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:18.195639 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:18.195639 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:18.195639 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:18.195639 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:18.195639 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:18.195639 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:18.195639 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:18.195639 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:18.196911 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 14:21:18.196911 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 14:21:18.196911 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 14:21:18.196911 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 14:21:18.196911 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 14:21:18.196911 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 14:21:18.196911 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:21:18.196911 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:21:18.205244 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 305/603] 10.222.0.86 () {56 vars in 1111 bytes} [Tue Jun 7 14:21:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:21:18.212728 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0fea29-b378-4835-877f-bf9d180a6ec5 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:18.216928 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa3e196-7bac-4f49-a624-893ee416925e None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:18.262324 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df0742b-31fb-4120-a044-840e9cdd7193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:18.264380 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df0742b-31fb-4120-a044-840e9cdd7193 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:18.264970 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df0742b-31fb-4120-a044-840e9cdd7193 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:18.265458 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df0742b-31fb-4120-a044-840e9cdd7193 None admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:18.266464 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df0742b-31fb-4120-a044-840e9cdd7193 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:18.267004 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df0742b-31fb-4120-a044-840e9cdd7193 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:18.269223 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df0742b-31fb-4120-a044-840e9cdd7193 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:18.287584 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 299/604] 10.222.0.86 () {56 vars in 1148 bytes} [Tue Jun 7 14:21:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:21:18.290219 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f16fce-cf50-4169-a713-0d001edc6733 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:18.290973 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f16fce-cf50-4169-a713-0d001edc6733 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:18.292363 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f16fce-cf50-4169-a713-0d001edc6733 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:18.294771 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 300/605] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:21:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:21:18.295956 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f16fce-cf50-4169-a713-0d001edc6733 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:18.335385 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0fea29-b378-4835-877f-bf9d180a6ec5 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:18.376947 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c283e28-ebb9-4005-aff6-5d29fa478ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:18.377965 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c283e28-ebb9-4005-aff6-5d29fa478ac3 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:18.378653 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c283e28-ebb9-4005-aff6-5d29fa478ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:18.379198 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c283e28-ebb9-4005-aff6-5d29fa478ac3 None admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:18.380249 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c283e28-ebb9-4005-aff6-5d29fa478ac3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:18.380767 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c283e28-ebb9-4005-aff6-5d29fa478ac3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:18.382535 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c283e28-ebb9-4005-aff6-5d29fa478ac3 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:18.404392 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 306/606] 10.222.0.86 () {56 vars in 1148 bytes} [Tue Jun 7 14:21:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:18.406126 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff7cc6f-298d-4553-b805-9e96ca40f073 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:18.406623 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff7cc6f-298d-4553-b805-9e96ca40f073 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:18.407182 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff7cc6f-298d-4553-b805-9e96ca40f073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:18.424546 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-6ff7cc6f-298d-4553-b805-9e96ca40f073 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:21:18.426080 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-6ff7cc6f-298d-4553-b805-9e96ca40f073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:21:18.432478 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f16fce-cf50-4169-a713-0d001edc6733 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:18.457280 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:18.461129 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:18.470434 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd79c0dc-5b74-47a9-b53e-946a838a4b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:18.471735 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd79c0dc-5b74-47a9-b53e-946a838a4b00 None admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:18.471735 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd79c0dc-5b74-47a9-b53e-946a838a4b00 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:18.472017 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd79c0dc-5b74-47a9-b53e-946a838a4b00 None admin] PATH_INFO: `/v3/projects/e429537b190c4c5ea7e1332ab044ca7a/users/b910435e5585436996ba5b5aeb7184bb/roles/28e9b75018ac44c0afe7ab728071f2d5` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:18.487144 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd79c0dc-5b74-47a9-b53e-946a838a4b00 None admin] RBAC: Authorizing `identity:create_grant(project_id=e429537b190c4c5ea7e1332ab044ca7a, user_id=b910435e5585436996ba5b5aeb7184bb, role_id=28e9b75018ac44c0afe7ab728071f2d5)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:18.488612 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd79c0dc-5b74-47a9-b53e-946a838a4b00 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:18.500035 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 307/607] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:21:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 14:21:18.501373 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff7cc6f-298d-4553-b805-9e96ca40f073 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:18.578660 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 301/608] 10.222.0.86 () {58 vars in 1439 bytes} [Tue Jun 7 14:21:18 2022] PUT /identity/v3/projects/e429537b190c4c5ea7e1332ab044ca7a/users/b910435e5585436996ba5b5aeb7184bb/roles/28e9b75018ac44c0afe7ab728071f2d5 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:21:18.585374 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee29f6f3-0b42-46ab-9905-cd95e4e795ff None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:18.585662 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee29f6f3-0b42-46ab-9905-cd95e4e795ff None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:18.585938 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee29f6f3-0b42-46ab-9905-cd95e4e795ff None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:18.587305 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 302/609] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:21:18 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:21:18.588029 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee29f6f3-0b42-46ab-9905-cd95e4e795ff None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:18.626028 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff7cc6f-298d-4553-b805-9e96ca40f073 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:18.669702 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52a4ab3-82a3-49dc-b1e1-fa426fb533b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:18.671070 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52a4ab3-82a3-49dc-b1e1-fa426fb533b5 None admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:18.671577 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52a4ab3-82a3-49dc-b1e1-fa426fb533b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:18.672130 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52a4ab3-82a3-49dc-b1e1-fa426fb533b5 None admin] PATH_INFO: `/v3/projects/e429537b190c4c5ea7e1332ab044ca7a/users/dda603ec5517460a83c333db2af804d4/roles/28e9b75018ac44c0afe7ab728071f2d5` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:18.690138 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52a4ab3-82a3-49dc-b1e1-fa426fb533b5 None admin] RBAC: Authorizing `identity:create_grant(project_id=e429537b190c4c5ea7e1332ab044ca7a, user_id=dda603ec5517460a83c333db2af804d4, role_id=28e9b75018ac44c0afe7ab728071f2d5)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:18.692370 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52a4ab3-82a3-49dc-b1e1-fa426fb533b5 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:18.743305 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee29f6f3-0b42-46ab-9905-cd95e4e795ff None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:18.765457 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 308/610] 10.222.0.86 () {58 vars in 1439 bytes} [Tue Jun 7 14:21:18 2022] PUT /identity/v3/projects/e429537b190c4c5ea7e1332ab044ca7a/users/dda603ec5517460a83c333db2af804d4/roles/28e9b75018ac44c0afe7ab728071f2d5 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:21:18.767256 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fee94bc-eefd-4161-8e45-e1cf65e347fe None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:18.767800 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fee94bc-eefd-4161-8e45-e1cf65e347fe None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:18.768984 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fee94bc-eefd-4161-8e45-e1cf65e347fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:18.786016 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a14343-35dc-4ab2-addb-461d8900d719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:18.787415 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a14343-35dc-4ab2-addb-461d8900d719 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:18.787415 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a14343-35dc-4ab2-addb-461d8900d719 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:18.787415 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a14343-35dc-4ab2-addb-461d8900d719 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:18.794128 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-0fee94bc-eefd-4161-8e45-e1cf65e347fe None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:21:18.795857 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-0fee94bc-eefd-4161-8e45-e1cf65e347fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:21:18.801462 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a14343-35dc-4ab2-addb-461d8900d719 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:21:18.809520 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-63a14343-35dc-4ab2-addb-461d8900d719 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 07 14:21:18.809520 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:18.809520 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:18.809520 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:18.809520 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:18.809520 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:18.809520 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:18.809520 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:18.809520 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:18.809520 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:18.809520 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:18.809520 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:18.809520 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:21:18.809520 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:21:18.809520 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:21:18.809520 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:21:18.811104 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:21:18.811104 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:21:18.811104 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:21:18.811104 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:21:18.811104 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:18.811104 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:18.811104 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:18.811104 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:18.811104 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:18.811104 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:18.811104 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:18.811104 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:18.811104 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:18.811104 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:18.811104 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:18.811104 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:18.812461 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:18.812461 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:18.812461 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:18.812461 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:18.812461 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:21:18.812461 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:21:18.812461 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:21:18.812461 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:21:18.812461 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:21:18.812461 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:21:18.812461 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 07 14:21:18.812461 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:21:18.812461 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 303/611] 10.222.0.86 () {56 vars in 1102 bytes} [Tue Jun 7 14:21:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:21:18.813926 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:18.817282 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a14343-35dc-4ab2-addb-461d8900d719 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:18.863319 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:18.889732 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 309/612] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:21:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 14:21:18.928718 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fee94bc-eefd-4161-8e45-e1cf65e347fe None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:18.981452 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a14343-35dc-4ab2-addb-461d8900d719 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:19.045026 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fb1dca-797b-469d-8d0a-392841355aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:19.045694 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fb1dca-797b-469d-8d0a-392841355aa2 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:19.045974 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fb1dca-797b-469d-8d0a-392841355aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:19.046241 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fb1dca-797b-469d-8d0a-392841355aa2 None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:19.046990 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fb1dca-797b-469d-8d0a-392841355aa2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:19.047291 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fb1dca-797b-469d-8d0a-392841355aa2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:19.048704 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fb1dca-797b-469d-8d0a-392841355aa2 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:19.058943 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 304/613] 10.222.0.86 () {56 vars in 1103 bytes} [Tue Jun 7 14:21:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:19.064592 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fb1dca-797b-469d-8d0a-392841355aa2 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:19.093477 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fee94bc-eefd-4161-8e45-e1cf65e347fe None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:19.142650 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be295ca-6628-4fab-9797-d8a0f13b2fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:19.143875 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be295ca-6628-4fab-9797-d8a0f13b2fce None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:19.144464 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be295ca-6628-4fab-9797-d8a0f13b2fce None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:19.145006 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be295ca-6628-4fab-9797-d8a0f13b2fce None admin] PATH_INFO: `/v3/roles/service` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:19.158569 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be295ca-6628-4fab-9797-d8a0f13b2fce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:21:19.167637 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-7be295ca-6628-4fab-9797-d8a0f13b2fce None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 07 14:21:19.167637 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:19.167637 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:19.167637 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:19.167637 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:19.167637 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:19.167637 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:19.167637 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:19.167637 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:19.167637 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:19.167637 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:19.167637 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:19.167637 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:21:19.167637 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:21:19.167637 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:21:19.167637 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:21:19.168586 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:21:19.168586 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:21:19.168586 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:21:19.168586 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:21:19.168586 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:19.168586 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:19.168586 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:19.168586 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:19.168586 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:19.168586 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:19.168586 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:19.168586 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:19.168586 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:19.168586 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:19.168586 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:19.168586 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:19.169993 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:19.169993 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:19.169993 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:19.169993 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:19.169993 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:21:19.169993 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:21:19.169993 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:21:19.169993 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:21:19.169993 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:21:19.169993 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:21:19.169993 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 07 14:21:19.169993 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:21:19.176720 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fb1dca-797b-469d-8d0a-392841355aa2 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:19.177021 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 310/614] 10.222.0.86 () {56 vars in 1102 bytes} [Tue Jun 7 14:21:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:21:19.178458 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:19.180421 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be295ca-6628-4fab-9797-d8a0f13b2fce None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:19.193158 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:19.212589 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb7f769-6b2b-4e75-862a-450bfd614a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:19.213655 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb7f769-6b2b-4e75-862a-450bfd614a66 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:19.214072 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb7f769-6b2b-4e75-862a-450bfd614a66 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:19.214501 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb7f769-6b2b-4e75-862a-450bfd614a66 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:19.226672 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb7f769-6b2b-4e75-862a-450bfd614a66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:19.228367 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb7f769-6b2b-4e75-862a-450bfd614a66 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:19.246548 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-1fb7f769-6b2b-4e75-862a-450bfd614a66 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:21:19.246548 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:19.246548 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:19.246548 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:19.246548 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:19.246548 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:19.246548 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:19.246548 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:19.246548 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:19.246548 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:19.246548 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:19.246548 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:19.246548 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:21:19.246548 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:21:19.246548 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:21:19.248118 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:21:19.248118 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:19.248118 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:19.248118 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:19.248118 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:19.248118 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:19.248118 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:19.248118 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:19.248118 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:19.248118 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:19.248118 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:19.248118 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:19.248118 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:19.248118 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:19.248118 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:19.248118 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:19.248118 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:19.248989 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:21:19.248989 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:21:19.248989 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:21:19.248989 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:21:19.248989 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 305/615] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jun 7 14:21:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 14:21:19.254540 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb7f769-6b2b-4e75-862a-450bfd614a66 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:19.368255 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb7f769-6b2b-4e75-862a-450bfd614a66 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:19.409136 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225a0a47-6b59-47bd-9ce0-bc368e3e83e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:19.409810 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225a0a47-6b59-47bd-9ce0-bc368e3e83e1 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:19.410093 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225a0a47-6b59-47bd-9ce0-bc368e3e83e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:19.410371 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225a0a47-6b59-47bd-9ce0-bc368e3e83e1 None admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:19.411099 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225a0a47-6b59-47bd-9ce0-bc368e3e83e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:19.411405 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225a0a47-6b59-47bd-9ce0-bc368e3e83e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:19.412802 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225a0a47-6b59-47bd-9ce0-bc368e3e83e1 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:19.416636 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be295ca-6628-4fab-9797-d8a0f13b2fce None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:19.444694 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 306/616] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jun 7 14:21:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:19.447864 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225a0a47-6b59-47bd-9ce0-bc368e3e83e1 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:19.469570 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:19.489823 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d188b260-7ae7-4587-92dc-3793aa6ffcff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:19.494139 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d188b260-7ae7-4587-92dc-3793aa6ffcff None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:19.494139 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d188b260-7ae7-4587-92dc-3793aa6ffcff None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:19.494139 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d188b260-7ae7-4587-92dc-3793aa6ffcff None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:19.494139 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d188b260-7ae7-4587-92dc-3793aa6ffcff None admin] RBAC: Adding query filter params (name=service) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:19.494139 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d188b260-7ae7-4587-92dc-3793aa6ffcff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:19.494139 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d188b260-7ae7-4587-92dc-3793aa6ffcff None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:19.514606 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 311/617] 10.222.0.86 () {56 vars in 1103 bytes} [Tue Jun 7 14:21:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:19.521071 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d188b260-7ae7-4587-92dc-3793aa6ffcff None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:19.585045 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225a0a47-6b59-47bd-9ce0-bc368e3e83e1 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:19.625087 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce6853d-bd1e-457c-ac8d-0009c94ca81c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:19.626025 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce6853d-bd1e-457c-ac8d-0009c94ca81c None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:19.626360 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce6853d-bd1e-457c-ac8d-0009c94ca81c None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:19.626631 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce6853d-bd1e-457c-ac8d-0009c94ca81c None admin] PATH_INFO: `/v3/users/swift` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:19.635308 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce6853d-bd1e-457c-ac8d-0009c94ca81c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:19.636778 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce6853d-bd1e-457c-ac8d-0009c94ca81c None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:19.654075 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:19.655608 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-4ce6853d-bd1e-457c-ac8d-0009c94ca81c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 07 14:21:19.655608 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:19.655608 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:19.655608 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:19.655608 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:19.655608 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:19.655608 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:19.655608 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:19.655608 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:19.655608 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:19.655608 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:19.655608 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:19.655608 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 14:21:19.655608 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 14:21:19.655608 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 14:21:19.655608 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 14:21:19.656554 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:19.656554 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:19.656554 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 14:21:19.656554 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:21:19.656554 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 14:21:19.656554 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:21:19.656554 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:19.656554 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:19.656554 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:19.656554 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:19.656554 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:19.656554 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:19.656554 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:19.656554 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:19.656554 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:19.656554 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:19.656554 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:19.656554 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:19.658071 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:19.658071 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:19.658071 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 14:21:19.658071 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 14:21:19.658071 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 14:21:19.658071 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 14:21:19.658071 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 14:21:19.658071 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 14:21:19.658071 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 07 14:21:19.658071 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:21:19.658071 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 307/618] 10.222.0.86 () {56 vars in 1096 bytes} [Tue Jun 7 14:21:19 2022] GET /identity/v3/users/swift => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:21:19.663139 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce6853d-bd1e-457c-ac8d-0009c94ca81c None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:19.729297 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d188b260-7ae7-4587-92dc-3793aa6ffcff None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:19.782940 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2348bf-c297-40ed-83de-73a9124433dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:19.784370 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2348bf-c297-40ed-83de-73a9124433dc None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:19.784651 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2348bf-c297-40ed-83de-73a9124433dc None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:19.785086 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2348bf-c297-40ed-83de-73a9124433dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:19.797236 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2348bf-c297-40ed-83de-73a9124433dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:19.798688 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2348bf-c297-40ed-83de-73a9124433dc None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:19.817866 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-de2348bf-c297-40ed-83de-73a9124433dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:21:19.817866 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:19.817866 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:19.817866 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:19.817866 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:19.817866 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:19.817866 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:19.817866 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:19.817866 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:19.817866 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:19.817866 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:19.817866 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:19.817866 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:21:19.817866 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:21:19.817866 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:21:19.818757 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:21:19.818757 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:19.818757 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:19.818757 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:19.818757 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:19.818757 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:19.818757 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:19.818757 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:19.818757 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:19.818757 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:19.818757 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:19.818757 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:19.818757 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:19.818757 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:19.818757 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:19.818757 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:19.818757 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:19.819804 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:21:19.819804 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:21:19.819804 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:21:19.819804 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:21:19.819804 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 312/619] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jun 7 14:21:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:21:19.826225 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2348bf-c297-40ed-83de-73a9124433dc None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:19.832125 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:19.893079 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce6853d-bd1e-457c-ac8d-0009c94ca81c None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:19.973335 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2348bf-c297-40ed-83de-73a9124433dc None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:19.983812 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104dd39b-474a-46fe-a3b7-7df99969f367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:19.984437 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104dd39b-474a-46fe-a3b7-7df99969f367 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:19.984725 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104dd39b-474a-46fe-a3b7-7df99969f367 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:19.985007 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104dd39b-474a-46fe-a3b7-7df99969f367 None admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:19.985858 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104dd39b-474a-46fe-a3b7-7df99969f367 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:19.986174 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104dd39b-474a-46fe-a3b7-7df99969f367 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:19.987615 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104dd39b-474a-46fe-a3b7-7df99969f367 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:19.996113 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:20.009822 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f20fe92-4a14-4ca7-ae91-23f929be8a98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:20.019689 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f20fe92-4a14-4ca7-ae91-23f929be8a98 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:20.019689 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f20fe92-4a14-4ca7-ae91-23f929be8a98 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:20.019689 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f20fe92-4a14-4ca7-ae91-23f929be8a98 None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:20.019689 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f20fe92-4a14-4ca7-ae91-23f929be8a98 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:20.019689 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f20fe92-4a14-4ca7-ae91-23f929be8a98 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:20.019689 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f20fe92-4a14-4ca7-ae91-23f929be8a98 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:20.028143 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 313/620] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jun 7 14:21:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:20.030501 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 308/621] 10.222.0.86 () {56 vars in 1135 bytes} [Tue Jun 7 14:21:19 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:20.035218 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f20fe92-4a14-4ca7-ae91-23f929be8a98 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:20.038100 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104dd39b-474a-46fe-a3b7-7df99969f367 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:20.153290 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f20fe92-4a14-4ca7-ae91-23f929be8a98 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:20.200882 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2fb23f-9a17-4a7d-b520-47f18d632cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:20.201811 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2fb23f-9a17-4a7d-b520-47f18d632cf4 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:20.202154 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2fb23f-9a17-4a7d-b520-47f18d632cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:20.202496 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2fb23f-9a17-4a7d-b520-47f18d632cf4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:20.203849 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104dd39b-474a-46fe-a3b7-7df99969f367 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:20.212830 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2fb23f-9a17-4a7d-b520-47f18d632cf4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:20.214357 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2fb23f-9a17-4a7d-b520-47f18d632cf4 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:20.233411 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-5b2fb23f-9a17-4a7d-b520-47f18d632cf4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 07 14:21:20.233411 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:20.233411 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:20.233411 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:20.233411 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:20.233411 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:20.233411 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:20.233411 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:20.233411 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:20.233411 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:20.233411 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:20.233411 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:20.233411 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 14:21:20.233411 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 14:21:20.233411 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 14:21:20.233411 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 14:21:20.234587 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:20.234587 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:20.234587 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 14:21:20.234587 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:21:20.234587 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 14:21:20.234587 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:21:20.234587 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:20.234587 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:20.234587 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:20.234587 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:20.234587 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:20.234587 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:20.234587 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:20.234587 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:20.234587 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:20.234587 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:20.234587 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:20.234587 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:20.235741 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:20.235741 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:20.235741 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 14:21:20.235741 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 14:21:20.235741 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 14:21:20.235741 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 14:21:20.235741 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 14:21:20.235741 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 14:21:20.235741 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 07 14:21:20.235741 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:21:20.236466 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 314/622] 10.222.0.86 () {56 vars in 1093 bytes} [Tue Jun 7 14:21:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:21:20.238145 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5d4dce-edaa-45d8-8d8b-9017a40d3403 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:20.238430 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5d4dce-edaa-45d8-8d8b-9017a40d3403 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:20.238704 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5d4dce-edaa-45d8-8d8b-9017a40d3403 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:20.240130 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 315/623] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:21:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:21:20.244192 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5d4dce-edaa-45d8-8d8b-9017a40d3403 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:20.254780 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:20.265331 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aee9d0-964b-41ec-bdd6-787f8334b501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:20.266935 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aee9d0-964b-41ec-bdd6-787f8334b501 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:20.267425 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aee9d0-964b-41ec-bdd6-787f8334b501 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:20.267917 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aee9d0-964b-41ec-bdd6-787f8334b501 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:20.286320 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32aee9d0-964b-41ec-bdd6-787f8334b501 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:20.288444 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32aee9d0-964b-41ec-bdd6-787f8334b501 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:20.299419 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:20.316783 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-32aee9d0-964b-41ec-bdd6-787f8334b501 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:21:20.316783 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:20.316783 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:20.316783 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:20.316783 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:20.316783 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:20.316783 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:20.316783 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:20.316783 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:20.316783 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:20.316783 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:20.316783 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:20.316783 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:21:20.316783 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:21:20.316783 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:21:20.317699 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:21:20.317699 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:20.317699 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:20.317699 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:20.317699 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:20.317699 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:20.317699 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:20.317699 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:20.317699 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:20.317699 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:20.317699 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:20.317699 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:20.317699 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:20.317699 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:20.317699 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:20.317699 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:20.317699 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:20.318565 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:21:20.318565 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:21:20.318565 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:21:20.318565 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:21:20.321395 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 309/624] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jun 7 14:21:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 14:21:20.322761 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d75861d-3dc1-406c-ad59-f934ebba2645 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:20.323181 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d75861d-3dc1-406c-ad59-f934ebba2645 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:20.323586 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d75861d-3dc1-406c-ad59-f934ebba2645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:20.346003 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-5d75861d-3dc1-406c-ad59-f934ebba2645 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:21:20.347784 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-5d75861d-3dc1-406c-ad59-f934ebba2645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:21:20.369777 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5d4dce-edaa-45d8-8d8b-9017a40d3403 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:20.408122 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dbc4f2-afb1-4482-90df-adbcf4fbed2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:20.408966 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dbc4f2-afb1-4482-90df-adbcf4fbed2f None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:20.409362 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dbc4f2-afb1-4482-90df-adbcf4fbed2f None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:20.409754 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dbc4f2-afb1-4482-90df-adbcf4fbed2f None admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:20.410867 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dbc4f2-afb1-4482-90df-adbcf4fbed2f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:20.411263 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dbc4f2-afb1-4482-90df-adbcf4fbed2f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:20.412931 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dbc4f2-afb1-4482-90df-adbcf4fbed2f None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:20.432675 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 316/625] 10.222.0.86 () {56 vars in 1133 bytes} [Tue Jun 7 14:21:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:21:20.433752 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dbc4f2-afb1-4482-90df-adbcf4fbed2f None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:20.443781 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 310/626] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:21:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 14:21:20.444736 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d75861d-3dc1-406c-ad59-f934ebba2645 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:20.549134 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:20.553602 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dbc4f2-afb1-4482-90df-adbcf4fbed2f None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:20.568905 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d75861d-3dc1-406c-ad59-f934ebba2645 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:20.580635 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:20.591377 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e51aadf-56d4-46b5-a2f8-6a778529e1ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:20.592285 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e51aadf-56d4-46b5-a2f8-6a778529e1ed None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:20.592712 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e51aadf-56d4-46b5-a2f8-6a778529e1ed None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:20.593130 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e51aadf-56d4-46b5-a2f8-6a778529e1ed None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:20.594016 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e51aadf-56d4-46b5-a2f8-6a778529e1ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:20.594465 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e51aadf-56d4-46b5-a2f8-6a778529e1ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:20.596093 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e51aadf-56d4-46b5-a2f8-6a778529e1ed None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:20.605364 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ee2276-97d5-47ef-903b-a437e55dc781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:20.605859 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ee2276-97d5-47ef-903b-a437e55dc781 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:20.606221 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ee2276-97d5-47ef-903b-a437e55dc781 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:20.607092 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ee2276-97d5-47ef-903b-a437e55dc781 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:20.614194 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 317/627] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jun 7 14:21:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:20.615333 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e51aadf-56d4-46b5-a2f8-6a778529e1ed None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:20.678539 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ee2276-97d5-47ef-903b-a437e55dc781 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:20.680189 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ee2276-97d5-47ef-903b-a437e55dc781 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:20.726933 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e51aadf-56d4-46b5-a2f8-6a778529e1ed None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:20.763962 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf31997-8aad-4445-a920-c01338a86b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:20.765135 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf31997-8aad-4445-a920-c01338a86b38 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:20.765670 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf31997-8aad-4445-a920-c01338a86b38 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:20.766166 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf31997-8aad-4445-a920-c01338a86b38 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:20.777776 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf31997-8aad-4445-a920-c01338a86b38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:21:20.785429 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 311/628] 10.222.0.86 () {58 vars in 1282 bytes} [Tue Jun 7 14:21:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 07 14:21:20.786343 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ee2276-97d5-47ef-903b-a437e55dc781 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:20.787125 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-3bf31997-8aad-4445-a920-c01338a86b38 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 07 14:21:20.787125 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:20.787125 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:20.787125 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:20.787125 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:20.787125 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:20.787125 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:20.787125 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:20.787125 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:20.787125 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:20.787125 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:20.787125 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:20.787125 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:21:20.787125 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:21:20.787125 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:21:20.787125 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:21:20.788047 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:21:20.788047 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:21:20.788047 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:21:20.788047 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:21:20.788047 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:20.788047 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:20.788047 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:20.788047 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:20.788047 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:20.788047 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:20.788047 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:20.788047 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:20.788047 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:20.788047 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:20.788047 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:20.788047 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:20.788942 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:20.788942 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:20.788942 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:20.788942 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:20.788942 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:21:20.788942 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:21:20.788942 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:21:20.788942 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:21:20.788942 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:21:20.788942 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:21:20.788942 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 07 14:21:20.788942 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:21:20.791899 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 318/629] 10.222.0.86 () {56 vars in 1102 bytes} [Tue Jun 7 14:21:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:21:20.792907 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf31997-8aad-4445-a920-c01338a86b38 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:20.803409 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:20.819159 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:20.900645 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ee2276-97d5-47ef-903b-a437e55dc781 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:20.906892 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf31997-8aad-4445-a920-c01338a86b38 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:20.938693 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655331d0-962c-431e-8d5d-efbbf0ca2a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:20.939634 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655331d0-962c-431e-8d5d-efbbf0ca2a3b None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:20.939838 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655331d0-962c-431e-8d5d-efbbf0ca2a3b None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:20.940119 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655331d0-962c-431e-8d5d-efbbf0ca2a3b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:20.944817 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ec7c81-4d1d-44e0-8e6c-05920f2ebef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:20.945842 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec7c81-4d1d-44e0-8e6c-05920f2ebef0 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:20.946352 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec7c81-4d1d-44e0-8e6c-05920f2ebef0 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:20.946819 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec7c81-4d1d-44e0-8e6c-05920f2ebef0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:20.947550 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655331d0-962c-431e-8d5d-efbbf0ca2a3b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:20.949035 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655331d0-962c-431e-8d5d-efbbf0ca2a3b None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:20.958107 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ec7c81-4d1d-44e0-8e6c-05920f2ebef0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:20.959811 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ec7c81-4d1d-44e0-8e6c-05920f2ebef0 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:20.963238 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-655331d0-962c-431e-8d5d-efbbf0ca2a3b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:21:20.963238 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:20.963238 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:20.963238 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:20.963238 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:20.963238 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:20.963238 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:20.963238 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:20.963238 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:20.963238 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:20.963238 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:20.963238 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:20.963238 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 14:21:20.963238 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 14:21:20.963238 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 14:21:20.964157 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 14:21:20.964157 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:20.964157 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:20.964157 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:20.964157 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:20.964157 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:20.964157 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:20.964157 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:20.964157 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:20.964157 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:20.964157 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:20.964157 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:20.964157 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:20.964157 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:20.964157 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:20.964157 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:20.964157 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:20.965018 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 14:21:20.965018 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 14:21:20.965018 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 14:21:20.965018 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 14:21:20.965018 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 14:21:20.965018 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 14:21:20.965018 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:21:20.965018 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:21:20.969235 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 312/630] 10.222.0.86 () {56 vars in 1111 bytes} [Tue Jun 7 14:21:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:21:20.970108 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655331d0-962c-431e-8d5d-efbbf0ca2a3b None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:20.982443 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-37ec7c81-4d1d-44e0-8e6c-05920f2ebef0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:21:20.982443 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:20.982443 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:20.982443 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:20.982443 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:20.982443 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:20.982443 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:20.982443 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:20.982443 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:20.982443 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:20.982443 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:20.982443 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:20.982443 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:21:20.982443 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:21:20.982443 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:21:20.983369 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:21:20.983369 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:20.983369 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:20.983369 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:20.983369 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:20.983369 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:20.983369 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:20.983369 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:20.983369 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:20.983369 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:20.983369 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:20.983369 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:20.983369 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:20.983369 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:20.983369 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:20.983369 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:20.983369 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:20.984275 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:21:20.984275 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:21:20.984275 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:21:20.984275 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:21:20.986522 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 319/631] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jun 7 14:21:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:21:20.987614 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ec7c81-4d1d-44e0-8e6c-05920f2ebef0 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:21.045598 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:21.060661 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:21.078744 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655331d0-962c-431e-8d5d-efbbf0ca2a3b None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:21.092679 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ec7c81-4d1d-44e0-8e6c-05920f2ebef0 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:21.117764 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f08a04-db12-4d2e-9acb-ab43fc94022d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:21.118468 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f08a04-db12-4d2e-9acb-ab43fc94022d None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:21.118759 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f08a04-db12-4d2e-9acb-ab43fc94022d None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:21.119039 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f08a04-db12-4d2e-9acb-ab43fc94022d None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:21.119965 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f08a04-db12-4d2e-9acb-ab43fc94022d None admin] RBAC: Adding query filter params (name=service) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:21.120290 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f08a04-db12-4d2e-9acb-ab43fc94022d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:21.121717 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f08a04-db12-4d2e-9acb-ab43fc94022d None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:21.134151 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be957c94-67c9-4913-a794-200a7da4425a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:21.135208 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be957c94-67c9-4913-a794-200a7da4425a None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:21.135688 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be957c94-67c9-4913-a794-200a7da4425a None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:21.136190 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be957c94-67c9-4913-a794-200a7da4425a None admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:21.137182 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be957c94-67c9-4913-a794-200a7da4425a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:21.137830 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be957c94-67c9-4913-a794-200a7da4425a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:21.139979 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be957c94-67c9-4913-a794-200a7da4425a None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:21.140630 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 313/632] 10.222.0.86 () {56 vars in 1103 bytes} [Tue Jun 7 14:21:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:21.141550 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f08a04-db12-4d2e-9acb-ab43fc94022d None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:21.153248 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 320/633] 10.222.0.86 () {56 vars in 1148 bytes} [Tue Jun 7 14:21:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:21.154480 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be957c94-67c9-4913-a794-200a7da4425a None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:21.260304 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be957c94-67c9-4913-a794-200a7da4425a None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:21.269382 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f08a04-db12-4d2e-9acb-ab43fc94022d None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:21.289996 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:21.297660 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2c4dfd-887c-4859-acc8-85b9f79faff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:21.301590 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2c4dfd-887c-4859-acc8-85b9f79faff6 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:21.301590 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2c4dfd-887c-4859-acc8-85b9f79faff6 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:21.301590 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2c4dfd-887c-4859-acc8-85b9f79faff6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:21.301867 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:21.306833 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9580656-f5ae-4a75-8f11-9852cd90c933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:21.307498 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9580656-f5ae-4a75-8f11-9852cd90c933 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:21.307807 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9580656-f5ae-4a75-8f11-9852cd90c933 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:21.308091 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9580656-f5ae-4a75-8f11-9852cd90c933 None admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:21.308822 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9580656-f5ae-4a75-8f11-9852cd90c933 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:21.309132 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9580656-f5ae-4a75-8f11-9852cd90c933 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:21.310555 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9580656-f5ae-4a75-8f11-9852cd90c933 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:21.311667 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2c4dfd-887c-4859-acc8-85b9f79faff6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:21.313348 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2c4dfd-887c-4859-acc8-85b9f79faff6 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:21.323812 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 314/634] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jun 7 14:21:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:21.323812 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9580656-f5ae-4a75-8f11-9852cd90c933 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:21.334762 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-fd2c4dfd-887c-4859-acc8-85b9f79faff6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:21:21.334762 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:21.334762 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:21.334762 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:21.334762 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:21.334762 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:21.334762 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:21.334762 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:21.334762 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:21.334762 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:21.334762 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:21.334762 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:21.334762 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:21:21.334762 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:21:21.334762 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:21:21.336727 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:21:21.336727 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:21.336727 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:21.336727 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:21.336727 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:21.336727 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:21.336727 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:21.336727 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:21.336727 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:21.336727 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:21.336727 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:21.336727 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:21.336727 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:21.336727 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:21.336727 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:21.336727 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:21.336727 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:21.337588 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:21:21.337588 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:21:21.337588 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:21:21.337588 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:21:21.337588 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 321/635] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jun 7 14:21:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:21:21.337588 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4f4355-4b08-4b52-ae19-ba8f7ec1b1fb None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:21.337931 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4f4355-4b08-4b52-ae19-ba8f7ec1b1fb None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:21.338393 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4f4355-4b08-4b52-ae19-ba8f7ec1b1fb None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:21.339455 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 322/636] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:21:21 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:21:21.343978 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4f4355-4b08-4b52-ae19-ba8f7ec1b1fb None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:21.435622 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9580656-f5ae-4a75-8f11-9852cd90c933 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:21.449643 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4f4355-4b08-4b52-ae19-ba8f7ec1b1fb None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:21.470578 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917fe11d-8113-48be-8d8c-042af18e3b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:21.471496 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917fe11d-8113-48be-8d8c-042af18e3b75 None admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:21.471835 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917fe11d-8113-48be-8d8c-042af18e3b75 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:21.472119 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917fe11d-8113-48be-8d8c-042af18e3b75 None admin] PATH_INFO: `/v3/projects/e429537b190c4c5ea7e1332ab044ca7a/users/c9774349dd2b4ec092ef04c3df050a7e/roles/28e9b75018ac44c0afe7ab728071f2d5` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:21.483023 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf092eb-77da-454f-adb1-6ba4ad295af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:21.483832 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf092eb-77da-454f-adb1-6ba4ad295af2 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:21.484113 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf092eb-77da-454f-adb1-6ba4ad295af2 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:21.484390 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf092eb-77da-454f-adb1-6ba4ad295af2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:21.486080 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917fe11d-8113-48be-8d8c-042af18e3b75 None admin] RBAC: Authorizing `identity:create_grant(project_id=e429537b190c4c5ea7e1332ab044ca7a, user_id=c9774349dd2b4ec092ef04c3df050a7e, role_id=28e9b75018ac44c0afe7ab728071f2d5)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:21.487518 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917fe11d-8113-48be-8d8c-042af18e3b75 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:21.491047 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf092eb-77da-454f-adb1-6ba4ad295af2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:21.492571 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf092eb-77da-454f-adb1-6ba4ad295af2 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:21.507185 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-3cf092eb-77da-454f-adb1-6ba4ad295af2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:21:21.507185 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:21.507185 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:21.507185 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:21.507185 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:21.507185 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:21.507185 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:21.507185 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:21.507185 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:21.507185 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:21.507185 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:21.507185 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:21.507185 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 14:21:21.507185 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 14:21:21.507185 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 14:21:21.508248 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 14:21:21.508248 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:21.508248 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:21.508248 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:21.508248 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:21.508248 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:21.508248 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:21.508248 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:21.508248 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:21.508248 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:21.508248 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:21.508248 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:21.508248 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:21.508248 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:21.508248 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:21.508248 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:21.508248 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:21.509508 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 14:21:21.509508 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 14:21:21.509508 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 14:21:21.509508 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 14:21:21.509508 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 14:21:21.509508 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 14:21:21.509508 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:21:21.509508 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:21:21.509508 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 323/637] 10.222.0.86 () {56 vars in 1111 bytes} [Tue Jun 7 14:21:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:21:21.509508 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf092eb-77da-454f-adb1-6ba4ad295af2 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:21.552068 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:21.561128 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 315/638] 10.222.0.86 () {58 vars in 1439 bytes} [Tue Jun 7 14:21:21 2022] PUT /identity/v3/projects/e429537b190c4c5ea7e1332ab044ca7a/users/c9774349dd2b4ec092ef04c3df050a7e/roles/28e9b75018ac44c0afe7ab728071f2d5 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:21:21.562454 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb427aed-da03-46c8-9e60-6e44bcc07cc0 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:21.562803 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb427aed-da03-46c8-9e60-6e44bcc07cc0 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:21.562976 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb427aed-da03-46c8-9e60-6e44bcc07cc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:21.584803 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-fb427aed-da03-46c8-9e60-6e44bcc07cc0 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:21:21.586051 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-fb427aed-da03-46c8-9e60-6e44bcc07cc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:21:21.616121 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf092eb-77da-454f-adb1-6ba4ad295af2 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:21.630691 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:21.656410 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe69ef4-728e-4252-b6bd-5fcd4e36f23d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:21.657200 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe69ef4-728e-4252-b6bd-5fcd4e36f23d None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:21.657380 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe69ef4-728e-4252-b6bd-5fcd4e36f23d None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:21.657640 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe69ef4-728e-4252-b6bd-5fcd4e36f23d None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:21.658375 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe69ef4-728e-4252-b6bd-5fcd4e36f23d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:21.658683 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe69ef4-728e-4252-b6bd-5fcd4e36f23d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:21.660137 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe69ef4-728e-4252-b6bd-5fcd4e36f23d None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:21.669730 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 316/639] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:21:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 14:21:21.672186 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336c3b36-a21f-4438-81b6-9e1a65ba6780 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:21.672543 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336c3b36-a21f-4438-81b6-9e1a65ba6780 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:21.672968 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336c3b36-a21f-4438-81b6-9e1a65ba6780 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:21.674750 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 324/640] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jun 7 14:21:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:21.675903 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe69ef4-728e-4252-b6bd-5fcd4e36f23d None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:21.678918 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 317/641] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:21:21 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:21:21.680966 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336c3b36-a21f-4438-81b6-9e1a65ba6780 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:21.796971 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe69ef4-728e-4252-b6bd-5fcd4e36f23d None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:21.798638 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:21.801154 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336c3b36-a21f-4438-81b6-9e1a65ba6780 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:21.832590 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81cbf3f-ba6f-43ea-8500-da9f7931442f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:21.833184 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81cbf3f-ba6f-43ea-8500-da9f7931442f None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:21.833467 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81cbf3f-ba6f-43ea-8500-da9f7931442f None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:21.833740 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81cbf3f-ba6f-43ea-8500-da9f7931442f None admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:21.834531 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81cbf3f-ba6f-43ea-8500-da9f7931442f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:21.834842 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81cbf3f-ba6f-43ea-8500-da9f7931442f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:21.836306 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81cbf3f-ba6f-43ea-8500-da9f7931442f None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:21.837318 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49608098-f676-4948-b4e7-cf0655719b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:21.838110 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49608098-f676-4948-b4e7-cf0655719b97 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:21.838400 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49608098-f676-4948-b4e7-cf0655719b97 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:21.838685 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49608098-f676-4948-b4e7-cf0655719b97 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:21.846483 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49608098-f676-4948-b4e7-cf0655719b97 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:21.847948 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49608098-f676-4948-b4e7-cf0655719b97 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:21.850080 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 325/642] 10.222.0.86 () {56 vars in 1148 bytes} [Tue Jun 7 14:21:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:21.851587 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6c5b39-0d53-4515-a042-b9467508166c None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:21.851909 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6c5b39-0d53-4515-a042-b9467508166c None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:21.852186 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6c5b39-0d53-4515-a042-b9467508166c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:21.868390 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-49608098-f676-4948-b4e7-cf0655719b97 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 07 14:21:21.868390 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:21.868390 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:21.868390 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:21.868390 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:21.868390 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:21.868390 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:21.868390 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:21.868390 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:21.868390 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:21.868390 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:21.868390 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:21.868390 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 14:21:21.868390 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 14:21:21.868390 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 14:21:21.868390 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 14:21:21.869480 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:21.869480 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:21.869480 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 14:21:21.869480 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:21:21.869480 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 14:21:21.869480 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:21:21.869480 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:21.869480 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:21.869480 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:21.869480 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:21.869480 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:21.869480 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:21.869480 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:21.869480 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:21.869480 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:21.869480 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:21.869480 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:21.869480 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:21.870431 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:21.870431 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:21.870431 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 14:21:21.870431 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 14:21:21.870431 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 14:21:21.870431 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 14:21:21.870431 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 14:21:21.870431 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 14:21:21.870431 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 07 14:21:21.870431 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:21:21.870431 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 318/643] 10.222.0.86 () {56 vars in 1099 bytes} [Tue Jun 7 14:21:21 2022] GET /identity/v3/users/cinder => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:21:21.872175 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-3d6c5b39-0d53-4515-a042-b9467508166c None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:21:21.872765 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49608098-f676-4948-b4e7-cf0655719b97 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:21.873363 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-3d6c5b39-0d53-4515-a042-b9467508166c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:21:21.909997 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:21.947688 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 326/644] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:21:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 14:21:21.948566 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6c5b39-0d53-4515-a042-b9467508166c None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:21.994972 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49608098-f676-4948-b4e7-cf0655719b97 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:22.030663 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5056c7d7-f6e6-4f96-a941-1e6fee671840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:22.031460 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5056c7d7-f6e6-4f96-a941-1e6fee671840 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:22.031745 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5056c7d7-f6e6-4f96-a941-1e6fee671840 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:22.032049 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5056c7d7-f6e6-4f96-a941-1e6fee671840 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:22.043508 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5056c7d7-f6e6-4f96-a941-1e6fee671840 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:21:22.047026 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:22.052031 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-5056c7d7-f6e6-4f96-a941-1e6fee671840 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 07 14:21:22.052031 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:22.052031 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:22.052031 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:22.052031 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:22.052031 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:22.052031 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:22.052031 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:22.052031 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:22.052031 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:22.052031 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:22.052031 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:22.052031 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:21:22.052031 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:21:22.052031 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:21:22.052031 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:21:22.052960 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:21:22.052960 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:21:22.052960 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:21:22.052960 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:21:22.052960 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:22.052960 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:22.052960 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:22.052960 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:22.052960 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:22.052960 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:22.052960 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:22.052960 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:22.052960 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:22.052960 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:22.052960 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:22.052960 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:22.053846 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:22.053846 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:22.053846 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:22.053846 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:22.053846 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:21:22.053846 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:21:22.053846 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:21:22.053846 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:21:22.053846 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:21:22.053846 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:21:22.053846 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 07 14:21:22.053846 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:21:22.053846 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 319/645] 10.222.0.86 () {56 vars in 1102 bytes} [Tue Jun 7 14:21:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:21:22.054632 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5056c7d7-f6e6-4f96-a941-1e6fee671840 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:22.061971 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6c5b39-0d53-4515-a042-b9467508166c None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:22.100735 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53da635c-db84-4a48-9e42-f68bc01fc730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:22.101306 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53da635c-db84-4a48-9e42-f68bc01fc730 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:22.101592 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53da635c-db84-4a48-9e42-f68bc01fc730 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:22.101868 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53da635c-db84-4a48-9e42-f68bc01fc730 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:22.102697 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53da635c-db84-4a48-9e42-f68bc01fc730 None admin] RBAC: Adding query filter params (role.id=28e9b75018ac44c0afe7ab728071f2d5, scope.project.id=e429537b190c4c5ea7e1332ab044ca7a, user.id=b99cfb70f54c45c8870369359da20378) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:22.103014 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53da635c-db84-4a48-9e42-f68bc01fc730 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:22.104465 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53da635c-db84-4a48-9e42-f68bc01fc730 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:22.111055 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 327/646] 10.222.0.86 () {56 vars in 1374 bytes} [Tue Jun 7 14:21:21 2022] GET /identity/v3/role_assignments?user.id=b99cfb70f54c45c8870369359da20378&scope.project.id=e429537b190c4c5ea7e1332ab044ca7a&role.id=28e9b75018ac44c0afe7ab728071f2d5 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:22.111930 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53da635c-db84-4a48-9e42-f68bc01fc730 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:22.168655 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:22.179074 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5056c7d7-f6e6-4f96-a941-1e6fee671840 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:22.221414 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0de285d-be9e-4727-8a1c-2ae92ef56139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:22.222443 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0de285d-be9e-4727-8a1c-2ae92ef56139 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:22.222933 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0de285d-be9e-4727-8a1c-2ae92ef56139 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:22.223370 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0de285d-be9e-4727-8a1c-2ae92ef56139 None admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:22.224456 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0de285d-be9e-4727-8a1c-2ae92ef56139 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:22.224930 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0de285d-be9e-4727-8a1c-2ae92ef56139 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:22.229697 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0de285d-be9e-4727-8a1c-2ae92ef56139 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:22.236494 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53da635c-db84-4a48-9e42-f68bc01fc730 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:22.254636 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 320/647] 10.222.0.86 () {56 vars in 1137 bytes} [Tue Jun 7 14:21:22 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:22.255861 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0de285d-be9e-4727-8a1c-2ae92ef56139 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:22.275983 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944dae86-9908-438d-a3b4-5c057a13eeb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:22.276958 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944dae86-9908-438d-a3b4-5c057a13eeb8 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:22.277341 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944dae86-9908-438d-a3b4-5c057a13eeb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:22.277719 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944dae86-9908-438d-a3b4-5c057a13eeb8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:22.290447 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944dae86-9908-438d-a3b4-5c057a13eeb8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:21:22.299160 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-944dae86-9908-438d-a3b4-5c057a13eeb8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 07 14:21:22.299160 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:22.299160 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:22.299160 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:22.299160 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:22.299160 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:22.299160 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:22.299160 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:22.299160 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:22.299160 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:22.299160 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:22.299160 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:22.299160 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:21:22.299160 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:21:22.299160 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:21:22.299160 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:21:22.300412 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:21:22.300412 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:21:22.300412 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:21:22.300412 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:21:22.300412 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:22.300412 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:22.300412 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:22.300412 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:22.300412 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:22.300412 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:22.300412 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:22.300412 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:22.300412 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:22.300412 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:22.300412 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:22.300412 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:22.301419 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:22.301419 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:22.301419 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:22.301419 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:22.301419 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:21:22.301419 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:21:22.301419 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:21:22.301419 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:21:22.301419 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:21:22.301419 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:21:22.301419 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 07 14:21:22.301419 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:21:22.308043 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 328/648] 10.222.0.86 () {56 vars in 1102 bytes} [Tue Jun 7 14:21:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:21:22.309192 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944dae86-9908-438d-a3b4-5c057a13eeb8 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:22.331735 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:22.375020 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0de285d-be9e-4727-8a1c-2ae92ef56139 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:22.416227 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708a1da7-052f-4ca0-9071-feb92b1d062e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:22.416894 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708a1da7-052f-4ca0-9071-feb92b1d062e None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:22.417189 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708a1da7-052f-4ca0-9071-feb92b1d062e None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:22.417444 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708a1da7-052f-4ca0-9071-feb92b1d062e None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:22.418190 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708a1da7-052f-4ca0-9071-feb92b1d062e None admin] RBAC: Adding query filter params (name=service) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:22.418496 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708a1da7-052f-4ca0-9071-feb92b1d062e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:22.421124 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708a1da7-052f-4ca0-9071-feb92b1d062e None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:22.430264 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 321/649] 10.222.0.86 () {56 vars in 1103 bytes} [Tue Jun 7 14:21:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:22.431091 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708a1da7-052f-4ca0-9071-feb92b1d062e None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:22.433703 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944dae86-9908-438d-a3b4-5c057a13eeb8 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:22.452227 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:22.477374 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a67b9f-4695-4a78-8c6b-87c6a28d8b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:22.478182 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a67b9f-4695-4a78-8c6b-87c6a28d8b53 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:22.478583 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a67b9f-4695-4a78-8c6b-87c6a28d8b53 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:22.478965 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a67b9f-4695-4a78-8c6b-87c6a28d8b53 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:22.562713 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708a1da7-052f-4ca0-9071-feb92b1d062e None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:22.564349 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a67b9f-4695-4a78-8c6b-87c6a28d8b53 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:22.566827 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a67b9f-4695-4a78-8c6b-87c6a28d8b53 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:22.587720 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:22.606444 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c1dc0a-e003-46a0-a0ce-293408f21c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:22.608136 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c1dc0a-e003-46a0-a0ce-293408f21c4a None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:22.612027 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c1dc0a-e003-46a0-a0ce-293408f21c4a None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:22.612882 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c1dc0a-e003-46a0-a0ce-293408f21c4a None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:22.613811 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c1dc0a-e003-46a0-a0ce-293408f21c4a None admin] RBAC: Adding query filter params (name=service) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:22.614289 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c1dc0a-e003-46a0-a0ce-293408f21c4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:22.616293 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c1dc0a-e003-46a0-a0ce-293408f21c4a None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:22.627812 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 322/650] 10.222.0.86 () {56 vars in 1103 bytes} [Tue Jun 7 14:21:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:22.628952 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c1dc0a-e003-46a0-a0ce-293408f21c4a None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:22.703983 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 329/651] 10.222.0.86 () {58 vars in 1282 bytes} [Tue Jun 7 14:21:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 07 14:21:22.705113 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a67b9f-4695-4a78-8c6b-87c6a28d8b53 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:22.712201 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:22.739725 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c1dc0a-e003-46a0-a0ce-293408f21c4a None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:22.776097 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53498910-85a2-44e0-b801-76bf2f2669fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:22.776681 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53498910-85a2-44e0-b801-76bf2f2669fe None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:22.776970 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53498910-85a2-44e0-b801-76bf2f2669fe None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:22.777248 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53498910-85a2-44e0-b801-76bf2f2669fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:22.788408 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53498910-85a2-44e0-b801-76bf2f2669fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:22.790113 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53498910-85a2-44e0-b801-76bf2f2669fe None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:22.807633 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-53498910-85a2-44e0-b801-76bf2f2669fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:21:22.807633 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:22.807633 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:22.807633 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:22.807633 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:22.807633 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:22.807633 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:22.807633 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:22.807633 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:22.807633 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:22.807633 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:22.807633 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:22.807633 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:21:22.807633 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:21:22.807633 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:21:22.808582 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:21:22.808582 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:22.808582 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:22.808582 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:22.808582 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:22.808582 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:22.808582 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:22.808582 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:22.808582 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:22.808582 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:22.808582 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:22.808582 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:22.808582 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:22.808582 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:22.808582 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:22.808582 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:22.808582 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:22.809997 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:21:22.809997 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:21:22.809997 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:21:22.809997 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:21:22.814138 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 323/652] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jun 7 14:21:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:21:22.815138 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53498910-85a2-44e0-b801-76bf2f2669fe None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:22.829046 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a67b9f-4695-4a78-8c6b-87c6a28d8b53 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:22.847384 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:22.867652 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c19831-4ac5-4dc9-8f71-7819385aab57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:22.868896 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c19831-4ac5-4dc9-8f71-7819385aab57 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:22.869327 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c19831-4ac5-4dc9-8f71-7819385aab57 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:22.869748 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c19831-4ac5-4dc9-8f71-7819385aab57 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:22.882169 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c19831-4ac5-4dc9-8f71-7819385aab57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:22.883818 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c19831-4ac5-4dc9-8f71-7819385aab57 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:22.903021 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-40c19831-4ac5-4dc9-8f71-7819385aab57 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:21:22.903021 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:22.903021 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:22.903021 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:22.903021 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:22.903021 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:22.903021 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:22.903021 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:22.903021 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:22.903021 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:22.903021 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:22.903021 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:22.903021 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:21:22.903021 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:21:22.903021 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:21:22.908132 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:21:22.908132 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:22.908132 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:22.908132 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:22.908132 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:22.908132 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:22.908132 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:22.908132 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:22.908132 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:22.908132 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:22.908132 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:22.908132 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:22.908132 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:22.908132 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:22.908132 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:22.908132 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:22.908132 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:22.909483 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:21:22.909483 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:21:22.909483 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:21:22.909483 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:21:22.909483 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 330/653] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jun 7 14:21:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:21:22.913424 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c19831-4ac5-4dc9-8f71-7819385aab57 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:22.921448 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53498910-85a2-44e0-b801-76bf2f2669fe None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:22.947935 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:22.956439 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305bb01d-4910-45fa-9f3e-556ab90b283e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:22.957245 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305bb01d-4910-45fa-9f3e-556ab90b283e None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:22.957531 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305bb01d-4910-45fa-9f3e-556ab90b283e None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:22.958072 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305bb01d-4910-45fa-9f3e-556ab90b283e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:22.968730 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305bb01d-4910-45fa-9f3e-556ab90b283e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:22.970302 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305bb01d-4910-45fa-9f3e-556ab90b283e None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:22.988060 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-305bb01d-4910-45fa-9f3e-556ab90b283e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:21:22.988060 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:22.988060 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:22.988060 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:22.988060 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:22.988060 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:22.988060 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:22.988060 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:22.988060 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:22.988060 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:22.988060 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:22.988060 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:22.988060 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:21:22.988060 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:21:22.988060 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:21:22.989167 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:21:22.989167 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:22.989167 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:22.989167 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:22.989167 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:22.989167 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:22.989167 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:22.989167 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:22.989167 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:22.989167 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:22.989167 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:22.989167 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:22.989167 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:22.989167 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:22.989167 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:22.989167 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:22.989167 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:22.990221 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:21:22.990221 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:21:22.990221 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:21:22.990221 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:21:22.990221 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 324/654] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jun 7 14:21:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:21:22.991373 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305bb01d-4910-45fa-9f3e-556ab90b283e None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:23.022759 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c19831-4ac5-4dc9-8f71-7819385aab57 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:23.058709 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cec18b1-8141-4f11-ab75-4e6ef2156249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:23.060199 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cec18b1-8141-4f11-ab75-4e6ef2156249 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:23.060656 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cec18b1-8141-4f11-ab75-4e6ef2156249 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:23.061082 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cec18b1-8141-4f11-ab75-4e6ef2156249 None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:23.061963 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cec18b1-8141-4f11-ab75-4e6ef2156249 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:23.062419 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cec18b1-8141-4f11-ab75-4e6ef2156249 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:23.063968 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cec18b1-8141-4f11-ab75-4e6ef2156249 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:23.076775 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 331/655] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jun 7 14:21:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:23.077795 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cec18b1-8141-4f11-ab75-4e6ef2156249 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:23.100379 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305bb01d-4910-45fa-9f3e-556ab90b283e None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:23.116711 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:23.146086 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd880a48-7562-4145-8f20-f4219302331c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:23.146990 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd880a48-7562-4145-8f20-f4219302331c None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:23.147434 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd880a48-7562-4145-8f20-f4219302331c None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:23.147885 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd880a48-7562-4145-8f20-f4219302331c None admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:23.149178 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd880a48-7562-4145-8f20-f4219302331c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:23.149890 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd880a48-7562-4145-8f20-f4219302331c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:23.151937 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd880a48-7562-4145-8f20-f4219302331c None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:23.175074 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 325/656] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jun 7 14:21:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:23.176225 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd880a48-7562-4145-8f20-f4219302331c None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:23.210742 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cec18b1-8141-4f11-ab75-4e6ef2156249 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:23.233624 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:23.251482 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5755b44-8930-4d96-9233-ea24b3a2ddca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:23.252190 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5755b44-8930-4d96-9233-ea24b3a2ddca None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:23.252473 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5755b44-8930-4d96-9233-ea24b3a2ddca None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:23.252750 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5755b44-8930-4d96-9233-ea24b3a2ddca None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:23.253532 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5755b44-8930-4d96-9233-ea24b3a2ddca None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:23.253837 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5755b44-8930-4d96-9233-ea24b3a2ddca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:23.255272 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5755b44-8930-4d96-9233-ea24b3a2ddca None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:23.267419 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 332/657] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jun 7 14:21:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:23.268480 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5755b44-8930-4d96-9233-ea24b3a2ddca None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:23.317039 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd880a48-7562-4145-8f20-f4219302331c None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:23.358864 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563e73a5-b9d2-4d64-bbda-262214e2c09f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:23.360573 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563e73a5-b9d2-4d64-bbda-262214e2c09f None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:23.361093 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563e73a5-b9d2-4d64-bbda-262214e2c09f None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:23.362016 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563e73a5-b9d2-4d64-bbda-262214e2c09f None admin] PATH_INFO: `/v3/users/glance` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:23.372041 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563e73a5-b9d2-4d64-bbda-262214e2c09f None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:23.373388 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:23.375568 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563e73a5-b9d2-4d64-bbda-262214e2c09f None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:23.385733 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5755b44-8930-4d96-9233-ea24b3a2ddca None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:23.395945 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-563e73a5-b9d2-4d64-bbda-262214e2c09f None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 07 14:21:23.395945 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:23.395945 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:23.395945 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:23.395945 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:23.395945 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:23.395945 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:23.395945 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:23.395945 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:23.395945 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:23.395945 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:23.395945 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:23.395945 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 14:21:23.395945 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 14:21:23.395945 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 14:21:23.395945 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 14:21:23.397020 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:23.397020 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:23.397020 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 14:21:23.397020 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:21:23.397020 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 14:21:23.397020 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:21:23.397020 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:23.397020 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:23.397020 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:23.397020 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:23.397020 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:23.397020 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:23.397020 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:23.397020 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:23.397020 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:23.397020 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:23.397020 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:23.397020 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:23.397958 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:23.397958 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:23.397958 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 14:21:23.397958 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 14:21:23.397958 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 14:21:23.397958 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 14:21:23.397958 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 14:21:23.397958 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 14:21:23.397958 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 07 14:21:23.397958 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:21:23.406577 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 326/658] 10.222.0.86 () {56 vars in 1099 bytes} [Tue Jun 7 14:21:23 2022] GET /identity/v3/users/glance => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:21:23.406577 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563e73a5-b9d2-4d64-bbda-262214e2c09f None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:23.434455 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e47c661-7dec-47c6-aba3-299432224a9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:23.435248 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e47c661-7dec-47c6-aba3-299432224a9f None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:23.435530 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e47c661-7dec-47c6-aba3-299432224a9f None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:23.435864 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e47c661-7dec-47c6-aba3-299432224a9f None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:23.443679 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e47c661-7dec-47c6-aba3-299432224a9f None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:23.445154 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e47c661-7dec-47c6-aba3-299432224a9f None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:23.460635 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-3e47c661-7dec-47c6-aba3-299432224a9f None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 07 14:21:23.460635 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:23.460635 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:23.460635 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:23.460635 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:23.460635 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:23.460635 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:23.460635 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:23.460635 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:23.460635 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:23.460635 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:23.460635 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:23.460635 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 14:21:23.460635 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 14:21:23.460635 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 14:21:23.460635 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 14:21:23.461679 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:23.461679 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:23.461679 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 14:21:23.461679 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:21:23.461679 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 14:21:23.461679 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:21:23.461679 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:23.461679 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:23.461679 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:23.461679 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:23.461679 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:23.461679 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:23.461679 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:23.461679 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:23.461679 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:23.461679 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:23.461679 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:23.461679 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:23.462599 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:23.462599 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:23.462599 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 14:21:23.462599 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 14:21:23.462599 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 14:21:23.462599 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 14:21:23.462599 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 14:21:23.462599 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 14:21:23.462599 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 07 14:21:23.462599 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:21:23.467203 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 333/659] 10.222.0.86 () {56 vars in 1102 bytes} [Tue Jun 7 14:21:23 2022] GET /identity/v3/users/neutron => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:21:23.468132 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e47c661-7dec-47c6-aba3-299432224a9f None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:23.541268 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:23.546137 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563e73a5-b9d2-4d64-bbda-262214e2c09f None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:23.579656 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e47c661-7dec-47c6-aba3-299432224a9f None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:23.582053 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7834bf-02b5-44c3-94ff-98d74cb8eaaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:23.583354 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7834bf-02b5-44c3-94ff-98d74cb8eaaf None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:23.583897 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7834bf-02b5-44c3-94ff-98d74cb8eaaf None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:23.584391 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7834bf-02b5-44c3-94ff-98d74cb8eaaf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:23.592218 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7834bf-02b5-44c3-94ff-98d74cb8eaaf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:23.593922 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7834bf-02b5-44c3-94ff-98d74cb8eaaf None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:23.608710 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-8d7834bf-02b5-44c3-94ff-98d74cb8eaaf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:21:23.608710 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:23.608710 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:23.608710 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:23.608710 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:23.608710 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:23.608710 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:23.608710 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:23.608710 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:23.608710 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:23.608710 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:23.608710 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:23.608710 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 14:21:23.608710 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 14:21:23.608710 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 14:21:23.609617 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 14:21:23.609617 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:23.609617 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:23.609617 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:23.609617 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:23.609617 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:23.609617 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:23.609617 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:23.609617 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:23.609617 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:23.609617 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:23.609617 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:23.609617 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:23.609617 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:23.609617 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:23.609617 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:23.609617 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:23.610495 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 14:21:23.610495 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 14:21:23.610495 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 14:21:23.610495 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 14:21:23.610495 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 14:21:23.610495 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 14:21:23.610495 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:21:23.610495 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:21:23.613022 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 327/660] 10.222.0.86 () {56 vars in 1111 bytes} [Tue Jun 7 14:21:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:21:23.614284 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7834bf-02b5-44c3-94ff-98d74cb8eaaf None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:23.616478 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0afd651-17c5-48bf-b91a-a08cbe8d83ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:23.617298 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0afd651-17c5-48bf-b91a-a08cbe8d83ba None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:23.617588 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0afd651-17c5-48bf-b91a-a08cbe8d83ba None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:23.617867 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0afd651-17c5-48bf-b91a-a08cbe8d83ba None admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:23.618703 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0afd651-17c5-48bf-b91a-a08cbe8d83ba None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:23.619014 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0afd651-17c5-48bf-b91a-a08cbe8d83ba None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:23.620621 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0afd651-17c5-48bf-b91a-a08cbe8d83ba None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:23.643795 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 334/661] 10.222.0.86 () {56 vars in 1137 bytes} [Tue Jun 7 14:21:23 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:23.643795 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0afd651-17c5-48bf-b91a-a08cbe8d83ba None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:23.655747 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:23.736849 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7834bf-02b5-44c3-94ff-98d74cb8eaaf None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:23.757248 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0afd651-17c5-48bf-b91a-a08cbe8d83ba None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:23.785624 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b73cf2b-a6d9-49bb-98cc-fac81e4159c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:23.786633 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b73cf2b-a6d9-49bb-98cc-fac81e4159c6 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:23.787125 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b73cf2b-a6d9-49bb-98cc-fac81e4159c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:23.792077 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b73cf2b-a6d9-49bb-98cc-fac81e4159c6 None admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:23.793129 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b73cf2b-a6d9-49bb-98cc-fac81e4159c6 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:23.793644 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b73cf2b-a6d9-49bb-98cc-fac81e4159c6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:23.795418 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b73cf2b-a6d9-49bb-98cc-fac81e4159c6 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:23.798691 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4369665-f61f-4f4e-b58c-35a16da4ec37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:23.799798 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4369665-f61f-4f4e-b58c-35a16da4ec37 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:23.799798 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4369665-f61f-4f4e-b58c-35a16da4ec37 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:23.799975 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4369665-f61f-4f4e-b58c-35a16da4ec37 None admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:23.800703 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4369665-f61f-4f4e-b58c-35a16da4ec37 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:23.801011 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4369665-f61f-4f4e-b58c-35a16da4ec37 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:23.802422 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4369665-f61f-4f4e-b58c-35a16da4ec37 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:23.815162 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 335/662] 10.222.0.86 () {56 vars in 1148 bytes} [Tue Jun 7 14:21:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:23.816043 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4369665-f61f-4f4e-b58c-35a16da4ec37 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:23.827271 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 328/663] 10.222.0.86 () {56 vars in 1139 bytes} [Tue Jun 7 14:21:23 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:23.828445 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b73cf2b-a6d9-49bb-98cc-fac81e4159c6 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:23.847893 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:23.893668 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:23.931352 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4369665-f61f-4f4e-b58c-35a16da4ec37 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:23.943823 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b73cf2b-a6d9-49bb-98cc-fac81e4159c6 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:23.973662 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea48a30-9669-441f-a7ec-bf28fd4dfccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:23.974461 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea48a30-9669-441f-a7ec-bf28fd4dfccf None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:23.974847 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea48a30-9669-441f-a7ec-bf28fd4dfccf None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:23.975491 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea48a30-9669-441f-a7ec-bf28fd4dfccf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:23.981267 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86611827-1070-4211-8836-4cc5c91fe445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:23.982145 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86611827-1070-4211-8836-4cc5c91fe445 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:23.982778 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86611827-1070-4211-8836-4cc5c91fe445 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:23.983209 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86611827-1070-4211-8836-4cc5c91fe445 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:23.984245 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86611827-1070-4211-8836-4cc5c91fe445 None admin] RBAC: Adding query filter params (role.id=28e9b75018ac44c0afe7ab728071f2d5, scope.project.id=e429537b190c4c5ea7e1332ab044ca7a, user.id=af5a95620a4b43538abfe09eed4bf115) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:23.984710 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86611827-1070-4211-8836-4cc5c91fe445 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:23.986354 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86611827-1070-4211-8836-4cc5c91fe445 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:23.993812 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 329/664] 10.222.0.86 () {56 vars in 1374 bytes} [Tue Jun 7 14:21:23 2022] GET /identity/v3/role_assignments?user.id=af5a95620a4b43538abfe09eed4bf115&scope.project.id=e429537b190c4c5ea7e1332ab044ca7a&role.id=28e9b75018ac44c0afe7ab728071f2d5 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:23.995511 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86611827-1070-4211-8836-4cc5c91fe445 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:24.064231 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea48a30-9669-441f-a7ec-bf28fd4dfccf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:24.066118 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea48a30-9669-441f-a7ec-bf28fd4dfccf None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:24.118632 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:24.147223 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86611827-1070-4211-8836-4cc5c91fe445 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:24.192584 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:24.193031 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37937e4-22b1-4fe6-a9bf-94d7e5650e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:24.194292 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37937e4-22b1-4fe6-a9bf-94d7e5650e22 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:24.195321 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37937e4-22b1-4fe6-a9bf-94d7e5650e22 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:24.195780 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37937e4-22b1-4fe6-a9bf-94d7e5650e22 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:24.279150 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 336/665] 10.222.0.86 () {58 vars in 1282 bytes} [Tue Jun 7 14:21:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 07 14:21:24.283236 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993404f0-bce7-4fe0-97f6-df64656c88e7 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:24.283236 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993404f0-bce7-4fe0-97f6-df64656c88e7 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:24.283236 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993404f0-bce7-4fe0-97f6-df64656c88e7 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:24.283236 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 337/666] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:21:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:21:24.284459 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993404f0-bce7-4fe0-97f6-df64656c88e7 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:24.311909 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37937e4-22b1-4fe6-a9bf-94d7e5650e22 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:24.313356 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37937e4-22b1-4fe6-a9bf-94d7e5650e22 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:24.416066 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:24.442198 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 330/667] 10.222.0.86 () {58 vars in 1282 bytes} [Tue Jun 7 14:21:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 07 14:21:24.443920 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a178d0-c0ae-428b-bcc1-be4dc211b731 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:24.444416 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a178d0-c0ae-428b-bcc1-be4dc211b731 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:24.444895 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a178d0-c0ae-428b-bcc1-be4dc211b731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:24.462803 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-77a178d0-c0ae-428b-bcc1-be4dc211b731 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:21:24.463299 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993404f0-bce7-4fe0-97f6-df64656c88e7 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:24.464634 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-77a178d0-c0ae-428b-bcc1-be4dc211b731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:21:24.499140 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f02b150-7bba-4a23-ae36-933fd9da1197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:24.499986 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f02b150-7bba-4a23-ae36-933fd9da1197 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:24.500273 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f02b150-7bba-4a23-ae36-933fd9da1197 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:24.500643 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f02b150-7bba-4a23-ae36-933fd9da1197 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:24.510973 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f02b150-7bba-4a23-ae36-933fd9da1197 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:24.512482 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f02b150-7bba-4a23-ae36-933fd9da1197 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:24.531549 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-6f02b150-7bba-4a23-ae36-933fd9da1197 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:21:24.531549 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:24.531549 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:24.531549 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:24.531549 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:24.531549 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:24.531549 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:24.531549 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:24.531549 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:24.531549 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:24.531549 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:24.531549 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:24.531549 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:21:24.531549 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:21:24.531549 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:21:24.532692 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:21:24.532692 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:24.532692 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:24.532692 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:24.532692 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:24.532692 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:24.532692 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:24.532692 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:24.532692 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:24.532692 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:24.532692 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:24.532692 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:24.532692 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:24.532692 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:24.532692 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:24.532692 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:24.532692 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:24.533553 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:21:24.533553 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:21:24.533553 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:21:24.533553 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:21:24.533553 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 338/668] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jun 7 14:21:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:21:24.534212 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f02b150-7bba-4a23-ae36-933fd9da1197 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:24.555866 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 331/669] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:21:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 14:21:24.556482 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:24.558438 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a178d0-c0ae-428b-bcc1-be4dc211b731 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:24.637749 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f02b150-7bba-4a23-ae36-933fd9da1197 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:24.672330 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a178d0-c0ae-428b-bcc1-be4dc211b731 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:24.672965 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bebd09f-9bac-48bb-a624-1c990a5ae16f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:24.673822 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bebd09f-9bac-48bb-a624-1c990a5ae16f None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:24.674114 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bebd09f-9bac-48bb-a624-1c990a5ae16f None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:24.674394 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bebd09f-9bac-48bb-a624-1c990a5ae16f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:24.683021 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:24.687402 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bebd09f-9bac-48bb-a624-1c990a5ae16f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:24.688880 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bebd09f-9bac-48bb-a624-1c990a5ae16f None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:24.706157 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fe10be-1c90-4bd7-b57d-00687ad7d984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:24.706317 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-5bebd09f-9bac-48bb-a624-1c990a5ae16f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:21:24.706317 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:24.706317 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:24.706317 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:24.706317 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:24.706317 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:24.706317 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:24.706317 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:24.706317 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:24.706317 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:24.706317 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:24.706317 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:24.706317 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:21:24.706317 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:21:24.706317 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:21:24.707121 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:21:24.707121 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:24.707121 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:24.707121 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:24.707121 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:24.707121 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:24.707121 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:24.707121 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:24.707121 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:24.707121 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:24.707121 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:24.707121 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:24.707121 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:24.707121 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:24.707121 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:24.707121 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:24.707121 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:24.708414 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:21:24.708414 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:21:24.708414 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:21:24.708414 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:21:24.708632 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fe10be-1c90-4bd7-b57d-00687ad7d984 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:24.708632 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fe10be-1c90-4bd7-b57d-00687ad7d984 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:24.708632 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fe10be-1c90-4bd7-b57d-00687ad7d984 None admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:24.708632 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fe10be-1c90-4bd7-b57d-00687ad7d984 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:24.708632 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fe10be-1c90-4bd7-b57d-00687ad7d984 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:24.709841 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fe10be-1c90-4bd7-b57d-00687ad7d984 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:24.712004 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 339/670] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jun 7 14:21:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:21:24.713334 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21632e06-67dc-48c3-babb-fdbf61468765 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:24.713625 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21632e06-67dc-48c3-babb-fdbf61468765 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:24.713906 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21632e06-67dc-48c3-babb-fdbf61468765 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:24.719455 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 340/671] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:21:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:21:24.719455 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21632e06-67dc-48c3-babb-fdbf61468765 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:24.729432 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 332/672] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jun 7 14:21:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:24.729432 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fe10be-1c90-4bd7-b57d-00687ad7d984 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:24.791409 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:24.823054 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21632e06-67dc-48c3-babb-fdbf61468765 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:24.835253 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fe10be-1c90-4bd7-b57d-00687ad7d984 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:24.862459 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36257162-76bc-4425-bad8-a96eb9685a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:24.863258 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36257162-76bc-4425-bad8-a96eb9685a2b None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:24.863546 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36257162-76bc-4425-bad8-a96eb9685a2b None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:24.863850 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36257162-76bc-4425-bad8-a96eb9685a2b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:24.872394 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710f6cab-27df-4cc1-8712-2201973bd2a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:24.873051 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710f6cab-27df-4cc1-8712-2201973bd2a9 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:24.873335 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710f6cab-27df-4cc1-8712-2201973bd2a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:24.873616 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710f6cab-27df-4cc1-8712-2201973bd2a9 None admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:24.874334 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710f6cab-27df-4cc1-8712-2201973bd2a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:24.874503 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36257162-76bc-4425-bad8-a96eb9685a2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:21:24.874664 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710f6cab-27df-4cc1-8712-2201973bd2a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:24.876033 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710f6cab-27df-4cc1-8712-2201973bd2a9 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:24.882364 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-36257162-76bc-4425-bad8-a96eb9685a2b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 07 14:21:24.882364 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:24.882364 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:24.882364 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:24.882364 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:24.882364 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:24.882364 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:24.882364 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:24.882364 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:24.882364 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:24.882364 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:24.882364 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:24.882364 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:21:24.882364 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:21:24.882364 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:21:24.882364 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:21:24.883292 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:21:24.883292 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:21:24.883292 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:21:24.883292 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:21:24.883292 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:24.883292 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:24.883292 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:24.883292 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:24.883292 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:24.883292 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:24.883292 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:24.883292 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:24.883292 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:24.883292 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:24.883292 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:24.883292 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:24.884257 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:24.884257 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:24.884257 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:24.884257 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:24.884257 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:21:24.884257 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:21:24.884257 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:21:24.884257 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:21:24.884257 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:21:24.884257 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:21:24.884257 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 07 14:21:24.884257 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:21:24.884257 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 341/673] 10.222.0.86 () {56 vars in 1102 bytes} [Tue Jun 7 14:21:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:21:24.884930 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874ab090-8063-4281-aac6-b6b6f7489db2 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:24.885499 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874ab090-8063-4281-aac6-b6b6f7489db2 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:24.885499 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874ab090-8063-4281-aac6-b6b6f7489db2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:24.898220 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 333/674] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jun 7 14:21:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:24.898220 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710f6cab-27df-4cc1-8712-2201973bd2a9 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:24.904821 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-874ab090-8063-4281-aac6-b6b6f7489db2 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:21:24.906009 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-874ab090-8063-4281-aac6-b6b6f7489db2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:21:24.929250 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:24.979917 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 342/675] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:21:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 14:21:24.979917 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874ab090-8063-4281-aac6-b6b6f7489db2 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:25.004017 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710f6cab-27df-4cc1-8712-2201973bd2a9 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:25.038909 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1428b0a-8ce9-4e90-aeab-ba1ea3bd4ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:25.039990 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1428b0a-8ce9-4e90-aeab-ba1ea3bd4ead None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:25.040294 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1428b0a-8ce9-4e90-aeab-ba1ea3bd4ead None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:25.040545 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1428b0a-8ce9-4e90-aeab-ba1ea3bd4ead None admin] PATH_INFO: `/v3/projects/service` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:25.047994 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1428b0a-8ce9-4e90-aeab-ba1ea3bd4ead None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:25.049422 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1428b0a-8ce9-4e90-aeab-ba1ea3bd4ead None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:25.051195 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:25.063548 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-e1428b0a-8ce9-4e90-aeab-ba1ea3bd4ead None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:21:25.063548 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:25.063548 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:25.063548 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:25.063548 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:25.063548 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:25.063548 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:25.063548 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:25.063548 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:25.063548 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:25.063548 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:25.063548 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:25.063548 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 14:21:25.063548 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 14:21:25.063548 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 14:21:25.069170 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 14:21:25.069170 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:25.069170 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:25.069170 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:25.069170 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:25.069170 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:25.069170 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:25.069170 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:25.069170 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:25.069170 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:25.069170 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:25.069170 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:25.069170 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:25.069170 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:25.069170 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:25.069170 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:25.069170 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:25.070077 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 14:21:25.070077 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 14:21:25.070077 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 14:21:25.070077 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 14:21:25.070077 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 14:21:25.070077 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 14:21:25.070077 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:21:25.070077 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:21:25.070077 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 334/676] 10.222.0.86 () {56 vars in 1111 bytes} [Tue Jun 7 14:21:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:21:25.070077 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1428b0a-8ce9-4e90-aeab-ba1ea3bd4ead None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:25.093563 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874ab090-8063-4281-aac6-b6b6f7489db2 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:25.129290 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48883d37-bdb3-4fb8-9a5c-12b4a85a4fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:25.129957 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48883d37-bdb3-4fb8-9a5c-12b4a85a4fac None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:25.130241 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48883d37-bdb3-4fb8-9a5c-12b4a85a4fac None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:25.130521 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48883d37-bdb3-4fb8-9a5c-12b4a85a4fac None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:25.131292 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48883d37-bdb3-4fb8-9a5c-12b4a85a4fac None admin] RBAC: Adding query filter params (name=service) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:25.131606 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48883d37-bdb3-4fb8-9a5c-12b4a85a4fac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:25.133000 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48883d37-bdb3-4fb8-9a5c-12b4a85a4fac None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:25.141518 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 343/677] 10.222.0.86 () {56 vars in 1103 bytes} [Tue Jun 7 14:21:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:25.142304 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48883d37-bdb3-4fb8-9a5c-12b4a85a4fac None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:25.169597 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:25.178983 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1428b0a-8ce9-4e90-aeab-ba1ea3bd4ead None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:25.212838 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dbd2aa-7b50-4f1b-8101-2416894aa31c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:25.213736 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dbd2aa-7b50-4f1b-8101-2416894aa31c None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:25.214024 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dbd2aa-7b50-4f1b-8101-2416894aa31c None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:25.214304 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dbd2aa-7b50-4f1b-8101-2416894aa31c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:25.222184 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dbd2aa-7b50-4f1b-8101-2416894aa31c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:25.223648 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dbd2aa-7b50-4f1b-8101-2416894aa31c None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:25.243687 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-69dbd2aa-7b50-4f1b-8101-2416894aa31c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:21:25.243687 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:25.243687 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:25.243687 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:25.243687 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:25.243687 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:25.243687 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:25.243687 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:25.243687 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:25.243687 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:25.243687 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:25.243687 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:25.243687 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 14:21:25.243687 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 14:21:25.243687 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 14:21:25.244736 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 14:21:25.244736 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:25.244736 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:25.244736 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:25.244736 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:25.244736 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:25.244736 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:25.244736 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:25.244736 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:25.244736 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:25.244736 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:25.244736 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:25.244736 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:25.244736 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:25.244736 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:25.244736 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:25.244736 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:25.245633 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 14:21:25.245633 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 14:21:25.245633 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 14:21:25.245633 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 14:21:25.245633 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 14:21:25.245633 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 14:21:25.245633 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:21:25.245633 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:21:25.245633 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 335/678] 10.222.0.86 () {56 vars in 1111 bytes} [Tue Jun 7 14:21:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:21:25.246140 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dbd2aa-7b50-4f1b-8101-2416894aa31c None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:25.258716 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48883d37-bdb3-4fb8-9a5c-12b4a85a4fac None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:25.281947 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:25.295349 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905596ea-fe13-47b3-ba2e-6169440eba77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:25.296693 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905596ea-fe13-47b3-ba2e-6169440eba77 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:25.296988 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905596ea-fe13-47b3-ba2e-6169440eba77 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:25.297394 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905596ea-fe13-47b3-ba2e-6169440eba77 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:25.312053 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905596ea-fe13-47b3-ba2e-6169440eba77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:21:25.321236 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-905596ea-fe13-47b3-ba2e-6169440eba77 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 14:21:25.321236 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:25.321236 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:25.321236 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:25.321236 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:25.321236 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:25.321236 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:25.321236 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:25.321236 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:25.321236 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:25.321236 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:25.321236 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:25.321236 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:21:25.321236 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:21:25.321236 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:21:25.321236 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:21:25.322354 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:21:25.322354 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:21:25.322354 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:21:25.322354 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:21:25.322354 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:25.322354 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:25.322354 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:25.322354 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:25.322354 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:25.322354 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:25.322354 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:25.322354 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:25.322354 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:25.322354 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:25.322354 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:25.322354 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:25.323349 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:25.323349 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:25.323349 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:25.323349 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:25.323349 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:21:25.323349 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:21:25.323349 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:21:25.323349 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:21:25.323349 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:21:25.323349 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:21:25.323349 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 14:21:25.323349 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:21:25.326368 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 344/679] 10.222.0.86 () {56 vars in 1096 bytes} [Tue Jun 7 14:21:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:21:25.327175 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905596ea-fe13-47b3-ba2e-6169440eba77 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:25.354482 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dbd2aa-7b50-4f1b-8101-2416894aa31c None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:25.388993 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d618b32-78de-41c7-beac-268ac9617343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:25.389661 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d618b32-78de-41c7-beac-268ac9617343 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:25.389950 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d618b32-78de-41c7-beac-268ac9617343 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:25.390234 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d618b32-78de-41c7-beac-268ac9617343 None admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:25.391037 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d618b32-78de-41c7-beac-268ac9617343 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:25.391343 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d618b32-78de-41c7-beac-268ac9617343 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:25.392811 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d618b32-78de-41c7-beac-268ac9617343 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:25.405971 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 336/680] 10.222.0.86 () {56 vars in 1148 bytes} [Tue Jun 7 14:21:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:25.407044 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d618b32-78de-41c7-beac-268ac9617343 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:25.420649 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:25.439975 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905596ea-fe13-47b3-ba2e-6169440eba77 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:25.474522 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4b4a9f-388d-4152-bb0f-cbfb9679c9d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:25.475312 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4b4a9f-388d-4152-bb0f-cbfb9679c9d3 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:25.475600 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4b4a9f-388d-4152-bb0f-cbfb9679c9d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:25.475925 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4b4a9f-388d-4152-bb0f-cbfb9679c9d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:25.486665 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4b4a9f-388d-4152-bb0f-cbfb9679c9d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:25.488064 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4b4a9f-388d-4152-bb0f-cbfb9679c9d3 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:25.505873 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-cf4b4a9f-388d-4152-bb0f-cbfb9679c9d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:21:25.505873 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:25.505873 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:25.505873 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:25.505873 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:25.505873 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:25.505873 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:25.505873 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:25.505873 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:25.505873 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:25.505873 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:25.505873 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:25.505873 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:21:25.505873 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:21:25.505873 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:21:25.506743 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:21:25.506743 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:25.506743 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:25.506743 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:25.506743 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:25.506743 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:25.506743 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:25.506743 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:25.506743 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:25.506743 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:25.506743 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:25.506743 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:25.506743 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:25.506743 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:25.506743 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:25.506743 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:25.506743 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:25.507614 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:21:25.507614 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:21:25.507614 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:21:25.507614 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:21:25.507614 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 345/681] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jun 7 14:21:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:21:25.507915 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4b4a9f-388d-4152-bb0f-cbfb9679c9d3 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:25.519696 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d618b32-78de-41c7-beac-268ac9617343 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:25.544504 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:25.556386 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25818537-f051-476e-8fee-bcb084502d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:25.557230 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25818537-f051-476e-8fee-bcb084502d6e None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:25.557663 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25818537-f051-476e-8fee-bcb084502d6e None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:25.558097 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25818537-f051-476e-8fee-bcb084502d6e None admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:25.558888 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25818537-f051-476e-8fee-bcb084502d6e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:25.559201 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25818537-f051-476e-8fee-bcb084502d6e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:25.560736 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25818537-f051-476e-8fee-bcb084502d6e None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:25.577843 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 337/682] 10.222.0.86 () {56 vars in 1148 bytes} [Tue Jun 7 14:21:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:25.578733 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25818537-f051-476e-8fee-bcb084502d6e None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:25.612642 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4b4a9f-388d-4152-bb0f-cbfb9679c9d3 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:25.648374 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a818ef-ac56-4456-b84d-a19b0ecb9bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:25.649225 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:25.649734 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a818ef-ac56-4456-b84d-a19b0ecb9bc2 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:25.650022 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a818ef-ac56-4456-b84d-a19b0ecb9bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:25.650346 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a818ef-ac56-4456-b84d-a19b0ecb9bc2 None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:25.651106 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a818ef-ac56-4456-b84d-a19b0ecb9bc2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:25.651428 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a818ef-ac56-4456-b84d-a19b0ecb9bc2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:25.652832 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a818ef-ac56-4456-b84d-a19b0ecb9bc2 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:25.666538 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 346/683] 10.222.0.86 () {56 vars in 1099 bytes} [Tue Jun 7 14:21:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:25.666538 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a818ef-ac56-4456-b84d-a19b0ecb9bc2 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:25.687187 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25818537-f051-476e-8fee-bcb084502d6e None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:25.723084 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda727be-024e-4aee-847b-29035e759334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:25.723747 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda727be-024e-4aee-847b-29035e759334 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:25.724059 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda727be-024e-4aee-847b-29035e759334 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:25.724340 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda727be-024e-4aee-847b-29035e759334 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:25.725172 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda727be-024e-4aee-847b-29035e759334 None admin] RBAC: Adding query filter params (role.id=28e9b75018ac44c0afe7ab728071f2d5, scope.project.id=e429537b190c4c5ea7e1332ab044ca7a, user.id=b910435e5585436996ba5b5aeb7184bb) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:25.725494 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda727be-024e-4aee-847b-29035e759334 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:25.727033 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda727be-024e-4aee-847b-29035e759334 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:25.733602 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 338/684] 10.222.0.86 () {56 vars in 1374 bytes} [Tue Jun 7 14:21:25 2022] GET /identity/v3/role_assignments?user.id=b910435e5585436996ba5b5aeb7184bb&scope.project.id=e429537b190c4c5ea7e1332ab044ca7a&role.id=28e9b75018ac44c0afe7ab728071f2d5 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:25.744217 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda727be-024e-4aee-847b-29035e759334 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:25.789566 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:25.797461 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a818ef-ac56-4456-b84d-a19b0ecb9bc2 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:25.850225 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c68aa4-aa8b-4c1c-866e-e453d50fc2a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:25.851261 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c68aa4-aa8b-4c1c-866e-e453d50fc2a7 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:25.851697 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c68aa4-aa8b-4c1c-866e-e453d50fc2a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:25.852910 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c68aa4-aa8b-4c1c-866e-e453d50fc2a7 None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:25.854106 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c68aa4-aa8b-4c1c-866e-e453d50fc2a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:25.854684 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c68aa4-aa8b-4c1c-866e-e453d50fc2a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:25.857161 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c68aa4-aa8b-4c1c-866e-e453d50fc2a7 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:25.872621 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda727be-024e-4aee-847b-29035e759334 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:25.873090 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 347/685] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jun 7 14:21:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:25.874039 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c68aa4-aa8b-4c1c-866e-e453d50fc2a7 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:25.927104 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe707f47-7ba0-4a8c-9bfd-fc65ef7a4767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:25.928378 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe707f47-7ba0-4a8c-9bfd-fc65ef7a4767 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:25.929343 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe707f47-7ba0-4a8c-9bfd-fc65ef7a4767 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:25.929812 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe707f47-7ba0-4a8c-9bfd-fc65ef7a4767 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:25.931101 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe707f47-7ba0-4a8c-9bfd-fc65ef7a4767 None admin] RBAC: Adding query filter params (role.id=28e9b75018ac44c0afe7ab728071f2d5, scope.project.id=e429537b190c4c5ea7e1332ab044ca7a, user.id=dda603ec5517460a83c333db2af804d4) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:25.931852 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe707f47-7ba0-4a8c-9bfd-fc65ef7a4767 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:25.933929 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe707f47-7ba0-4a8c-9bfd-fc65ef7a4767 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:25.936807 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:25.947790 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 339/686] 10.222.0.86 () {56 vars in 1374 bytes} [Tue Jun 7 14:21:25 2022] GET /identity/v3/role_assignments?user.id=dda603ec5517460a83c333db2af804d4&scope.project.id=e429537b190c4c5ea7e1332ab044ca7a&role.id=28e9b75018ac44c0afe7ab728071f2d5 => generated 608 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:25.947790 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe707f47-7ba0-4a8c-9bfd-fc65ef7a4767 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:26.008291 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c68aa4-aa8b-4c1c-866e-e453d50fc2a7 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:26.058692 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4b4edf-d3dc-4b8d-a6c4-6cb27320e6b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:26.060267 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4b4edf-d3dc-4b8d-a6c4-6cb27320e6b3 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:26.060653 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4b4edf-d3dc-4b8d-a6c4-6cb27320e6b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:26.061031 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4b4edf-d3dc-4b8d-a6c4-6cb27320e6b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:26.073602 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4b4edf-d3dc-4b8d-a6c4-6cb27320e6b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:26.075292 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4b4edf-d3dc-4b8d-a6c4-6cb27320e6b3 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:26.075411 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe707f47-7ba0-4a8c-9bfd-fc65ef7a4767 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:26.096097 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-cc4b4edf-d3dc-4b8d-a6c4-6cb27320e6b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:21:26.096097 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:26.096097 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:26.096097 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:26.096097 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:26.096097 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:26.096097 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:26.096097 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:26.096097 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:26.096097 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:26.096097 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:26.096097 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:26.096097 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:21:26.096097 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:21:26.096097 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:21:26.097222 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:21:26.097222 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:26.097222 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:26.097222 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:26.097222 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:26.097222 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:26.097222 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:26.097222 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:26.097222 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:26.097222 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:26.097222 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:26.097222 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:26.097222 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:26.097222 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:26.097222 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:26.097222 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:26.097222 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:26.098311 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:21:26.098311 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:21:26.098311 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:21:26.098311 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:21:26.103896 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 348/687] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jun 7 14:21:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:21:26.105761 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4b4edf-d3dc-4b8d-a6c4-6cb27320e6b3 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:26.115794 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53ca3e0-3565-47a5-9789-a1ea25659555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:26.116603 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53ca3e0-3565-47a5-9789-a1ea25659555 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:26.117036 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53ca3e0-3565-47a5-9789-a1ea25659555 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:26.117313 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53ca3e0-3565-47a5-9789-a1ea25659555 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:26.118804 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:26.128512 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53ca3e0-3565-47a5-9789-a1ea25659555 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:26.130328 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53ca3e0-3565-47a5-9789-a1ea25659555 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:26.146856 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-f53ca3e0-3565-47a5-9789-a1ea25659555 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 07 14:21:26.146856 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:26.146856 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:26.146856 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:26.146856 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:26.146856 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:26.146856 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:26.146856 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:26.146856 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:26.146856 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:26.146856 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:26.146856 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:26.146856 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 14:21:26.146856 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 14:21:26.146856 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 14:21:26.146856 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 14:21:26.148089 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:26.148089 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:26.148089 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 14:21:26.148089 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:21:26.148089 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 14:21:26.148089 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:21:26.148089 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:26.148089 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:26.148089 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:26.148089 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:26.148089 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:26.148089 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:26.148089 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:26.148089 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:26.148089 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:26.148089 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:26.148089 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:26.148089 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:26.149233 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:26.149233 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:26.149233 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 14:21:26.149233 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 14:21:26.149233 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 14:21:26.149233 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 14:21:26.149233 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 14:21:26.149233 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 14:21:26.149233 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 07 14:21:26.149233 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:21:26.151647 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 340/688] 10.222.0.86 () {56 vars in 1096 bytes} [Tue Jun 7 14:21:25 2022] GET /identity/v3/users/swift => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:21:26.161414 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53ca3e0-3565-47a5-9789-a1ea25659555 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:26.251809 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4b4edf-d3dc-4b8d-a6c4-6cb27320e6b3 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:26.253581 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:26.293128 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cbf56e-73b6-4339-bda1-b11432e55a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:26.294746 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cbf56e-73b6-4339-bda1-b11432e55a83 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:26.295233 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cbf56e-73b6-4339-bda1-b11432e55a83 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:26.295679 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cbf56e-73b6-4339-bda1-b11432e55a83 None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:26.296617 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cbf56e-73b6-4339-bda1-b11432e55a83 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:26.297126 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cbf56e-73b6-4339-bda1-b11432e55a83 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:26.298683 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cbf56e-73b6-4339-bda1-b11432e55a83 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:26.300385 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53ca3e0-3565-47a5-9789-a1ea25659555 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:26.316135 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 349/689] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jun 7 14:21:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:26.321915 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cbf56e-73b6-4339-bda1-b11432e55a83 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:26.345776 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9c0d90-85c4-4d69-9954-01cc3d4bc695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:26.346449 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9c0d90-85c4-4d69-9954-01cc3d4bc695 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:26.346731 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9c0d90-85c4-4d69-9954-01cc3d4bc695 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:26.347009 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9c0d90-85c4-4d69-9954-01cc3d4bc695 None admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:26.347880 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9c0d90-85c4-4d69-9954-01cc3d4bc695 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:26.348188 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9c0d90-85c4-4d69-9954-01cc3d4bc695 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:26.349618 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9c0d90-85c4-4d69-9954-01cc3d4bc695 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:26.377011 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 341/690] 10.222.0.86 () {56 vars in 1135 bytes} [Tue Jun 7 14:21:26 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:26.378286 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9c0d90-85c4-4d69-9954-01cc3d4bc695 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:26.428155 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:26.455865 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cbf56e-73b6-4339-bda1-b11432e55a83 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:26.484443 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9c0d90-85c4-4d69-9954-01cc3d4bc695 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:26.502525 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a0d86a-49a4-4beb-b90d-8a4f195c7a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:26.503317 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a0d86a-49a4-4beb-b90d-8a4f195c7a81 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:26.503599 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a0d86a-49a4-4beb-b90d-8a4f195c7a81 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:26.504671 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a0d86a-49a4-4beb-b90d-8a4f195c7a81 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:26.506795 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:26.519967 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a0d86a-49a4-4beb-b90d-8a4f195c7a81 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:26.522616 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a0d86a-49a4-4beb-b90d-8a4f195c7a81 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:26.527135 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e0cb04-75b2-4553-afe6-1fb6c0a5de41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:26.528452 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e0cb04-75b2-4553-afe6-1fb6c0a5de41 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:26.528746 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e0cb04-75b2-4553-afe6-1fb6c0a5de41 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:26.529025 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e0cb04-75b2-4553-afe6-1fb6c0a5de41 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:26.542254 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-d8a0d86a-49a4-4beb-b90d-8a4f195c7a81 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 07 14:21:26.542254 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:26.542254 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:26.542254 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:26.542254 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:26.542254 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:26.542254 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:26.542254 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:26.542254 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:26.542254 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:26.542254 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:26.542254 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:26.542254 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 14:21:26.542254 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 14:21:26.542254 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 14:21:26.542254 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 14:21:26.543257 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:26.543257 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:26.543257 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 14:21:26.543257 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:21:26.543257 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 14:21:26.543257 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:21:26.543257 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:26.543257 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:26.543257 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:26.543257 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:26.543257 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:26.543257 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:26.543257 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:26.543257 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:26.543257 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:26.543257 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:26.543257 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:26.543257 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:26.544886 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:26.544886 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:26.544886 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 14:21:26.544886 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 14:21:26.544886 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 14:21:26.544886 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 14:21:26.544886 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 14:21:26.544886 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 14:21:26.544886 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 07 14:21:26.544886 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:21:26.550678 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 350/691] 10.222.0.86 () {56 vars in 1093 bytes} [Tue Jun 7 14:21:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:21:26.550678 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ef0b43-5c8d-4596-bafd-af14e9724d52 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:26.550678 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ef0b43-5c8d-4596-bafd-af14e9724d52 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:26.550678 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ef0b43-5c8d-4596-bafd-af14e9724d52 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:26.550678 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 351/692] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:21:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:21:26.552054 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ef0b43-5c8d-4596-bafd-af14e9724d52 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:26.615574 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e0cb04-75b2-4553-afe6-1fb6c0a5de41 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:26.617408 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e0cb04-75b2-4553-afe6-1fb6c0a5de41 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:26.672282 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ef0b43-5c8d-4596-bafd-af14e9724d52 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:26.701260 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:26.709576 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36ba767-22a4-4a32-9648-1c41a09f21c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:26.710250 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36ba767-22a4-4a32-9648-1c41a09f21c0 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:26.710533 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36ba767-22a4-4a32-9648-1c41a09f21c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:26.710808 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36ba767-22a4-4a32-9648-1c41a09f21c0 None admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:26.711720 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36ba767-22a4-4a32-9648-1c41a09f21c0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:26.712034 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36ba767-22a4-4a32-9648-1c41a09f21c0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:26.713657 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36ba767-22a4-4a32-9648-1c41a09f21c0 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:26.737838 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 352/693] 10.222.0.86 () {56 vars in 1133 bytes} [Tue Jun 7 14:21:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:26.737838 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2624ba4b-fe50-4752-bbca-6d19a909c08a None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:26.737838 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2624ba4b-fe50-4752-bbca-6d19a909c08a None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:26.737838 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2624ba4b-fe50-4752-bbca-6d19a909c08a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:26.754860 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-2624ba4b-fe50-4752-bbca-6d19a909c08a None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:21:26.756095 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-2624ba4b-fe50-4752-bbca-6d19a909c08a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:21:26.760269 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 342/694] 10.222.0.86 () {58 vars in 1282 bytes} [Tue Jun 7 14:21:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 07 14:21:26.761811 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e0cb04-75b2-4553-afe6-1fb6c0a5de41 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:26.786186 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:26.832400 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 353/695] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:21:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 14:21:26.841161 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2624ba4b-fe50-4752-bbca-6d19a909c08a None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:26.897089 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e0cb04-75b2-4553-afe6-1fb6c0a5de41 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:26.946975 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f6758e-501d-440c-a5c4-3ebb280d3074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:26.948253 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f6758e-501d-440c-a5c4-3ebb280d3074 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:26.949136 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f6758e-501d-440c-a5c4-3ebb280d3074 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:26.949606 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f6758e-501d-440c-a5c4-3ebb280d3074 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:26.966170 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2624ba4b-fe50-4752-bbca-6d19a909c08a None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:26.983891 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:27.003004 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93dfa2c-39f3-4f50-96fd-c0f109d9ce55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:27.003827 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93dfa2c-39f3-4f50-96fd-c0f109d9ce55 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:27.004111 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93dfa2c-39f3-4f50-96fd-c0f109d9ce55 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:27.004384 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93dfa2c-39f3-4f50-96fd-c0f109d9ce55 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:27.015002 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93dfa2c-39f3-4f50-96fd-c0f109d9ce55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:27.016451 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93dfa2c-39f3-4f50-96fd-c0f109d9ce55 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:27.034946 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-a93dfa2c-39f3-4f50-96fd-c0f109d9ce55 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:21:27.034946 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:27.034946 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:27.034946 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:27.034946 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:27.034946 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:27.034946 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:27.034946 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:27.034946 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:27.034946 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:27.034946 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:27.034946 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:27.034946 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:21:27.034946 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:21:27.034946 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:21:27.036023 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:21:27.036023 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:27.036023 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:27.036023 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:27.036023 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:27.036023 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:27.036023 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:27.036023 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:27.036023 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:27.036023 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:27.036023 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:27.036023 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:27.036023 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:27.036023 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:27.036023 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:27.036023 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:27.036023 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:27.037105 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:21:27.037105 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:21:27.037105 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:21:27.037105 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:21:27.040042 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 354/696] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jun 7 14:21:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:21:27.040980 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93dfa2c-39f3-4f50-96fd-c0f109d9ce55 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:27.049186 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f6758e-501d-440c-a5c4-3ebb280d3074 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:27.050750 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f6758e-501d-440c-a5c4-3ebb280d3074 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:27.070617 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:27.166428 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 343/697] 10.222.0.86 () {58 vars in 1282 bytes} [Tue Jun 7 14:21:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 07 14:21:27.167492 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f6758e-501d-440c-a5c4-3ebb280d3074 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:27.174433 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93dfa2c-39f3-4f50-96fd-c0f109d9ce55 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:27.211392 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2dea46-64f0-41a8-9b0f-b487f9c15b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:27.212412 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2dea46-64f0-41a8-9b0f-b487f9c15b84 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:27.212790 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2dea46-64f0-41a8-9b0f-b487f9c15b84 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:27.213188 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2dea46-64f0-41a8-9b0f-b487f9c15b84 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:27.214057 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2dea46-64f0-41a8-9b0f-b487f9c15b84 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:27.215415 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2dea46-64f0-41a8-9b0f-b487f9c15b84 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:27.230027 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-ca2dea46-64f0-41a8-9b0f-b487f9c15b84 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 07 14:21:27.230027 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:27.230027 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 07 14:21:27.230027 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 07 14:21:27.230027 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 07 14:21:27.230027 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 07 14:21:27.230027 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 07 14:21:27.230027 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 14:21:27.230027 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 07 14:21:27.230027 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:21:27.230027 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 07 14:21:27.230027 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:21:27.230027 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:27.230027 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:27.230027 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:27.230027 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:27.231215 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:27.231215 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:27.231215 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:27.231215 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:27.231215 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:27.231215 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:27.231215 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:27.231215 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 07 14:21:27.231215 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 07 14:21:27.231215 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 07 14:21:27.231215 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 07 14:21:27.231215 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:27.231215 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:27.231215 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:27.231215 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:27.231215 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:27.232372 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:27.232372 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:27.232372 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:27.232372 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:27.232372 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:27.232372 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:27.232372 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:27.232372 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:27.232372 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:27.232372 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:27.232372 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:27.232372 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 07 14:21:27.232372 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 14:21:27.232372 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 07 14:21:27.232372 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:21:27.234639 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 355/698] 10.222.0.86 () {56 vars in 1129 bytes} [Tue Jun 7 14:21:27 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:21:27.235655 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2dea46-64f0-41a8-9b0f-b487f9c15b84 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:27.270039 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:27.309731 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f6758e-501d-440c-a5c4-3ebb280d3074 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:27.329424 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:27.346996 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2dea46-64f0-41a8-9b0f-b487f9c15b84 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:27.349214 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97961b1-4eb0-4c45-b888-614a101ba689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:27.350151 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97961b1-4eb0-4c45-b888-614a101ba689 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:27.350657 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97961b1-4eb0-4c45-b888-614a101ba689 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:27.351185 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97961b1-4eb0-4c45-b888-614a101ba689 None admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:27.352176 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97961b1-4eb0-4c45-b888-614a101ba689 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:27.352708 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97961b1-4eb0-4c45-b888-614a101ba689 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:27.354298 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97961b1-4eb0-4c45-b888-614a101ba689 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:27.372589 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 344/699] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jun 7 14:21:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:27.373855 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97961b1-4eb0-4c45-b888-614a101ba689 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:27.386303 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e97972b-1ef8-43f5-9637-1dbd0aad3665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:27.387244 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e97972b-1ef8-43f5-9637-1dbd0aad3665 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:27.387559 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e97972b-1ef8-43f5-9637-1dbd0aad3665 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:27.387896 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e97972b-1ef8-43f5-9637-1dbd0aad3665 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:27.398928 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e97972b-1ef8-43f5-9637-1dbd0aad3665 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:27.400572 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e97972b-1ef8-43f5-9637-1dbd0aad3665 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:27.421677 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-9e97972b-1ef8-43f5-9637-1dbd0aad3665 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:21:27.421677 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:27.421677 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:27.421677 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:27.421677 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:27.421677 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:27.421677 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:27.421677 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:27.421677 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:27.421677 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:27.421677 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:27.421677 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:27.421677 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:21:27.421677 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:21:27.421677 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:21:27.422632 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:21:27.422632 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:27.422632 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:27.422632 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:27.422632 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:27.422632 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:27.422632 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:27.422632 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:27.422632 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:27.422632 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:27.422632 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:27.422632 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:27.422632 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:27.422632 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:27.422632 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:27.422632 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:27.422632 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:27.423513 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:21:27.423513 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:21:27.423513 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:21:27.423513 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:21:27.423513 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 356/700] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jun 7 14:21:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:21:27.428234 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e97972b-1ef8-43f5-9637-1dbd0aad3665 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:27.487305 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97961b1-4eb0-4c45-b888-614a101ba689 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:27.518532 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:27.524263 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af711b8-7502-467e-9dd5-b35d1fc0dc0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:27.525212 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af711b8-7502-467e-9dd5-b35d1fc0dc0e None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:27.525705 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af711b8-7502-467e-9dd5-b35d1fc0dc0e None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:27.526207 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af711b8-7502-467e-9dd5-b35d1fc0dc0e None admin] PATH_INFO: `/v3/services` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:27.527118 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af711b8-7502-467e-9dd5-b35d1fc0dc0e None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:27.527632 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af711b8-7502-467e-9dd5-b35d1fc0dc0e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:27.529290 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af711b8-7502-467e-9dd5-b35d1fc0dc0e None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:27.534268 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 345/701] 10.222.0.86 () {56 vars in 1124 bytes} [Tue Jun 7 14:21:27 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:27.537562 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e97972b-1ef8-43f5-9637-1dbd0aad3665 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:27.537672 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af711b8-7502-467e-9dd5-b35d1fc0dc0e None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:27.573994 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca52e61-59f2-4aac-ba04-50556e3fca8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:27.574409 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca52e61-59f2-4aac-ba04-50556e3fca8f None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:27.574691 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca52e61-59f2-4aac-ba04-50556e3fca8f None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:27.574986 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca52e61-59f2-4aac-ba04-50556e3fca8f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:27.581603 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:27.582941 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca52e61-59f2-4aac-ba04-50556e3fca8f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:27.584546 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca52e61-59f2-4aac-ba04-50556e3fca8f None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:27.598401 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-8ca52e61-59f2-4aac-ba04-50556e3fca8f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:21:27.598401 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:27.598401 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:27.598401 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:27.598401 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:27.598401 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:27.598401 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:27.598401 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:27.598401 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:27.598401 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:27.598401 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:27.598401 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:27.598401 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 14:21:27.598401 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 14:21:27.598401 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 14:21:27.605478 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 14:21:27.605478 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:27.605478 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:27.605478 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:27.605478 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:27.605478 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:27.605478 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:27.605478 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:27.605478 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:27.605478 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:27.605478 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:27.605478 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:27.605478 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:27.605478 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:27.605478 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:27.605478 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:27.605478 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:27.606901 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 14:21:27.606901 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 14:21:27.606901 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 14:21:27.606901 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 14:21:27.606901 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 14:21:27.606901 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 14:21:27.606901 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:21:27.606901 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:21:27.606901 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 357/702] 10.222.0.86 () {56 vars in 1111 bytes} [Tue Jun 7 14:21:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:21:27.606901 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca52e61-59f2-4aac-ba04-50556e3fca8f None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:27.653605 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af711b8-7502-467e-9dd5-b35d1fc0dc0e None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:27.691038 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf05f7c-643d-4239-82f8-3e43210f63a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:27.692138 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf05f7c-643d-4239-82f8-3e43210f63a7 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:27.692634 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf05f7c-643d-4239-82f8-3e43210f63a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:27.693146 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf05f7c-643d-4239-82f8-3e43210f63a7 None admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:27.694171 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf05f7c-643d-4239-82f8-3e43210f63a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:27.694781 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf05f7c-643d-4239-82f8-3e43210f63a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:27.696411 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf05f7c-643d-4239-82f8-3e43210f63a7 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:27.709645 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca52e61-59f2-4aac-ba04-50556e3fca8f None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:27.710458 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 346/703] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jun 7 14:21:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:27.711487 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf05f7c-643d-4239-82f8-3e43210f63a7 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:27.751464 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e437be73-b2dd-4311-9ac7-1eea9b8907c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:27.752172 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e437be73-b2dd-4311-9ac7-1eea9b8907c7 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:27.752456 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e437be73-b2dd-4311-9ac7-1eea9b8907c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:27.752728 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e437be73-b2dd-4311-9ac7-1eea9b8907c7 None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:27.753437 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e437be73-b2dd-4311-9ac7-1eea9b8907c7 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:27.753742 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e437be73-b2dd-4311-9ac7-1eea9b8907c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:27.755093 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e437be73-b2dd-4311-9ac7-1eea9b8907c7 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:27.761564 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 358/704] 10.222.0.86 () {56 vars in 1124 bytes} [Tue Jun 7 14:21:27 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:27.762494 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e437be73-b2dd-4311-9ac7-1eea9b8907c7 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:27.775516 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:27.824366 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:27.828184 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf05f7c-643d-4239-82f8-3e43210f63a7 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:27.867237 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11646fb-7fad-42b5-93f0-d602bd4f3022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:27.868320 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11646fb-7fad-42b5-93f0-d602bd4f3022 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:27.868932 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11646fb-7fad-42b5-93f0-d602bd4f3022 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:27.869422 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11646fb-7fad-42b5-93f0-d602bd4f3022 None admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:27.870499 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11646fb-7fad-42b5-93f0-d602bd4f3022 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:27.871055 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11646fb-7fad-42b5-93f0-d602bd4f3022 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:27.873326 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11646fb-7fad-42b5-93f0-d602bd4f3022 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:27.888052 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 347/705] 10.222.0.86 () {56 vars in 1148 bytes} [Tue Jun 7 14:21:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:27.894364 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11646fb-7fad-42b5-93f0-d602bd4f3022 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:27.926275 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e437be73-b2dd-4311-9ac7-1eea9b8907c7 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:28.007818 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11646fb-7fad-42b5-93f0-d602bd4f3022 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:28.037084 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293ca6d8-38ec-491e-b8ce-8d0b9a41b358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:28.037854 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293ca6d8-38ec-491e-b8ce-8d0b9a41b358 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:28.038138 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293ca6d8-38ec-491e-b8ce-8d0b9a41b358 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:28.038415 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293ca6d8-38ec-491e-b8ce-8d0b9a41b358 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:28.049551 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3234f64-b7b9-4302-ad35-7461a9bd536e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:28.050726 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3234f64-b7b9-4302-ad35-7461a9bd536e None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:28.051232 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3234f64-b7b9-4302-ad35-7461a9bd536e None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:28.051713 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3234f64-b7b9-4302-ad35-7461a9bd536e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:28.052783 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3234f64-b7b9-4302-ad35-7461a9bd536e None admin] RBAC: Adding query filter params (role.id=28e9b75018ac44c0afe7ab728071f2d5, scope.project.id=e429537b190c4c5ea7e1332ab044ca7a, user.id=c9774349dd2b4ec092ef04c3df050a7e) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:28.053304 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3234f64-b7b9-4302-ad35-7461a9bd536e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:28.054982 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3234f64-b7b9-4302-ad35-7461a9bd536e None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:28.061052 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293ca6d8-38ec-491e-b8ce-8d0b9a41b358 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:28.062581 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293ca6d8-38ec-491e-b8ce-8d0b9a41b358 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:28.062799 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 348/706] 10.222.0.86 () {56 vars in 1374 bytes} [Tue Jun 7 14:21:27 2022] GET /identity/v3/role_assignments?user.id=c9774349dd2b4ec092ef04c3df050a7e&scope.project.id=e429537b190c4c5ea7e1332ab044ca7a&role.id=28e9b75018ac44c0afe7ab728071f2d5 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:21:28.083348 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-293ca6d8-38ec-491e-b8ce-8d0b9a41b358 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:21:28.083348 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:28.083348 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:28.083348 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:28.083348 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:28.083348 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:28.083348 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:28.083348 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:28.083348 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:28.083348 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:28.083348 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:28.083348 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:28.083348 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 14:21:28.083348 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 14:21:28.083348 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 14:21:28.084392 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 14:21:28.084392 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:28.084392 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:28.084392 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:28.084392 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:28.084392 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:28.084392 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:28.084392 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:28.084392 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:28.084392 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:28.084392 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:28.084392 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:28.084392 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:28.084392 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:28.084392 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:28.084392 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:28.084392 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:28.085269 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 14:21:28.085269 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 14:21:28.085269 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 14:21:28.085269 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 14:21:28.085269 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 14:21:28.085269 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 14:21:28.085269 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:21:28.085269 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:21:28.087925 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 359/707] 10.222.0.86 () {56 vars in 1111 bytes} [Tue Jun 7 14:21:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:21:28.096943 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3234f64-b7b9-4302-ad35-7461a9bd536e None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:28.132623 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:28.223159 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3234f64-b7b9-4302-ad35-7461a9bd536e None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:28.263214 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b6fa4e-e138-4ea6-9497-7d889d476968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:28.263838 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b6fa4e-e138-4ea6-9497-7d889d476968 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:28.264131 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b6fa4e-e138-4ea6-9497-7d889d476968 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:28.264410 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b6fa4e-e138-4ea6-9497-7d889d476968 None admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:28.265271 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b6fa4e-e138-4ea6-9497-7d889d476968 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:28.265594 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b6fa4e-e138-4ea6-9497-7d889d476968 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:28.267073 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b6fa4e-e138-4ea6-9497-7d889d476968 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:28.281178 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 349/708] 10.222.0.86 () {56 vars in 1148 bytes} [Tue Jun 7 14:21:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:28.287298 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293ca6d8-38ec-491e-b8ce-8d0b9a41b358 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:28.370274 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:28.409740 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293ca6d8-38ec-491e-b8ce-8d0b9a41b358 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:28.446172 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c6faa8-3a48-46cc-8b80-a19fe83ae961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:28.446844 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c6faa8-3a48-46cc-8b80-a19fe83ae961 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:28.447127 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c6faa8-3a48-46cc-8b80-a19fe83ae961 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:28.447402 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c6faa8-3a48-46cc-8b80-a19fe83ae961 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:28.448288 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c6faa8-3a48-46cc-8b80-a19fe83ae961 None admin] RBAC: Adding query filter params (role.id=e3bf6239f5bf477b965704b086786f11, scope.project.id=e429537b190c4c5ea7e1332ab044ca7a, user.id=b99cfb70f54c45c8870369359da20378) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:28.448606 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c6faa8-3a48-46cc-8b80-a19fe83ae961 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:28.450550 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c6faa8-3a48-46cc-8b80-a19fe83ae961 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:28.456854 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 360/709] 10.222.0.86 () {56 vars in 1374 bytes} [Tue Jun 7 14:21:28 2022] GET /identity/v3/role_assignments?user.id=b99cfb70f54c45c8870369359da20378&scope.project.id=e429537b190c4c5ea7e1332ab044ca7a&role.id=e3bf6239f5bf477b965704b086786f11 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:28.493827 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dc916d-20a0-42e1-a1eb-7bec9800b585 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:28.494170 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dc916d-20a0-42e1-a1eb-7bec9800b585 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:28.494401 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dc916d-20a0-42e1-a1eb-7bec9800b585 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:28.496068 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 350/710] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:21:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:21:28.502495 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1497b4b1-67cd-44ec-9c8f-4634f05e8d7d None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:28.502777 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1497b4b1-67cd-44ec-9c8f-4634f05e8d7d None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:28.503060 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1497b4b1-67cd-44ec-9c8f-4634f05e8d7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:28.521165 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-1497b4b1-67cd-44ec-9c8f-4634f05e8d7d None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:21:28.522394 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-1497b4b1-67cd-44ec-9c8f-4634f05e8d7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:21:28.602436 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 361/711] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:21:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 14:21:28.626449 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dc916d-20a0-42e1-a1eb-7bec9800b585 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:28.628943 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dca986d-9a22-4a2a-9e80-fede95858bd6 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:28.629239 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dca986d-9a22-4a2a-9e80-fede95858bd6 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:28.629517 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dca986d-9a22-4a2a-9e80-fede95858bd6 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:28.631296 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 362/712] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:21:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:21:28.636521 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4182db1-05a0-446a-933b-96a765dfd74e None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:28.636865 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4182db1-05a0-446a-933b-96a765dfd74e None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:28.637147 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4182db1-05a0-446a-933b-96a765dfd74e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:28.664602 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-c4182db1-05a0-446a-933b-96a765dfd74e None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:21:28.666064 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-c4182db1-05a0-446a-933b-96a765dfd74e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:21:28.749770 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:28.752963 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:28.761146 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 363/713] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:21:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 07 14:21:28.774207 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dc916d-20a0-42e1-a1eb-7bec9800b585 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:28.787115 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4182db1-05a0-446a-933b-96a765dfd74e None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:28.819091 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ea3d4d-f68f-4099-8e4b-936fd16058e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:28.820508 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ea3d4d-f68f-4099-8e4b-936fd16058e9 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:28.820915 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ea3d4d-f68f-4099-8e4b-936fd16058e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:28.821197 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ea3d4d-f68f-4099-8e4b-936fd16058e9 None admin] PATH_INFO: `/v3/services/network` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:28.821896 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ea3d4d-f68f-4099-8e4b-936fd16058e9 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:28.824184 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ea3d4d-f68f-4099-8e4b-936fd16058e9 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:28.842150 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-54ea3d4d-f68f-4099-8e4b-936fd16058e9 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 07 14:21:28.842150 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:28.842150 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 07 14:21:28.842150 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 07 14:21:28.842150 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 07 14:21:28.842150 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 07 14:21:28.842150 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 07 14:21:28.842150 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 14:21:28.842150 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 07 14:21:28.842150 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:21:28.842150 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 07 14:21:28.842150 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:21:28.842150 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:28.842150 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:28.842150 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:28.842150 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:28.842150 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:28.843597 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:28.843597 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:28.843597 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:28.843597 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:28.843597 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:28.843597 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:28.843597 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 07 14:21:28.843597 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 07 14:21:28.843597 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 07 14:21:28.843597 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 07 14:21:28.843597 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:28.843597 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:28.843597 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:28.843597 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:28.843597 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:28.843597 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:28.844738 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:28.844738 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:28.844738 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:28.844738 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:28.844738 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:28.844738 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:28.844738 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:28.844738 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:28.844738 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:28.844738 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:28.844738 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 07 14:21:28.844738 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 14:21:28.844738 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 07 14:21:28.844738 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:21:28.844738 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 351/714] 10.222.0.86 () {56 vars in 1111 bytes} [Tue Jun 7 14:21:28 2022] GET /identity/v3/services/network => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:21:28.856457 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ea3d4d-f68f-4099-8e4b-936fd16058e9 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:28.919463 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4182db1-05a0-446a-933b-96a765dfd74e None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:28.962937 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163cb723-7e39-403a-b88c-ea3ec912e666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:28.963748 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163cb723-7e39-403a-b88c-ea3ec912e666 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:28.964081 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163cb723-7e39-403a-b88c-ea3ec912e666 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:28.964427 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163cb723-7e39-403a-b88c-ea3ec912e666 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:28.991451 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163cb723-7e39-403a-b88c-ea3ec912e666 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:28.992950 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163cb723-7e39-403a-b88c-ea3ec912e666 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:29.018576 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-163cb723-7e39-403a-b88c-ea3ec912e666 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:21:29.018576 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:29.018576 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:29.018576 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:29.018576 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:29.018576 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:29.018576 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:29.018576 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:29.018576 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:29.018576 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:29.018576 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:29.018576 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:29.018576 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:21:29.018576 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:21:29.018576 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:21:29.019490 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:21:29.019490 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:29.019490 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:29.019490 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:29.019490 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:29.019490 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:29.019490 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:29.019490 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:29.019490 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:29.019490 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:29.019490 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:29.019490 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:29.019490 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:29.019490 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:29.019490 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:29.019490 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:29.019490 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:29.020397 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:21:29.020397 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:21:29.020397 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:21:29.020397 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:21:29.036256 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 364/715] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jun 7 14:21:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 14:21:29.037508 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163cb723-7e39-403a-b88c-ea3ec912e666 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:29.040149 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ea3d4d-f68f-4099-8e4b-936fd16058e9 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:29.103925 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29609565-05fe-4169-97b0-a04f29b57e3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:29.104597 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29609565-05fe-4169-97b0-a04f29b57e3a None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:29.104881 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29609565-05fe-4169-97b0-a04f29b57e3a None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:29.105156 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29609565-05fe-4169-97b0-a04f29b57e3a None admin] PATH_INFO: `/v3/services` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:29.105867 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29609565-05fe-4169-97b0-a04f29b57e3a None admin] RBAC: Adding query filter params (name=network) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:29.106205 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29609565-05fe-4169-97b0-a04f29b57e3a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:29.109449 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29609565-05fe-4169-97b0-a04f29b57e3a None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:29.117334 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:29.118806 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 352/716] 10.222.0.86 () {56 vars in 1112 bytes} [Tue Jun 7 14:21:28 2022] GET /identity/v3/services?name=network => generated 124 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:29.121725 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29609565-05fe-4169-97b0-a04f29b57e3a None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:29.139413 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:29.244234 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163cb723-7e39-403a-b88c-ea3ec912e666 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:29.264047 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29609565-05fe-4169-97b0-a04f29b57e3a None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:29.315836 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1a4e15-8973-4821-8a2e-14a7074c83b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:29.316435 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1a4e15-8973-4821-8a2e-14a7074c83b4 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:29.316717 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1a4e15-8973-4821-8a2e-14a7074c83b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:29.316996 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1a4e15-8973-4821-8a2e-14a7074c83b4 None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:29.317824 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1a4e15-8973-4821-8a2e-14a7074c83b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:29.318137 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1a4e15-8973-4821-8a2e-14a7074c83b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:29.319526 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1a4e15-8973-4821-8a2e-14a7074c83b4 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:29.334354 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27052d99-2975-42ba-825e-4a2c93ad3cc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:29.335027 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27052d99-2975-42ba-825e-4a2c93ad3cc8 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:29.335310 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27052d99-2975-42ba-825e-4a2c93ad3cc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:29.335641 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27052d99-2975-42ba-825e-4a2c93ad3cc8 None admin] PATH_INFO: `/v3/services` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:29.336395 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27052d99-2975-42ba-825e-4a2c93ad3cc8 None admin] RBAC: Adding query filter params (type=network) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:29.336705 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27052d99-2975-42ba-825e-4a2c93ad3cc8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:29.338069 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27052d99-2975-42ba-825e-4a2c93ad3cc8 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:29.344791 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 365/717] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jun 7 14:21:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:29.352657 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1a4e15-8973-4821-8a2e-14a7074c83b4 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:29.353777 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 353/718] 10.222.0.86 () {56 vars in 1112 bytes} [Tue Jun 7 14:21:29 2022] GET /identity/v3/services?type=network => generated 124 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:29.512022 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1a4e15-8973-4821-8a2e-14a7074c83b4 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:29.518647 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:29.561320 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924c9e4c-0f42-4000-81a5-62c7f6cde8b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:29.562072 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924c9e4c-0f42-4000-81a5-62c7f6cde8b0 None admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:29.562867 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924c9e4c-0f42-4000-81a5-62c7f6cde8b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:29.563298 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924c9e4c-0f42-4000-81a5-62c7f6cde8b0 None admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:29.564153 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924c9e4c-0f42-4000-81a5-62c7f6cde8b0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:29.565692 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924c9e4c-0f42-4000-81a5-62c7f6cde8b0 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:29.655996 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 366/719] 10.222.0.86 () {60 vars in 1132 bytes} [Tue Jun 7 14:21:29 2022] POST /identity/v3/users => generated 254 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 14:21:30.522319 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9740dc-1a20-4f97-813a-962465d2f710 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:30.522826 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9740dc-1a20-4f97-813a-962465d2f710 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:30.522904 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9740dc-1a20-4f97-813a-962465d2f710 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:30.524424 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 354/720] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:21:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:21:30.533376 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd38a7da-622f-4158-9cca-d2a9343e74cb None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:30.533831 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd38a7da-622f-4158-9cca-d2a9343e74cb None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:30.533919 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd38a7da-622f-4158-9cca-d2a9343e74cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:30.560763 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-fd38a7da-622f-4158-9cca-d2a9343e74cb None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:21:30.561954 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-fd38a7da-622f-4158-9cca-d2a9343e74cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:21:30.659037 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 367/721] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:21:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 14:21:30.690094 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9740dc-1a20-4f97-813a-962465d2f710 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:30.786425 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:30.816676 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9740dc-1a20-4f97-813a-962465d2f710 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:30.866767 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e53cab7-456c-47df-97da-4a719ad45476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:30.867909 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e53cab7-456c-47df-97da-4a719ad45476 None admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:30.868425 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e53cab7-456c-47df-97da-4a719ad45476 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:30.868901 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e53cab7-456c-47df-97da-4a719ad45476 None admin] PATH_INFO: `/v3/services` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:30.869834 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e53cab7-456c-47df-97da-4a719ad45476 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:30.871451 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e53cab7-456c-47df-97da-4a719ad45476 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:30.976684 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 355/722] 10.222.0.86 () {60 vars in 1141 bytes} [Tue Jun 7 14:21:30 2022] POST /identity/v3/services => generated 251 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:21:31.076014 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fbe9c7-ad6a-48c1-83fa-c908f0db55b0 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:31.076261 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fbe9c7-ad6a-48c1-83fa-c908f0db55b0 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:31.076492 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fbe9c7-ad6a-48c1-83fa-c908f0db55b0 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:31.078231 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 368/723] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:21:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:21:31.084031 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ad9500-1f42-485b-9413-8fd297a10470 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:31.084325 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ad9500-1f42-485b-9413-8fd297a10470 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:31.084612 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ad9500-1f42-485b-9413-8fd297a10470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:31.108700 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-32ad9500-1f42-485b-9413-8fd297a10470 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:21:31.109936 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-32ad9500-1f42-485b-9413-8fd297a10470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:21:31.210715 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 356/724] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:21:31 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 14:21:31.234849 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fbe9c7-ad6a-48c1-83fa-c908f0db55b0 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:31.335225 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:31.351353 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fbe9c7-ad6a-48c1-83fa-c908f0db55b0 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:31.357556 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae98ce1-b0fa-40f9-a363-86a6cd35d931 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:31.357840 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae98ce1-b0fa-40f9-a363-86a6cd35d931 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:31.358127 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae98ce1-b0fa-40f9-a363-86a6cd35d931 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:31.359504 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 357/725] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:21:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:21:31.364910 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701c5a71-6613-424a-b652-2bdc307c679d None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:31.365463 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701c5a71-6613-424a-b652-2bdc307c679d None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:31.365945 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701c5a71-6613-424a-b652-2bdc307c679d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:31.399851 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e9d8e8-bacf-4c50-8e58-cd31b998fa39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:31.401035 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e9d8e8-bacf-4c50-8e58-cd31b998fa39 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:31.401522 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e9d8e8-bacf-4c50-8e58-cd31b998fa39 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:31.402050 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e9d8e8-bacf-4c50-8e58-cd31b998fa39 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:31.403772 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-701c5a71-6613-424a-b652-2bdc307c679d None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:21:31.407072 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-701c5a71-6613-424a-b652-2bdc307c679d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:21:31.424896 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e9d8e8-bacf-4c50-8e58-cd31b998fa39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:21:31.433740 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-07e9d8e8-bacf-4c50-8e58-cd31b998fa39 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 14:21:31.433740 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:31.433740 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:31.433740 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:31.433740 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:31.433740 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:31.433740 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:31.433740 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:31.433740 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:31.433740 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:31.433740 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:31.433740 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:31.433740 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:21:31.433740 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:21:31.433740 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:21:31.433740 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:21:31.434696 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:21:31.434696 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:21:31.434696 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:21:31.434696 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:21:31.434696 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:31.434696 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:31.434696 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:31.434696 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:31.434696 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:31.434696 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:31.434696 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:31.434696 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:31.434696 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:31.434696 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:31.434696 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:31.434696 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:31.435582 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:31.435582 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:31.435582 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:31.435582 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:31.435582 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:21:31.435582 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:21:31.435582 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:21:31.435582 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:21:31.435582 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:21:31.435582 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:21:31.435582 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 14:21:31.435582 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:21:31.438453 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 369/726] 10.222.0.86 () {56 vars in 1096 bytes} [Tue Jun 7 14:21:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:21:31.443599 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e9d8e8-bacf-4c50-8e58-cd31b998fa39 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:31.537944 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:31.559601 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 358/727] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:21:31 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 14:21:31.580431 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e9d8e8-bacf-4c50-8e58-cd31b998fa39 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:31.604468 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701c5a71-6613-424a-b652-2bdc307c679d None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:31.641918 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6b7414-d3c2-464b-ae28-81a6f2816371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:31.642621 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6b7414-d3c2-464b-ae28-81a6f2816371 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:31.642907 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6b7414-d3c2-464b-ae28-81a6f2816371 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:31.643187 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6b7414-d3c2-464b-ae28-81a6f2816371 None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:31.644119 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6b7414-d3c2-464b-ae28-81a6f2816371 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:31.644432 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6b7414-d3c2-464b-ae28-81a6f2816371 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:31.645895 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6b7414-d3c2-464b-ae28-81a6f2816371 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:31.665530 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 370/728] 10.222.0.86 () {56 vars in 1099 bytes} [Tue Jun 7 14:21:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:31.668441 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6b7414-d3c2-464b-ae28-81a6f2816371 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:31.698468 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:31.734019 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701c5a71-6613-424a-b652-2bdc307c679d None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:31.772344 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e0a597-10b9-4e45-8ef7-a2493e122b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:31.774049 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e0a597-10b9-4e45-8ef7-a2493e122b04 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:31.774334 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e0a597-10b9-4e45-8ef7-a2493e122b04 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:31.774613 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e0a597-10b9-4e45-8ef7-a2493e122b04 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:31.804776 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e0a597-10b9-4e45-8ef7-a2493e122b04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:21:31.821318 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-33e0a597-10b9-4e45-8ef7-a2493e122b04 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 14:21:31.821318 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:31.821318 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:31.821318 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:31.821318 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:31.821318 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:31.821318 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:31.821318 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:31.821318 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:31.821318 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:31.821318 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:31.821318 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:31.821318 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:21:31.821318 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:21:31.821318 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:21:31.821318 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:21:31.822315 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:21:31.822315 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:21:31.822315 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:21:31.822315 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:21:31.822315 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:31.822315 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:31.822315 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:31.822315 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:31.822315 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:31.822315 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:31.822315 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:31.822315 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:31.822315 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:31.822315 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:31.822315 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:31.822315 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:31.823167 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:31.823167 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:31.823167 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:31.823167 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:31.823167 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:21:31.823167 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:21:31.823167 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:21:31.823167 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:21:31.823167 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:21:31.823167 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:21:31.823167 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 14:21:31.823167 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:21:31.823167 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 359/729] 10.222.0.86 () {56 vars in 1096 bytes} [Tue Jun 7 14:21:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 14:21:31.829082 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e0a597-10b9-4e45-8ef7-a2493e122b04 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:31.845246 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6b7414-d3c2-464b-ae28-81a6f2816371 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:31.899738 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7602e02-1797-4b22-aed0-82878e529b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:31.900482 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7602e02-1797-4b22-aed0-82878e529b71 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:31.900769 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7602e02-1797-4b22-aed0-82878e529b71 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:31.901042 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7602e02-1797-4b22-aed0-82878e529b71 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:31.912377 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7602e02-1797-4b22-aed0-82878e529b71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:31.913811 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7602e02-1797-4b22-aed0-82878e529b71 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:31.943204 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-b7602e02-1797-4b22-aed0-82878e529b71 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:21:31.943204 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:31.943204 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:31.943204 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:31.943204 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:31.943204 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:31.943204 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:31.943204 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:31.943204 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:31.943204 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:31.943204 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:31.943204 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:31.943204 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:21:31.943204 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:21:31.943204 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:21:31.944159 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:21:31.944159 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:31.944159 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:31.944159 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:31.944159 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:31.944159 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:31.944159 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:31.944159 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:31.944159 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:31.944159 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:31.944159 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:31.944159 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:31.944159 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:31.944159 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:31.944159 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:31.944159 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:31.944159 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:31.945039 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:21:31.945039 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:21:31.945039 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:21:31.945039 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:21:31.945039 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 371/730] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jun 7 14:21:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 14:21:31.953013 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7602e02-1797-4b22-aed0-82878e529b71 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:31.953149 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:32.028906 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e0a597-10b9-4e45-8ef7-a2493e122b04 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:32.045517 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:32.073139 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8de008-8e43-470f-bc2a-1fdedb3d55b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:32.074228 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8de008-8e43-470f-bc2a-1fdedb3d55b9 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:32.074539 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8de008-8e43-470f-bc2a-1fdedb3d55b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:32.074822 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8de008-8e43-470f-bc2a-1fdedb3d55b9 None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:32.075887 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8de008-8e43-470f-bc2a-1fdedb3d55b9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:32.076203 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8de008-8e43-470f-bc2a-1fdedb3d55b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:32.078367 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8de008-8e43-470f-bc2a-1fdedb3d55b9 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:32.086185 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7602e02-1797-4b22-aed0-82878e529b71 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:32.089827 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 360/731] 10.222.0.86 () {56 vars in 1099 bytes} [Tue Jun 7 14:21:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:21:32.091261 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe20379-34b7-4fb3-860e-58e083909208 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:32.091622 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe20379-34b7-4fb3-860e-58e083909208 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:32.091999 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe20379-34b7-4fb3-860e-58e083909208 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:32.093866 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 361/732] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:21:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:21:32.094710 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe20379-34b7-4fb3-860e-58e083909208 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:32.133796 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2650e0de-28f5-4951-b9fa-f1a3abc8b47d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:32.134464 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2650e0de-28f5-4951-b9fa-f1a3abc8b47d None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:32.134754 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2650e0de-28f5-4951-b9fa-f1a3abc8b47d None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:32.135083 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2650e0de-28f5-4951-b9fa-f1a3abc8b47d None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:32.135855 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2650e0de-28f5-4951-b9fa-f1a3abc8b47d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:32.136197 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2650e0de-28f5-4951-b9fa-f1a3abc8b47d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:32.137599 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2650e0de-28f5-4951-b9fa-f1a3abc8b47d None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:32.154470 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 372/733] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jun 7 14:21:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:32.155739 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c2ea7d-f8e2-42ad-8d5c-db4fa69f9b97 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:32.156075 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c2ea7d-f8e2-42ad-8d5c-db4fa69f9b97 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:32.156359 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c2ea7d-f8e2-42ad-8d5c-db4fa69f9b97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:32.173539 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-20c2ea7d-f8e2-42ad-8d5c-db4fa69f9b97 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:21:32.174781 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-20c2ea7d-f8e2-42ad-8d5c-db4fa69f9b97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:21:32.229319 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe20379-34b7-4fb3-860e-58e083909208 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:32.245757 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:32.255886 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 373/734] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:21:32 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 14:21:32.257048 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c2ea7d-f8e2-42ad-8d5c-db4fa69f9b97 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:32.268954 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a6be60-34df-46f9-a5c8-ada3dab4cbb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:32.269751 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a6be60-34df-46f9-a5c8-ada3dab4cbb4 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:32.270035 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a6be60-34df-46f9-a5c8-ada3dab4cbb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:32.270313 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a6be60-34df-46f9-a5c8-ada3dab4cbb4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:32.284015 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a6be60-34df-46f9-a5c8-ada3dab4cbb4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:32.285826 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a6be60-34df-46f9-a5c8-ada3dab4cbb4 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:32.310623 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-f8a6be60-34df-46f9-a5c8-ada3dab4cbb4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:21:32.310623 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:32.310623 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:32.310623 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:32.310623 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:32.310623 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:32.310623 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:32.310623 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:32.310623 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:32.310623 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:32.310623 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:32.310623 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:32.310623 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:21:32.310623 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:21:32.310623 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:21:32.311555 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:21:32.311555 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:32.311555 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:32.311555 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:32.311555 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:32.311555 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:32.311555 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:32.311555 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:32.311555 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:32.311555 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:32.311555 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:32.311555 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:32.311555 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:32.311555 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:32.311555 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:32.311555 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:32.311555 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:32.312810 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:21:32.312810 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:21:32.312810 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:21:32.312810 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:21:32.312810 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 362/735] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jun 7 14:21:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 14:21:32.313159 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a6be60-34df-46f9-a5c8-ada3dab4cbb4 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:32.334738 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:32.392838 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c2ea7d-f8e2-42ad-8d5c-db4fa69f9b97 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:32.435361 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a6be60-34df-46f9-a5c8-ada3dab4cbb4 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:32.437423 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f97a78-7c6a-4ae7-a974-75fc8674efd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:32.439185 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f97a78-7c6a-4ae7-a974-75fc8674efd0 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:32.439463 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f97a78-7c6a-4ae7-a974-75fc8674efd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:32.439795 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f97a78-7c6a-4ae7-a974-75fc8674efd0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:32.449404 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f97a78-7c6a-4ae7-a974-75fc8674efd0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:32.451656 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f97a78-7c6a-4ae7-a974-75fc8674efd0 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:32.472417 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-65f97a78-7c6a-4ae7-a974-75fc8674efd0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 07 14:21:32.472417 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:32.472417 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:32.472417 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:32.472417 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:32.472417 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:32.472417 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:32.472417 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:32.472417 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:32.472417 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:32.472417 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:32.472417 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:32.472417 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 14:21:32.472417 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 14:21:32.472417 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 14:21:32.472417 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 14:21:32.473426 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:32.473426 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:32.473426 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 14:21:32.473426 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:21:32.473426 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 14:21:32.473426 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:21:32.473426 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:32.473426 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:32.473426 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:32.473426 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:32.473426 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:32.473426 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:32.473426 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:32.473426 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:32.473426 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:32.473426 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:32.473426 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:32.473426 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:32.474350 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:32.474350 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:32.474350 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 14:21:32.474350 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 14:21:32.474350 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 14:21:32.474350 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 14:21:32.474350 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 14:21:32.474350 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 14:21:32.474350 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 07 14:21:32.474350 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:21:32.474873 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b9db05-abf2-478b-9e7d-3b07d8e7467b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:32.474873 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b9db05-abf2-478b-9e7d-3b07d8e7467b None admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:32.474873 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b9db05-abf2-478b-9e7d-3b07d8e7467b None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:32.475071 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 374/736] 10.222.0.86 () {56 vars in 1093 bytes} [Tue Jun 7 14:21:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:21:32.475138 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b9db05-abf2-478b-9e7d-3b07d8e7467b None admin] PATH_INFO: `/v3/services` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:32.475291 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f97a78-7c6a-4ae7-a974-75fc8674efd0 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:32.475364 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b9db05-abf2-478b-9e7d-3b07d8e7467b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:32.476421 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b9db05-abf2-478b-9e7d-3b07d8e7467b None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:32.560631 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 363/737] 10.222.0.86 () {60 vars in 1141 bytes} [Tue Jun 7 14:21:32 2022] POST /identity/v3/services => generated 240 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:21:32.561889 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b9db05-abf2-478b-9e7d-3b07d8e7467b None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:32.586469 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f97a78-7c6a-4ae7-a974-75fc8674efd0 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:32.604668 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:32.607274 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:32.643014 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d024cac8-2e1b-406d-9571-16cbf97eac32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:32.643850 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d024cac8-2e1b-406d-9571-16cbf97eac32 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:32.644210 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d024cac8-2e1b-406d-9571-16cbf97eac32 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:32.644558 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d024cac8-2e1b-406d-9571-16cbf97eac32 None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:32.645357 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d024cac8-2e1b-406d-9571-16cbf97eac32 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:32.645782 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d024cac8-2e1b-406d-9571-16cbf97eac32 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:32.647259 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d024cac8-2e1b-406d-9571-16cbf97eac32 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:32.663005 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 375/738] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jun 7 14:21:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:32.677711 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d024cac8-2e1b-406d-9571-16cbf97eac32 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:32.703445 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b9db05-abf2-478b-9e7d-3b07d8e7467b None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:32.747422 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5562d8-235b-4774-861e-a514fb696c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:32.748141 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5562d8-235b-4774-861e-a514fb696c9f None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:32.748425 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5562d8-235b-4774-861e-a514fb696c9f None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:32.748705 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5562d8-235b-4774-861e-a514fb696c9f None admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:32.749574 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5562d8-235b-4774-861e-a514fb696c9f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:32.749889 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5562d8-235b-4774-861e-a514fb696c9f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:32.751959 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5562d8-235b-4774-861e-a514fb696c9f None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:32.776112 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 364/739] 10.222.0.86 () {56 vars in 1133 bytes} [Tue Jun 7 14:21:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:32.782070 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5562d8-235b-4774-861e-a514fb696c9f None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:32.866851 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d024cac8-2e1b-406d-9571-16cbf97eac32 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:32.900683 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:32.913026 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca766e64-253c-4fe3-9dd0-68bb30a419ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:32.914418 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca766e64-253c-4fe3-9dd0-68bb30a419ac None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:32.914875 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca766e64-253c-4fe3-9dd0-68bb30a419ac None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:32.915317 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca766e64-253c-4fe3-9dd0-68bb30a419ac None admin] PATH_INFO: `/v3/users/swift` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:32.921541 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5562d8-235b-4774-861e-a514fb696c9f None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:32.924057 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca766e64-253c-4fe3-9dd0-68bb30a419ac None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:32.925755 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca766e64-253c-4fe3-9dd0-68bb30a419ac None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:32.941490 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-ca766e64-253c-4fe3-9dd0-68bb30a419ac None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 07 14:21:32.941490 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:32.941490 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:32.941490 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:32.941490 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:32.941490 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:32.941490 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:32.941490 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:32.941490 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:32.941490 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:32.941490 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:32.941490 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:32.941490 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 14:21:32.941490 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 14:21:32.941490 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 14:21:32.941490 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 14:21:32.942546 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:32.942546 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:32.942546 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 14:21:32.942546 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:21:32.942546 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 14:21:32.942546 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:21:32.942546 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:32.942546 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:32.942546 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:32.942546 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:32.942546 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:32.942546 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:32.942546 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:32.942546 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:32.942546 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:32.942546 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:32.942546 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:32.942546 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:32.943477 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:32.943477 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:32.943477 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 14:21:32.943477 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 14:21:32.943477 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 14:21:32.943477 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 14:21:32.943477 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 14:21:32.943477 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 14:21:32.943477 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 07 14:21:32.943477 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:21:32.945129 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 376/740] 10.222.0.86 () {56 vars in 1096 bytes} [Tue Jun 7 14:21:32 2022] GET /identity/v3/users/swift => generated 83 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 14:21:32.946368 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3916ba77-836f-4052-a580-1a5534a1daba None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:32.946659 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3916ba77-836f-4052-a580-1a5534a1daba None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:32.946933 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3916ba77-836f-4052-a580-1a5534a1daba None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:32.953030 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 377/741] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:21:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:21:32.954099 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3916ba77-836f-4052-a580-1a5534a1daba None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:32.962738 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31981b47-c4a7-4308-9304-7a78adeb7a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:32.963537 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31981b47-c4a7-4308-9304-7a78adeb7a99 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:32.965815 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31981b47-c4a7-4308-9304-7a78adeb7a99 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:32.965815 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31981b47-c4a7-4308-9304-7a78adeb7a99 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:32.977664 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31981b47-c4a7-4308-9304-7a78adeb7a99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:32.979126 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31981b47-c4a7-4308-9304-7a78adeb7a99 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:32.993140 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:33.000909 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-31981b47-c4a7-4308-9304-7a78adeb7a99 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:21:33.000909 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:33.000909 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:33.000909 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:33.000909 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:33.000909 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:33.000909 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:33.000909 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:33.000909 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:33.000909 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:33.000909 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:33.000909 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:33.000909 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:21:33.000909 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:21:33.000909 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:21:33.004736 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:21:33.004736 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:33.004736 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:33.004736 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:33.004736 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:33.004736 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:33.004736 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:33.004736 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:33.004736 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:33.004736 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:33.004736 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:33.004736 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:33.004736 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:33.004736 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:33.004736 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:33.004736 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:33.004736 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:33.005634 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:21:33.005634 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:21:33.005634 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:21:33.005634 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:21:33.005634 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 365/742] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jun 7 14:21:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 14:21:33.005634 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcbd857-fe13-445e-8ab8-006b8dd520ea None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:33.005634 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcbd857-fe13-445e-8ab8-006b8dd520ea None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:33.008492 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcbd857-fe13-445e-8ab8-006b8dd520ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:33.025802 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-9fcbd857-fe13-445e-8ab8-006b8dd520ea None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:21:33.027013 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-9fcbd857-fe13-445e-8ab8-006b8dd520ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:21:33.078373 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3916ba77-836f-4052-a580-1a5534a1daba None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:33.097821 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 366/743] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:21:33 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 14:21:33.098740 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcbd857-fe13-445e-8ab8-006b8dd520ea None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:33.118020 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4440ece5-46f1-40b0-8188-447538ceb453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:33.119127 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4440ece5-46f1-40b0-8188-447538ceb453 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:33.119732 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4440ece5-46f1-40b0-8188-447538ceb453 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:33.120307 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4440ece5-46f1-40b0-8188-447538ceb453 None admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:33.121987 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4440ece5-46f1-40b0-8188-447538ceb453 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:33.122510 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4440ece5-46f1-40b0-8188-447538ceb453 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:33.124527 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4440ece5-46f1-40b0-8188-447538ceb453 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:33.146596 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 378/744] 10.222.0.86 () {56 vars in 1135 bytes} [Tue Jun 7 14:21:32 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:33.147856 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4440ece5-46f1-40b0-8188-447538ceb453 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:33.171226 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:33.209774 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcbd857-fe13-445e-8ab8-006b8dd520ea None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:33.245719 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:33.248484 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52b87e9-19bc-4451-b395-5eeb942f5b0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:33.249157 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52b87e9-19bc-4451-b395-5eeb942f5b0d None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:33.249452 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52b87e9-19bc-4451-b395-5eeb942f5b0d None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:33.249723 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52b87e9-19bc-4451-b395-5eeb942f5b0d None admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:33.250457 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52b87e9-19bc-4451-b395-5eeb942f5b0d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:33.250770 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52b87e9-19bc-4451-b395-5eeb942f5b0d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:33.252434 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52b87e9-19bc-4451-b395-5eeb942f5b0d None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:33.261593 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4440ece5-46f1-40b0-8188-447538ceb453 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:33.269137 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 367/745] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jun 7 14:21:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:33.269965 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52b87e9-19bc-4451-b395-5eeb942f5b0d None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:33.302421 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00457846-de71-4681-a061-13cb43fece3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:33.303795 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00457846-de71-4681-a061-13cb43fece3e None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:33.304299 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00457846-de71-4681-a061-13cb43fece3e None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:33.304777 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00457846-de71-4681-a061-13cb43fece3e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:33.318481 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00457846-de71-4681-a061-13cb43fece3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:21:33.327957 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-00457846-de71-4681-a061-13cb43fece3e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 07 14:21:33.327957 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:33.327957 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:33.327957 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:33.327957 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:33.327957 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:33.327957 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:33.327957 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:33.327957 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:33.327957 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:33.327957 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:33.327957 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:33.327957 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:21:33.327957 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:21:33.327957 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:21:33.327957 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:21:33.328950 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:21:33.328950 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:21:33.328950 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:21:33.328950 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:21:33.328950 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:33.328950 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:33.328950 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:33.328950 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:33.328950 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:33.328950 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:33.328950 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:33.328950 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:33.328950 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:33.328950 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:33.328950 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:33.328950 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:33.329771 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:33.329771 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:33.329771 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:33.329771 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:33.329771 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:21:33.329771 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:21:33.329771 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:21:33.329771 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:21:33.329771 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:21:33.329771 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:21:33.329771 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 07 14:21:33.329771 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:21:33.332831 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 379/746] 10.222.0.86 () {56 vars in 1102 bytes} [Tue Jun 7 14:21:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:21:33.333925 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00457846-de71-4681-a061-13cb43fece3e None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:33.379338 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52b87e9-19bc-4451-b395-5eeb942f5b0d None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:33.405253 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:33.414269 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fb7a07-b6e1-473f-92a2-f2413a9857fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:33.414931 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fb7a07-b6e1-473f-92a2-f2413a9857fe None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:33.415219 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fb7a07-b6e1-473f-92a2-f2413a9857fe None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:33.415495 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fb7a07-b6e1-473f-92a2-f2413a9857fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:33.445687 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00457846-de71-4681-a061-13cb43fece3e None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:33.482422 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f655702-855f-4742-a82b-b89825a139b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:33.483685 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f655702-855f-4742-a82b-b89825a139b2 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:33.484214 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f655702-855f-4742-a82b-b89825a139b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:33.484786 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f655702-855f-4742-a82b-b89825a139b2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:33.491239 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fb7a07-b6e1-473f-92a2-f2413a9857fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:33.492420 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f655702-855f-4742-a82b-b89825a139b2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:33.492723 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fb7a07-b6e1-473f-92a2-f2413a9857fe None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:33.494433 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f655702-855f-4742-a82b-b89825a139b2 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:33.510760 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-4f655702-855f-4742-a82b-b89825a139b2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:21:33.510760 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:33.510760 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:33.510760 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:33.510760 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:33.510760 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:33.510760 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:33.510760 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:33.510760 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:33.510760 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:33.510760 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:33.510760 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:33.510760 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 14:21:33.510760 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 14:21:33.510760 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 14:21:33.511697 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 14:21:33.511697 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:33.511697 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:33.511697 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:33.511697 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:33.511697 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:33.511697 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:33.511697 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:33.511697 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:33.511697 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:33.511697 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:33.511697 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:33.511697 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:33.511697 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:33.511697 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:33.511697 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:33.511697 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:33.513249 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 14:21:33.513249 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 14:21:33.513249 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 14:21:33.513249 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 14:21:33.513249 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 14:21:33.513249 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 14:21:33.513249 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:21:33.513249 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:21:33.515928 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 380/747] 10.222.0.86 () {56 vars in 1111 bytes} [Tue Jun 7 14:21:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:21:33.517147 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f655702-855f-4742-a82b-b89825a139b2 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:33.530555 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:33.598995 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 368/748] 10.222.0.86 () {58 vars in 1282 bytes} [Tue Jun 7 14:21:33 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 07 14:21:33.599996 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fb7a07-b6e1-473f-92a2-f2413a9857fe None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:33.633359 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:33.634486 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f655702-855f-4742-a82b-b89825a139b2 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:33.671441 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfd4f16-8bc4-4f93-9157-7e59a1eb919e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:33.672141 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfd4f16-8bc4-4f93-9157-7e59a1eb919e None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:33.672427 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfd4f16-8bc4-4f93-9157-7e59a1eb919e None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:33.672704 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfd4f16-8bc4-4f93-9157-7e59a1eb919e None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:33.673460 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfd4f16-8bc4-4f93-9157-7e59a1eb919e None admin] RBAC: Adding query filter params (name=service) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:33.673766 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfd4f16-8bc4-4f93-9157-7e59a1eb919e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:33.675125 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfd4f16-8bc4-4f93-9157-7e59a1eb919e None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:33.687266 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 381/749] 10.222.0.86 () {56 vars in 1103 bytes} [Tue Jun 7 14:21:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:33.687266 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfd4f16-8bc4-4f93-9157-7e59a1eb919e None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:33.716030 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fb7a07-b6e1-473f-92a2-f2413a9857fe None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:33.752860 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ffac06-585f-4962-86ea-000c70d9beb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:33.754020 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ffac06-585f-4962-86ea-000c70d9beb3 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:33.754312 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ffac06-585f-4962-86ea-000c70d9beb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:33.754604 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ffac06-585f-4962-86ea-000c70d9beb3 None admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:33.755404 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ffac06-585f-4962-86ea-000c70d9beb3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:33.755721 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ffac06-585f-4962-86ea-000c70d9beb3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:33.756892 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:33.757229 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ffac06-585f-4962-86ea-000c70d9beb3 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:33.770115 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 369/750] 10.222.0.86 () {56 vars in 1148 bytes} [Tue Jun 7 14:21:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:33.771348 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed81034-95e3-4e34-88a1-34e038983ace None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:33.771637 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed81034-95e3-4e34-88a1-34e038983ace None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:33.771945 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed81034-95e3-4e34-88a1-34e038983ace None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:33.773308 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 370/751] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:21:33 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:21:33.773844 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed81034-95e3-4e34-88a1-34e038983ace None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:33.795582 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfd4f16-8bc4-4f93-9157-7e59a1eb919e None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:33.833730 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b04a1e-a8d2-40a6-87ff-bb87ce0d8c49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:33.834909 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b04a1e-a8d2-40a6-87ff-bb87ce0d8c49 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:33.835531 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b04a1e-a8d2-40a6-87ff-bb87ce0d8c49 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:33.835843 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b04a1e-a8d2-40a6-87ff-bb87ce0d8c49 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:33.847799 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b04a1e-a8d2-40a6-87ff-bb87ce0d8c49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:33.849264 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b04a1e-a8d2-40a6-87ff-bb87ce0d8c49 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:33.860892 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:33.868004 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-68b04a1e-a8d2-40a6-87ff-bb87ce0d8c49 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:21:33.868004 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:33.868004 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:33.868004 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:33.868004 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:33.868004 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:33.868004 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:33.868004 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:33.868004 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:33.868004 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:33.868004 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:33.868004 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:33.868004 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:21:33.868004 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:21:33.868004 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:21:33.868881 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:21:33.868881 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:33.868881 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:33.868881 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:33.868881 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:33.868881 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:33.868881 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:33.868881 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:33.868881 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:33.868881 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:33.868881 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:33.868881 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:33.868881 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:33.868881 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:33.868881 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:33.868881 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:33.868881 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:33.869763 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:21:33.869763 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:21:33.869763 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:21:33.869763 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:21:33.869763 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 382/752] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jun 7 14:21:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:21:33.870051 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b04a1e-a8d2-40a6-87ff-bb87ce0d8c49 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:33.881555 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed81034-95e3-4e34-88a1-34e038983ace None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:33.917390 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dddbf2a-02ad-4293-a497-d76859944fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:33.918224 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dddbf2a-02ad-4293-a497-d76859944fb1 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:33.918510 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dddbf2a-02ad-4293-a497-d76859944fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:33.918789 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dddbf2a-02ad-4293-a497-d76859944fb1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:33.930411 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dddbf2a-02ad-4293-a497-d76859944fb1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:33.931951 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dddbf2a-02ad-4293-a497-d76859944fb1 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:33.951540 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-9dddbf2a-02ad-4293-a497-d76859944fb1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:21:33.951540 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:33.951540 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:33.951540 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:33.951540 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:33.951540 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:33.951540 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:33.951540 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:33.951540 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:33.951540 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:33.951540 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:33.951540 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:33.951540 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:21:33.951540 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:21:33.951540 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:21:33.952529 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:21:33.952529 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:33.952529 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:33.952529 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:33.952529 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:33.952529 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:33.952529 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:33.952529 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:33.952529 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:33.952529 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:33.952529 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:33.952529 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:33.952529 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:33.952529 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:33.952529 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:33.952529 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:33.952529 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:33.953435 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:21:33.953435 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:21:33.953435 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:21:33.953435 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:21:33.953435 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 371/753] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jun 7 14:21:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:21:33.954280 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cdb1cb-bcc7-4989-a42f-670b7a4f2737 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:33.954563 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cdb1cb-bcc7-4989-a42f-670b7a4f2737 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:33.954838 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cdb1cb-bcc7-4989-a42f-670b7a4f2737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:33.974143 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-c3cdb1cb-bcc7-4989-a42f-670b7a4f2737 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:21:33.975635 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-c3cdb1cb-bcc7-4989-a42f-670b7a4f2737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:21:33.983871 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b04a1e-a8d2-40a6-87ff-bb87ce0d8c49 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:34.009137 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:34.020105 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19395675-2e14-46ed-9031-7b7f7986d1f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:34.021001 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19395675-2e14-46ed-9031-7b7f7986d1f8 None admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:34.021286 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19395675-2e14-46ed-9031-7b7f7986d1f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:34.026450 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19395675-2e14-46ed-9031-7b7f7986d1f8 None admin] PATH_INFO: `/v3/projects/e429537b190c4c5ea7e1332ab044ca7a/users/b99cfb70f54c45c8870369359da20378/roles/e3bf6239f5bf477b965704b086786f11` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:34.026450 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19395675-2e14-46ed-9031-7b7f7986d1f8 None admin] RBAC: Authorizing `identity:create_grant(project_id=e429537b190c4c5ea7e1332ab044ca7a, user_id=b99cfb70f54c45c8870369359da20378, role_id=e3bf6239f5bf477b965704b086786f11)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:34.026450 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19395675-2e14-46ed-9031-7b7f7986d1f8 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:34.047457 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 372/754] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:21:33 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 14:21:34.048330 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cdb1cb-bcc7-4989-a42f-670b7a4f2737 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:34.097939 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 383/755] 10.222.0.86 () {58 vars in 1439 bytes} [Tue Jun 7 14:21:33 2022] PUT /identity/v3/projects/e429537b190c4c5ea7e1332ab044ca7a/users/b99cfb70f54c45c8870369359da20378/roles/e3bf6239f5bf477b965704b086786f11 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:21:34.098840 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19395675-2e14-46ed-9031-7b7f7986d1f8 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:34.126031 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:34.166077 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cdb1cb-bcc7-4989-a42f-670b7a4f2737 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:34.213553 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233d1f21-7346-4f97-addf-1942fb8026f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:34.214336 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233d1f21-7346-4f97-addf-1942fb8026f0 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:34.214695 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233d1f21-7346-4f97-addf-1942fb8026f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:34.215623 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233d1f21-7346-4f97-addf-1942fb8026f0 None admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:34.216503 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233d1f21-7346-4f97-addf-1942fb8026f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:34.216874 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233d1f21-7346-4f97-addf-1942fb8026f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:34.219166 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233d1f21-7346-4f97-addf-1942fb8026f0 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:34.237157 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19395675-2e14-46ed-9031-7b7f7986d1f8 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:34.239924 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 373/756] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jun 7 14:21:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:34.241106 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233d1f21-7346-4f97-addf-1942fb8026f0 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:34.286251 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bd4a1d-4a82-4865-b9d9-6b51e0a7eac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:34.287496 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bd4a1d-4a82-4865-b9d9-6b51e0a7eac5 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:34.287835 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bd4a1d-4a82-4865-b9d9-6b51e0a7eac5 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:34.288122 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bd4a1d-4a82-4865-b9d9-6b51e0a7eac5 None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:34.288884 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bd4a1d-4a82-4865-b9d9-6b51e0a7eac5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:34.289454 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bd4a1d-4a82-4865-b9d9-6b51e0a7eac5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:34.291274 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bd4a1d-4a82-4865-b9d9-6b51e0a7eac5 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:34.308004 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 384/757] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jun 7 14:21:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:34.309901 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bd4a1d-4a82-4865-b9d9-6b51e0a7eac5 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:34.362225 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:34.366228 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233d1f21-7346-4f97-addf-1942fb8026f0 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:34.400579 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:34.410901 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24379ef0-b279-43ad-bbd7-9d12303828c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:34.412034 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24379ef0-b279-43ad-bbd7-9d12303828c3 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:34.412531 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24379ef0-b279-43ad-bbd7-9d12303828c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:34.413032 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24379ef0-b279-43ad-bbd7-9d12303828c3 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:34.414588 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24379ef0-b279-43ad-bbd7-9d12303828c3 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:34.416603 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24379ef0-b279-43ad-bbd7-9d12303828c3 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:34.427461 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bd4a1d-4a82-4865-b9d9-6b51e0a7eac5 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:34.433468 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-24379ef0-b279-43ad-bbd7-9d12303828c3 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 07 14:21:34.433468 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:34.433468 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 07 14:21:34.433468 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 07 14:21:34.433468 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 07 14:21:34.433468 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 07 14:21:34.433468 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 07 14:21:34.433468 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 14:21:34.433468 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 07 14:21:34.433468 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:21:34.433468 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 07 14:21:34.433468 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:21:34.433468 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:34.433468 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:34.433468 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:34.433468 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:34.435260 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:34.435260 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:34.435260 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:34.435260 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:34.435260 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:34.435260 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:34.435260 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:34.435260 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 07 14:21:34.435260 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 07 14:21:34.435260 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 07 14:21:34.435260 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 07 14:21:34.435260 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:34.435260 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:34.435260 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:34.435260 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:34.435260 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:34.436135 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:34.436135 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:34.436135 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:34.436135 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:34.436135 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:34.436135 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:34.436135 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:34.436135 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:34.436135 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:34.436135 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:34.436135 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:34.436135 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 07 14:21:34.436135 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 14:21:34.436135 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 07 14:21:34.436135 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:21:34.438972 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 374/758] 10.222.0.86 () {56 vars in 1129 bytes} [Tue Jun 7 14:21:34 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:21:34.439958 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24379ef0-b279-43ad-bbd7-9d12303828c3 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:34.473523 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03b3309-3070-47cc-ac25-92575d5d728b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:34.475119 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03b3309-3070-47cc-ac25-92575d5d728b None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:34.475527 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03b3309-3070-47cc-ac25-92575d5d728b None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:34.475943 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03b3309-3070-47cc-ac25-92575d5d728b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:34.488928 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03b3309-3070-47cc-ac25-92575d5d728b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:34.491016 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03b3309-3070-47cc-ac25-92575d5d728b None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:34.511448 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-d03b3309-3070-47cc-ac25-92575d5d728b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:21:34.511448 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:34.511448 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:34.511448 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:34.511448 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:34.511448 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:34.511448 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:34.511448 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:34.511448 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:34.511448 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:34.511448 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:34.511448 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:34.511448 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 14:21:34.511448 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 14:21:34.511448 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 14:21:34.512623 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 14:21:34.512623 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:34.512623 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:34.512623 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:34.512623 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:34.512623 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:34.512623 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:34.512623 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:34.512623 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:34.512623 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:34.512623 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:34.512623 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:34.512623 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:34.512623 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:34.512623 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:34.512623 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:34.512623 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:34.513506 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 14:21:34.513506 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 14:21:34.513506 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 14:21:34.513506 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 14:21:34.513506 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 14:21:34.513506 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 14:21:34.513506 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:21:34.513506 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:21:34.513917 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 385/759] 10.222.0.86 () {56 vars in 1111 bytes} [Tue Jun 7 14:21:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:21:34.515144 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03b3309-3070-47cc-ac25-92575d5d728b None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:34.560112 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24379ef0-b279-43ad-bbd7-9d12303828c3 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:34.596555 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e98bda-cce9-4a8a-9f6d-862ce50da65f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:34.597701 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e98bda-cce9-4a8a-9f6d-862ce50da65f None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:34.598209 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e98bda-cce9-4a8a-9f6d-862ce50da65f None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:34.598696 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e98bda-cce9-4a8a-9f6d-862ce50da65f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:34.607420 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e98bda-cce9-4a8a-9f6d-862ce50da65f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:34.609649 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e98bda-cce9-4a8a-9f6d-862ce50da65f None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:34.626067 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-c9e98bda-cce9-4a8a-9f6d-862ce50da65f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 07 14:21:34.626067 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:34.626067 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:34.626067 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:34.626067 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:34.626067 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:34.626067 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:34.626067 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:34.626067 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:34.626067 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:34.626067 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:34.626067 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:34.626067 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 14:21:34.626067 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 14:21:34.626067 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 14:21:34.626067 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 14:21:34.627055 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:34.627055 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:34.627055 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 14:21:34.627055 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:21:34.627055 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 14:21:34.627055 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:21:34.627055 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:34.627055 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:34.627055 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:34.627055 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:34.627055 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:34.627055 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:34.627055 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:34.627055 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:34.627055 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:34.627055 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:34.627055 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:34.627055 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:34.628029 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:34.628029 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:34.628029 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 14:21:34.628029 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 14:21:34.628029 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 14:21:34.628029 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 14:21:34.628029 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 14:21:34.628029 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 14:21:34.628029 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 07 14:21:34.628029 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:21:34.630753 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 375/760] 10.222.0.86 () {56 vars in 1117 bytes} [Tue Jun 7 14:21:34 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:21:34.631800 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e98bda-cce9-4a8a-9f6d-862ce50da65f None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:34.645359 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03b3309-3070-47cc-ac25-92575d5d728b None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:34.647186 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:34.692295 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:34.697295 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b227fa-43bf-47b1-a7a4-73ff3745d039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:34.698383 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b227fa-43bf-47b1-a7a4-73ff3745d039 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:34.698668 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b227fa-43bf-47b1-a7a4-73ff3745d039 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:34.698945 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b227fa-43bf-47b1-a7a4-73ff3745d039 None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:34.699927 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b227fa-43bf-47b1-a7a4-73ff3745d039 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:34.700239 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b227fa-43bf-47b1-a7a4-73ff3745d039 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:34.702190 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b227fa-43bf-47b1-a7a4-73ff3745d039 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:34.711829 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 386/761] 10.222.0.86 () {56 vars in 1124 bytes} [Tue Jun 7 14:21:34 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:34.713131 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b227fa-43bf-47b1-a7a4-73ff3745d039 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:34.750566 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e98bda-cce9-4a8a-9f6d-862ce50da65f None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:34.789979 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f56d3b8-b7a7-4994-9dc6-40b79be60bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:34.791038 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f56d3b8-b7a7-4994-9dc6-40b79be60bf9 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:34.791530 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f56d3b8-b7a7-4994-9dc6-40b79be60bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:34.792042 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f56d3b8-b7a7-4994-9dc6-40b79be60bf9 None admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:34.793748 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f56d3b8-b7a7-4994-9dc6-40b79be60bf9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:34.794292 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f56d3b8-b7a7-4994-9dc6-40b79be60bf9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:34.795972 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f56d3b8-b7a7-4994-9dc6-40b79be60bf9 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:34.809179 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 376/762] 10.222.0.86 () {56 vars in 1148 bytes} [Tue Jun 7 14:21:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:34.810303 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f56d3b8-b7a7-4994-9dc6-40b79be60bf9 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:34.852287 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b227fa-43bf-47b1-a7a4-73ff3745d039 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:34.890485 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c6b8a9-9fda-4590-ba71-cb9ab201e6b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:34.891533 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c6b8a9-9fda-4590-ba71-cb9ab201e6b6 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:34.892058 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c6b8a9-9fda-4590-ba71-cb9ab201e6b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:34.892713 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c6b8a9-9fda-4590-ba71-cb9ab201e6b6 None admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:34.893764 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c6b8a9-9fda-4590-ba71-cb9ab201e6b6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:34.894339 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c6b8a9-9fda-4590-ba71-cb9ab201e6b6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:34.896050 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c6b8a9-9fda-4590-ba71-cb9ab201e6b6 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:34.917873 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 387/763] 10.222.0.86 () {56 vars in 1149 bytes} [Tue Jun 7 14:21:34 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:34.919405 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c6b8a9-9fda-4590-ba71-cb9ab201e6b6 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:34.944381 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f56d3b8-b7a7-4994-9dc6-40b79be60bf9 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:34.952273 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:34.963491 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:34.985256 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48ccd3c-7cc6-403a-b14e-f349f7ad9dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:34.986072 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48ccd3c-7cc6-403a-b14e-f349f7ad9dcd None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:34.986474 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48ccd3c-7cc6-403a-b14e-f349f7ad9dcd None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:34.986841 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48ccd3c-7cc6-403a-b14e-f349f7ad9dcd None admin] PATH_INFO: `/v3/services` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:34.987785 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48ccd3c-7cc6-403a-b14e-f349f7ad9dcd None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:34.988117 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48ccd3c-7cc6-403a-b14e-f349f7ad9dcd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:34.989592 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48ccd3c-7cc6-403a-b14e-f349f7ad9dcd None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:34.996323 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 377/764] 10.222.0.86 () {56 vars in 1124 bytes} [Tue Jun 7 14:21:34 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:34.997507 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48ccd3c-7cc6-403a-b14e-f349f7ad9dcd None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:35.042440 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c6b8a9-9fda-4590-ba71-cb9ab201e6b6 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:35.079021 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb48bad-2272-43e0-94d8-61ab1c0e2ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:35.079917 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb48bad-2272-43e0-94d8-61ab1c0e2ab6 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:35.080341 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb48bad-2272-43e0-94d8-61ab1c0e2ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:35.080782 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb48bad-2272-43e0-94d8-61ab1c0e2ab6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:35.081812 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb48bad-2272-43e0-94d8-61ab1c0e2ab6 None admin] RBAC: Adding query filter params (role.id=e3bf6239f5bf477b965704b086786f11, scope.project.id=e429537b190c4c5ea7e1332ab044ca7a, user.id=c9774349dd2b4ec092ef04c3df050a7e) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:35.082324 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb48bad-2272-43e0-94d8-61ab1c0e2ab6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:35.084085 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb48bad-2272-43e0-94d8-61ab1c0e2ab6 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:35.091475 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 388/765] 10.222.0.86 () {56 vars in 1374 bytes} [Tue Jun 7 14:21:34 2022] GET /identity/v3/role_assignments?user.id=c9774349dd2b4ec092ef04c3df050a7e&scope.project.id=e429537b190c4c5ea7e1332ab044ca7a&role.id=e3bf6239f5bf477b965704b086786f11 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:35.092576 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb48bad-2272-43e0-94d8-61ab1c0e2ab6 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:35.108739 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48ccd3c-7cc6-403a-b14e-f349f7ad9dcd None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:35.152741 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e38238-a7fb-4d4a-9620-5618b069eac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:35.153685 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e38238-a7fb-4d4a-9620-5618b069eac7 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:35.154016 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e38238-a7fb-4d4a-9620-5618b069eac7 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:35.154450 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e38238-a7fb-4d4a-9620-5618b069eac7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:35.209969 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:35.218552 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:35.232509 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb48bad-2272-43e0-94d8-61ab1c0e2ab6 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:35.240299 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e38238-a7fb-4d4a-9620-5618b069eac7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:35.241975 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e38238-a7fb-4d4a-9620-5618b069eac7 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:35.270987 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8738682-3fd5-41f7-96a7-bf87ab90f8cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:35.271982 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8738682-3fd5-41f7-96a7-bf87ab90f8cc None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:35.272412 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8738682-3fd5-41f7-96a7-bf87ab90f8cc None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:35.272830 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8738682-3fd5-41f7-96a7-bf87ab90f8cc None admin] PATH_INFO: `/v3/endpoints` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:35.273839 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8738682-3fd5-41f7-96a7-bf87ab90f8cc None admin] RBAC: Adding query filter params (interface=public, service_id=7dc1f22dafd046d385479bced2bd8944, region_id=RegionOne) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:35.274350 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8738682-3fd5-41f7-96a7-bf87ab90f8cc None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:35.275970 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8738682-3fd5-41f7-96a7-bf87ab90f8cc None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:35.289181 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 389/766] 10.222.0.86 () {56 vars in 1251 bytes} [Tue Jun 7 14:21:35 2022] GET /identity/v3/endpoints?service_id=7dc1f22dafd046d385479bced2bd8944&interface=public®ion_id=RegionOne => generated 194 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:35.290884 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5bb634-de8e-4dcb-b585-c3aafe70a4fa None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:35.291367 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5bb634-de8e-4dcb-b585-c3aafe70a4fa None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:35.291893 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5bb634-de8e-4dcb-b585-c3aafe70a4fa None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:35.293785 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 390/767] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:21:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:21:35.294736 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5bb634-de8e-4dcb-b585-c3aafe70a4fa None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:35.374660 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 378/768] 10.222.0.86 () {58 vars in 1282 bytes} [Tue Jun 7 14:21:34 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 07 14:21:35.375927 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dda138b-dfe3-4399-9693-2c2e587a8f09 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:35.376220 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dda138b-dfe3-4399-9693-2c2e587a8f09 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:35.376502 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dda138b-dfe3-4399-9693-2c2e587a8f09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:35.396502 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-5dda138b-dfe3-4399-9693-2c2e587a8f09 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:21:35.397881 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-5dda138b-dfe3-4399-9693-2c2e587a8f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:21:35.408505 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5bb634-de8e-4dcb-b585-c3aafe70a4fa None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:35.445495 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e577c391-2ffb-4890-90b6-6c93070def0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:35.446163 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e577c391-2ffb-4890-90b6-6c93070def0c None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:35.446448 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e577c391-2ffb-4890-90b6-6c93070def0c None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:35.446725 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e577c391-2ffb-4890-90b6-6c93070def0c None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:35.447413 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e577c391-2ffb-4890-90b6-6c93070def0c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:35.448823 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e577c391-2ffb-4890-90b6-6c93070def0c None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:35.457067 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 391/769] 10.222.0.86 () {56 vars in 1087 bytes} [Tue Jun 7 14:21:35 2022] GET /identity/v3/services => generated 772 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:35.457902 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e577c391-2ffb-4890-90b6-6c93070def0c None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:35.478977 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:35.483607 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 379/770] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:21:35 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 14:21:35.507814 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dda138b-dfe3-4399-9693-2c2e587a8f09 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:35.518370 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:35.579651 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e577c391-2ffb-4890-90b6-6c93070def0c None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:35.627198 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a875afda-9fb2-46f4-a423-7ec660bae142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:35.628280 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a875afda-9fb2-46f4-a423-7ec660bae142 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:35.628721 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a875afda-9fb2-46f4-a423-7ec660bae142 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:35.629170 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a875afda-9fb2-46f4-a423-7ec660bae142 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:35.641162 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a875afda-9fb2-46f4-a423-7ec660bae142 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:35.642516 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dda138b-dfe3-4399-9693-2c2e587a8f09 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:35.643354 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a875afda-9fb2-46f4-a423-7ec660bae142 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:35.662914 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-a875afda-9fb2-46f4-a423-7ec660bae142 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:21:35.662914 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:35.662914 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:35.662914 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:35.662914 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:35.662914 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:35.662914 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:35.662914 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:35.662914 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:35.662914 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:35.662914 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:35.662914 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:35.662914 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:21:35.662914 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:21:35.662914 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:21:35.664787 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:21:35.664787 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:35.664787 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:35.664787 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:35.664787 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:35.664787 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:35.664787 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:35.664787 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:35.664787 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:35.664787 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:35.664787 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:35.664787 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:35.664787 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:35.664787 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:35.664787 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:35.664787 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:35.664787 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:35.665691 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:21:35.665691 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:21:35.665691 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:21:35.665691 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:21:35.667570 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 392/771] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jun 7 14:21:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:21:35.673291 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a875afda-9fb2-46f4-a423-7ec660bae142 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:35.682304 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13655ced-60c9-4a60-99f2-df72d2b86958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:35.683355 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13655ced-60c9-4a60-99f2-df72d2b86958 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:35.683775 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13655ced-60c9-4a60-99f2-df72d2b86958 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:35.684130 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13655ced-60c9-4a60-99f2-df72d2b86958 None admin] PATH_INFO: `/v3/services/network` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:35.684882 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13655ced-60c9-4a60-99f2-df72d2b86958 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:35.686479 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13655ced-60c9-4a60-99f2-df72d2b86958 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:35.700229 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-13655ced-60c9-4a60-99f2-df72d2b86958 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 07 14:21:35.700229 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:35.700229 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 07 14:21:35.700229 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 07 14:21:35.700229 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 07 14:21:35.700229 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 07 14:21:35.700229 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 07 14:21:35.700229 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 14:21:35.700229 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 07 14:21:35.700229 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:21:35.700229 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 07 14:21:35.700229 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:21:35.700229 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:35.700229 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:35.700229 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:35.700229 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:35.700229 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:35.701251 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:35.701251 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:35.701251 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:35.701251 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:35.701251 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:35.701251 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:35.701251 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 07 14:21:35.701251 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 07 14:21:35.701251 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 07 14:21:35.701251 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 07 14:21:35.701251 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:35.701251 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:35.701251 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:35.701251 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:35.701251 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:35.701251 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:35.702100 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:35.702100 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:35.702100 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:35.702100 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:35.702100 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:35.702100 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:35.702100 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:35.702100 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:35.702100 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:35.702100 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:35.702100 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 07 14:21:35.702100 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 14:21:35.702100 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 07 14:21:35.702100 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:21:35.702100 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 380/772] 10.222.0.86 () {56 vars in 1111 bytes} [Tue Jun 7 14:21:35 2022] GET /identity/v3/services/network => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 14:21:35.707872 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13655ced-60c9-4a60-99f2-df72d2b86958 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:35.750449 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:35.786519 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:35.821880 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13655ced-60c9-4a60-99f2-df72d2b86958 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:35.822997 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a875afda-9fb2-46f4-a423-7ec660bae142 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:35.862556 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43145de-2d5b-4171-9c63-fec9d7d26f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:35.863343 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43145de-2d5b-4171-9c63-fec9d7d26f84 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:35.863698 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43145de-2d5b-4171-9c63-fec9d7d26f84 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:35.864089 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43145de-2d5b-4171-9c63-fec9d7d26f84 None admin] PATH_INFO: `/v3/services` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:35.864884 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43145de-2d5b-4171-9c63-fec9d7d26f84 None admin] RBAC: Adding query filter params (name=network) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:35.865680 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43145de-2d5b-4171-9c63-fec9d7d26f84 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:35.867035 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43145de-2d5b-4171-9c63-fec9d7d26f84 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:35.870014 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6047c2-7ace-49ed-a0d0-20cd93d2b01a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:35.870943 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6047c2-7ace-49ed-a0d0-20cd93d2b01a None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:35.872020 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6047c2-7ace-49ed-a0d0-20cd93d2b01a None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:35.872469 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6047c2-7ace-49ed-a0d0-20cd93d2b01a None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:35.873381 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6047c2-7ace-49ed-a0d0-20cd93d2b01a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:35.873857 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6047c2-7ace-49ed-a0d0-20cd93d2b01a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:35.874246 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 381/773] 10.222.0.86 () {56 vars in 1112 bytes} [Tue Jun 7 14:21:35 2022] GET /identity/v3/services?name=network => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:35.875842 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6047c2-7ace-49ed-a0d0-20cd93d2b01a None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:35.879679 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43145de-2d5b-4171-9c63-fec9d7d26f84 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:35.890933 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 393/774] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jun 7 14:21:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:35.895868 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6047c2-7ace-49ed-a0d0-20cd93d2b01a None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:36.006859 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6047c2-7ace-49ed-a0d0-20cd93d2b01a None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:36.012261 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43145de-2d5b-4171-9c63-fec9d7d26f84 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:36.039169 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:36.042859 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a901cab0-0bf1-414b-9a12-744cb7ed1204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:36.044250 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a901cab0-0bf1-414b-9a12-744cb7ed1204 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:36.044536 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a901cab0-0bf1-414b-9a12-744cb7ed1204 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:36.044808 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a901cab0-0bf1-414b-9a12-744cb7ed1204 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:36.051962 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a901cab0-0bf1-414b-9a12-744cb7ed1204 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:36.053633 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a901cab0-0bf1-414b-9a12-744cb7ed1204 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:36.075105 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafcfa07-563c-4a61-ab50-6779a20b2dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:36.075793 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafcfa07-563c-4a61-ab50-6779a20b2dce None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:36.076090 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafcfa07-563c-4a61-ab50-6779a20b2dce None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:36.076368 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafcfa07-563c-4a61-ab50-6779a20b2dce None admin] PATH_INFO: `/v3/services` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:36.077079 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafcfa07-563c-4a61-ab50-6779a20b2dce None admin] RBAC: Adding query filter params (type=network) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:36.077388 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafcfa07-563c-4a61-ab50-6779a20b2dce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:36.078765 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafcfa07-563c-4a61-ab50-6779a20b2dce None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:36.079337 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-a901cab0-0bf1-414b-9a12-744cb7ed1204 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:21:36.079337 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:36.079337 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:36.079337 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:36.079337 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:36.079337 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:36.079337 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:36.079337 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:36.079337 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:36.079337 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:36.079337 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:36.079337 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:36.079337 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 14:21:36.079337 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 14:21:36.079337 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 14:21:36.080222 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 14:21:36.080222 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:36.080222 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:36.080222 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:36.080222 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:36.080222 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:36.080222 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:36.080222 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:36.080222 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:36.080222 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:36.080222 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:36.080222 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:36.080222 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:36.080222 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:36.080222 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:36.080222 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:36.080222 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:36.081094 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 14:21:36.081094 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 14:21:36.081094 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 14:21:36.081094 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 14:21:36.081094 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 14:21:36.081094 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 14:21:36.081094 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:21:36.081094 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:21:36.081999 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:36.082069 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 394/775] 10.222.0.86 () {56 vars in 1111 bytes} [Tue Jun 7 14:21:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:21:36.088203 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a901cab0-0bf1-414b-9a12-744cb7ed1204 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:36.094369 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 382/776] 10.222.0.86 () {56 vars in 1112 bytes} [Tue Jun 7 14:21:35 2022] GET /identity/v3/services?type=network => generated 350 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:21:36.099877 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafcfa07-563c-4a61-ab50-6779a20b2dce None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:36.224902 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a901cab0-0bf1-414b-9a12-744cb7ed1204 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:36.263860 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e562f1-644f-4c56-ac63-ae33eebaa409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:36.264524 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e562f1-644f-4c56-ac63-ae33eebaa409 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:36.264811 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e562f1-644f-4c56-ac63-ae33eebaa409 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:36.265091 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e562f1-644f-4c56-ac63-ae33eebaa409 None admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:36.266640 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e562f1-644f-4c56-ac63-ae33eebaa409 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:36.267555 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e562f1-644f-4c56-ac63-ae33eebaa409 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:36.269020 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e562f1-644f-4c56-ac63-ae33eebaa409 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:36.297391 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 395/777] 10.222.0.86 () {56 vars in 1148 bytes} [Tue Jun 7 14:21:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:36.304784 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e562f1-644f-4c56-ac63-ae33eebaa409 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:36.358145 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafcfa07-563c-4a61-ab50-6779a20b2dce None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:36.369621 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:36.446690 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e562f1-644f-4c56-ac63-ae33eebaa409 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:36.452166 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607252b8-b7c2-4dbd-ad2d-5867c5f30a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:36.452839 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607252b8-b7c2-4dbd-ad2d-5867c5f30a36 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:36.453125 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607252b8-b7c2-4dbd-ad2d-5867c5f30a36 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:36.453402 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607252b8-b7c2-4dbd-ad2d-5867c5f30a36 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:36.454212 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607252b8-b7c2-4dbd-ad2d-5867c5f30a36 None admin] RBAC: Adding query filter params (interface=public, service_id=7c92418725024a3181c0af27a3214f26, region_id=RegionOne) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:36.454531 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607252b8-b7c2-4dbd-ad2d-5867c5f30a36 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:36.455931 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607252b8-b7c2-4dbd-ad2d-5867c5f30a36 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:36.473510 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 383/778] 10.222.0.86 () {56 vars in 1251 bytes} [Tue Jun 7 14:21:36 2022] GET /identity/v3/endpoints?service_id=7c92418725024a3181c0af27a3214f26&interface=public®ion_id=RegionOne => generated 194 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:21:36.478931 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607252b8-b7c2-4dbd-ad2d-5867c5f30a36 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:36.520482 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9813aadc-d925-4754-bfc1-ccded980fd12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:36.521146 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9813aadc-d925-4754-bfc1-ccded980fd12 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:36.521434 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9813aadc-d925-4754-bfc1-ccded980fd12 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:36.521716 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9813aadc-d925-4754-bfc1-ccded980fd12 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:36.522566 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9813aadc-d925-4754-bfc1-ccded980fd12 None admin] RBAC: Adding query filter params (role.id=28e9b75018ac44c0afe7ab728071f2d5, scope.project.id=e429537b190c4c5ea7e1332ab044ca7a, user.id=d7b598c6a3f642ef9edc971ad3ebbe31) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:36.522885 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9813aadc-d925-4754-bfc1-ccded980fd12 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:36.524347 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9813aadc-d925-4754-bfc1-ccded980fd12 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:36.536028 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 396/779] 10.222.0.86 () {56 vars in 1374 bytes} [Tue Jun 7 14:21:36 2022] GET /identity/v3/role_assignments?user.id=d7b598c6a3f642ef9edc971ad3ebbe31&scope.project.id=e429537b190c4c5ea7e1332ab044ca7a&role.id=28e9b75018ac44c0afe7ab728071f2d5 => generated 259 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:36.588983 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:36.644550 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607252b8-b7c2-4dbd-ad2d-5867c5f30a36 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:36.700600 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fd5784-f50c-47b4-b9f5-d4d14ca0cf99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:36.701299 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fd5784-f50c-47b4-b9f5-d4d14ca0cf99 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:36.701588 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fd5784-f50c-47b4-b9f5-d4d14ca0cf99 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:36.701869 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fd5784-f50c-47b4-b9f5-d4d14ca0cf99 None admin] PATH_INFO: `/v3/services` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:36.702650 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fd5784-f50c-47b4-b9f5-d4d14ca0cf99 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:36.704115 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fd5784-f50c-47b4-b9f5-d4d14ca0cf99 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:36.710247 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 384/780] 10.222.0.86 () {56 vars in 1087 bytes} [Tue Jun 7 14:21:36 2022] GET /identity/v3/services => generated 772 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:36.721472 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b055f1a-9634-47fd-8cbb-dcf6cc7e0aaa None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:36.722001 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b055f1a-9634-47fd-8cbb-dcf6cc7e0aaa None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:36.722001 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b055f1a-9634-47fd-8cbb-dcf6cc7e0aaa None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:36.724992 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 397/781] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:21:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:21:36.729715 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a57a240-5fd1-4e77-899b-2dd0748ba837 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:36.729986 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a57a240-5fd1-4e77-899b-2dd0748ba837 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:36.730201 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a57a240-5fd1-4e77-899b-2dd0748ba837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:36.748716 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-1a57a240-5fd1-4e77-899b-2dd0748ba837 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:21:36.749920 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-1a57a240-5fd1-4e77-899b-2dd0748ba837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:21:36.831965 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 385/782] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:21:36 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 14:21:36.853424 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b055f1a-9634-47fd-8cbb-dcf6cc7e0aaa None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:36.982278 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b055f1a-9634-47fd-8cbb-dcf6cc7e0aaa None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:37.000135 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:37.021995 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd63079-1097-429d-a93d-75a8322a8a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:37.022874 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd63079-1097-429d-a93d-75a8322a8a77 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:37.023153 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd63079-1097-429d-a93d-75a8322a8a77 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:37.023472 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd63079-1097-429d-a93d-75a8322a8a77 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:37.036215 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd63079-1097-429d-a93d-75a8322a8a77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:21:37.049472 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-0dd63079-1097-429d-a93d-75a8322a8a77 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 14:21:37.049472 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:37.049472 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:37.049472 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:37.049472 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:37.049472 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:37.049472 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:37.049472 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:37.049472 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:37.049472 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:37.049472 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:37.049472 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:37.049472 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:21:37.049472 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:21:37.049472 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:21:37.049472 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:21:37.050423 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:21:37.050423 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:21:37.050423 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:21:37.050423 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:21:37.050423 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:37.050423 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:37.050423 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:37.050423 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:37.050423 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:37.050423 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:37.050423 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:37.050423 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:37.050423 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:37.050423 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:37.050423 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:37.050423 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:37.051240 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:37.051240 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:37.051240 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:37.051240 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:37.051240 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:21:37.051240 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:21:37.051240 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:21:37.051240 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:21:37.051240 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:21:37.051240 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:21:37.051240 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 14:21:37.051240 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:21:37.055601 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 398/783] 10.222.0.86 () {56 vars in 1096 bytes} [Tue Jun 7 14:21:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:21:37.056978 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a57a240-5fd1-4e77-899b-2dd0748ba837 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:37.119322 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:37.168735 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a57a240-5fd1-4e77-899b-2dd0748ba837 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:37.210933 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a976a22b-81e7-4638-bb0a-0760d5bf0066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:37.211921 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a976a22b-81e7-4638-bb0a-0760d5bf0066 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:37.212356 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a976a22b-81e7-4638-bb0a-0760d5bf0066 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:37.212800 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a976a22b-81e7-4638-bb0a-0760d5bf0066 None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:37.213723 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a976a22b-81e7-4638-bb0a-0760d5bf0066 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:37.214181 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a976a22b-81e7-4638-bb0a-0760d5bf0066 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:37.216294 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a976a22b-81e7-4638-bb0a-0760d5bf0066 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:37.226195 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 386/784] 10.222.0.86 () {56 vars in 1099 bytes} [Tue Jun 7 14:21:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:37.232977 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd63079-1097-429d-a93d-75a8322a8a77 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:37.412282 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd63079-1097-429d-a93d-75a8322a8a77 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:37.467367 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1300311-62b3-4e9e-8313-f1eec5c8bf13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:37.468452 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1300311-62b3-4e9e-8313-f1eec5c8bf13 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:37.468883 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1300311-62b3-4e9e-8313-f1eec5c8bf13 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:37.469321 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1300311-62b3-4e9e-8313-f1eec5c8bf13 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:37.484767 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1300311-62b3-4e9e-8313-f1eec5c8bf13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:37.486439 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1300311-62b3-4e9e-8313-f1eec5c8bf13 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:37.514848 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-e1300311-62b3-4e9e-8313-f1eec5c8bf13 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:21:37.514848 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:37.514848 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:37.514848 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:37.514848 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:37.514848 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:37.514848 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:37.514848 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:37.514848 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:37.514848 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:37.514848 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:37.514848 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:37.514848 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:21:37.514848 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:21:37.514848 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:21:37.515827 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:21:37.515827 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:37.515827 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:37.515827 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:37.515827 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:37.515827 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:37.515827 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:37.515827 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:37.515827 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:37.515827 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:37.515827 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:37.515827 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:37.515827 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:37.515827 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:37.515827 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:37.515827 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:37.515827 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:37.516711 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:21:37.516711 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:21:37.516711 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:21:37.516711 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:21:37.516711 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 399/785] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jun 7 14:21:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:21:37.524814 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a976a22b-81e7-4638-bb0a-0760d5bf0066 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:37.691487 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a976a22b-81e7-4638-bb0a-0760d5bf0066 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:37.716400 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:37.726094 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13dbd5b-e61e-4284-9280-7ae126036901 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:37.726586 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13dbd5b-e61e-4284-9280-7ae126036901 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:37.726662 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13dbd5b-e61e-4284-9280-7ae126036901 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:37.734282 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 400/786] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:21:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 07 14:21:37.734282 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6159860e-aadc-4270-955f-fded82fdbaa1 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:37.734282 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6159860e-aadc-4270-955f-fded82fdbaa1 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:37.734282 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6159860e-aadc-4270-955f-fded82fdbaa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:37.742395 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c044da2-d18e-4905-aa2b-4d901f16ba54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:37.743003 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c044da2-d18e-4905-aa2b-4d901f16ba54 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:37.743289 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c044da2-d18e-4905-aa2b-4d901f16ba54 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:37.743566 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c044da2-d18e-4905-aa2b-4d901f16ba54 None admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:37.744328 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c044da2-d18e-4905-aa2b-4d901f16ba54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:37.744638 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c044da2-d18e-4905-aa2b-4d901f16ba54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:37.746518 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c044da2-d18e-4905-aa2b-4d901f16ba54 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:37.766209 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-6159860e-aadc-4270-955f-fded82fdbaa1 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:21:37.767409 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-6159860e-aadc-4270-955f-fded82fdbaa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:21:37.777594 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 387/787] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jun 7 14:21:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:37.783221 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c044da2-d18e-4905-aa2b-4d901f16ba54 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:37.785980 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:37.839277 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 401/788] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:21:37 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 07 14:21:37.863443 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6159860e-aadc-4270-955f-fded82fdbaa1 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:37.970958 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6159860e-aadc-4270-955f-fded82fdbaa1 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:38.011417 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa196adb-2037-4930-9f95-50b8a2fd797d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:38.013093 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa196adb-2037-4930-9f95-50b8a2fd797d None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:38.013380 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa196adb-2037-4930-9f95-50b8a2fd797d None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:38.013758 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa196adb-2037-4930-9f95-50b8a2fd797d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:38.026941 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa196adb-2037-4930-9f95-50b8a2fd797d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:21:38.039657 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-aa196adb-2037-4930-9f95-50b8a2fd797d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 14:21:38.039657 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:38.039657 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:38.039657 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:38.039657 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:38.039657 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:38.039657 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:38.039657 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:38.039657 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:38.039657 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:38.039657 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:38.039657 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:38.039657 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:21:38.039657 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:21:38.039657 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:21:38.039657 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:21:38.040587 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:21:38.040587 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:21:38.040587 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:21:38.040587 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:21:38.040587 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:38.040587 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:38.040587 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:38.040587 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:38.040587 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:38.040587 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:38.040587 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:38.040587 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:38.040587 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:38.040587 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:38.040587 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:38.040587 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:38.041409 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:38.041409 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:38.041409 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:38.041409 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:38.041409 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:21:38.041409 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:21:38.041409 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:21:38.041409 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:21:38.041409 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:21:38.041409 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:21:38.041409 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 14:21:38.041409 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:21:38.041409 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 402/789] 10.222.0.86 () {56 vars in 1096 bytes} [Tue Jun 7 14:21:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 14:21:38.047252 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa196adb-2037-4930-9f95-50b8a2fd797d None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:38.062461 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c044da2-d18e-4905-aa2b-4d901f16ba54 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:38.067803 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:38.156155 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa196adb-2037-4930-9f95-50b8a2fd797d None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:38.189089 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cdee89-4586-44a2-a44f-8a868b357335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:38.190363 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cdee89-4586-44a2-a44f-8a868b357335 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:38.190890 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cdee89-4586-44a2-a44f-8a868b357335 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:38.191411 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cdee89-4586-44a2-a44f-8a868b357335 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:38.207811 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c869ccb-02b4-494b-8a12-eb2590c8e98e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:38.207811 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c869ccb-02b4-494b-8a12-eb2590c8e98e None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:38.207811 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c869ccb-02b4-494b-8a12-eb2590c8e98e None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:38.207811 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c869ccb-02b4-494b-8a12-eb2590c8e98e None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:38.208306 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c869ccb-02b4-494b-8a12-eb2590c8e98e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:38.208306 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c869ccb-02b4-494b-8a12-eb2590c8e98e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:38.208306 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c869ccb-02b4-494b-8a12-eb2590c8e98e None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:38.210052 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cdee89-4586-44a2-a44f-8a868b357335 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:38.211739 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cdee89-4586-44a2-a44f-8a868b357335 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:38.217958 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 403/790] 10.222.0.86 () {56 vars in 1099 bytes} [Tue Jun 7 14:21:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:38.223799 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c869ccb-02b4-494b-8a12-eb2590c8e98e None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:38.239987 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-01cdee89-4586-44a2-a44f-8a868b357335 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 07 14:21:38.239987 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:38.239987 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:38.239987 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:38.239987 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:38.239987 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:38.239987 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:38.239987 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:38.239987 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:38.239987 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:38.239987 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:38.239987 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:38.239987 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 14:21:38.239987 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 14:21:38.239987 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 14:21:38.239987 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 14:21:38.241000 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:38.241000 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:38.241000 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 14:21:38.241000 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:21:38.241000 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 14:21:38.241000 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:21:38.241000 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:38.241000 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:38.241000 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:38.241000 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:38.241000 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:38.241000 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:38.241000 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:38.241000 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:38.241000 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:38.241000 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:38.241000 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:38.241000 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:38.242009 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:38.242009 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:38.242009 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 14:21:38.242009 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 14:21:38.242009 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 14:21:38.242009 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 14:21:38.242009 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 14:21:38.242009 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 14:21:38.242009 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 07 14:21:38.242009 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:21:38.248452 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 388/791] 10.222.0.86 () {56 vars in 1093 bytes} [Tue Jun 7 14:21:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 466 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:21:38.253811 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cdee89-4586-44a2-a44f-8a868b357335 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:38.312137 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:38.331397 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c869ccb-02b4-494b-8a12-eb2590c8e98e None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:38.362966 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:38.371350 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dbec11-55a2-4a62-8f5f-a5c633d770c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:38.372509 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dbec11-55a2-4a62-8f5f-a5c633d770c6 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:38.372997 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dbec11-55a2-4a62-8f5f-a5c633d770c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:38.373493 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dbec11-55a2-4a62-8f5f-a5c633d770c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:38.385311 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dbec11-55a2-4a62-8f5f-a5c633d770c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:38.387695 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dbec11-55a2-4a62-8f5f-a5c633d770c6 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:38.411118 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-15dbec11-55a2-4a62-8f5f-a5c633d770c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:21:38.411118 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:38.411118 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:38.411118 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:38.411118 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:38.411118 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:38.411118 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:38.411118 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:38.411118 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:38.411118 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:38.411118 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:38.411118 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:38.411118 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:21:38.411118 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:21:38.411118 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:21:38.412282 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:21:38.412282 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:38.412282 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:38.412282 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:38.412282 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:38.412282 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:38.412282 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:38.412282 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:38.412282 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:38.412282 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:38.412282 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:38.412282 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:38.412282 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:38.412282 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:38.412282 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:38.412282 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:38.412282 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:38.413361 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:21:38.413361 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:21:38.413361 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:21:38.413361 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:21:38.415964 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 404/792] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jun 7 14:21:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:21:38.422049 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5d42ae-85a2-418a-b732-8039c9faf398 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:38.422049 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5d42ae-85a2-418a-b732-8039c9faf398 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:38.422049 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5d42ae-85a2-418a-b732-8039c9faf398 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:38.422736 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 405/793] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:21:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:21:38.427410 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5d42ae-85a2-418a-b732-8039c9faf398 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:38.436941 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cdee89-4586-44a2-a44f-8a868b357335 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:38.474222 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3e945c-d8ab-4124-9695-fab20104ace0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:38.474888 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3e945c-d8ab-4124-9695-fab20104ace0 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:38.475167 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3e945c-d8ab-4124-9695-fab20104ace0 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:38.475824 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3e945c-d8ab-4124-9695-fab20104ace0 None admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:38.477241 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3e945c-d8ab-4124-9695-fab20104ace0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:38.477553 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3e945c-d8ab-4124-9695-fab20104ace0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:38.479150 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3e945c-d8ab-4124-9695-fab20104ace0 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:38.503838 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 389/794] 10.222.0.86 () {56 vars in 1133 bytes} [Tue Jun 7 14:21:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:21:38.505471 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3fd94b-1b19-4d50-8968-f0a7a7d8542a None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:38.506668 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3fd94b-1b19-4d50-8968-f0a7a7d8542a None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:38.507132 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3fd94b-1b19-4d50-8968-f0a7a7d8542a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:38.523485 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-dd3fd94b-1b19-4d50-8968-f0a7a7d8542a None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:21:38.524764 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-dd3fd94b-1b19-4d50-8968-f0a7a7d8542a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:21:38.543673 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5d42ae-85a2-418a-b732-8039c9faf398 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:38.571021 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:38.579667 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea37326a-77d5-4339-8d14-f86d1b3189c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:38.581322 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea37326a-77d5-4339-8d14-f86d1b3189c1 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:38.581322 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea37326a-77d5-4339-8d14-f86d1b3189c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:38.581322 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea37326a-77d5-4339-8d14-f86d1b3189c1 None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:38.582344 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea37326a-77d5-4339-8d14-f86d1b3189c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:38.582846 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea37326a-77d5-4339-8d14-f86d1b3189c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:38.584420 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea37326a-77d5-4339-8d14-f86d1b3189c1 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:38.603775 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 390/795] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:21:38 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 14:21:38.603775 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3fd94b-1b19-4d50-8968-f0a7a7d8542a None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:38.607371 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 406/796] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jun 7 14:21:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:38.612606 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea37326a-77d5-4339-8d14-f86d1b3189c1 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:38.632144 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:38.705711 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3fd94b-1b19-4d50-8968-f0a7a7d8542a None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:38.725467 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea37326a-77d5-4339-8d14-f86d1b3189c1 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:38.740595 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac03b0f-c2ff-403b-aa58-3e2d88e4faa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:38.741314 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac03b0f-c2ff-403b-aa58-3e2d88e4faa2 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:38.741599 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac03b0f-c2ff-403b-aa58-3e2d88e4faa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:38.741876 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac03b0f-c2ff-403b-aa58-3e2d88e4faa2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:38.762372 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c883b7-458c-4a4e-896a-0c572e62ea30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:38.763913 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c883b7-458c-4a4e-896a-0c572e62ea30 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:38.764407 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c883b7-458c-4a4e-896a-0c572e62ea30 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:38.764878 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c883b7-458c-4a4e-896a-0c572e62ea30 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:38.773082 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c883b7-458c-4a4e-896a-0c572e62ea30 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:38.774778 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c883b7-458c-4a4e-896a-0c572e62ea30 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:38.789938 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-a9c883b7-458c-4a4e-896a-0c572e62ea30 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 07 14:21:38.789938 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:38.789938 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:38.789938 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:38.789938 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:38.789938 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:38.789938 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:38.789938 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:38.789938 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:38.789938 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:38.789938 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:38.789938 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:38.789938 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 14:21:38.789938 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 14:21:38.789938 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 14:21:38.789938 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 14:21:38.790932 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:38.790932 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:38.790932 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 14:21:38.790932 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:21:38.790932 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 14:21:38.790932 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:21:38.790932 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:38.790932 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:38.790932 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:38.790932 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:38.790932 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:38.790932 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:38.790932 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:38.790932 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:38.790932 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:38.790932 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:38.790932 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:38.790932 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:38.791905 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:38.791905 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:38.791905 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 14:21:38.791905 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 14:21:38.791905 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 14:21:38.791905 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 14:21:38.791905 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 14:21:38.791905 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 14:21:38.791905 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 07 14:21:38.791905 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:21:38.794589 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 407/797] 10.222.0.86 () {56 vars in 1096 bytes} [Tue Jun 7 14:21:38 2022] GET /identity/v3/users/swift => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 14:21:38.795589 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c883b7-458c-4a4e-896a-0c572e62ea30 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:38.816670 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac03b0f-c2ff-403b-aa58-3e2d88e4faa2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:38.818322 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac03b0f-c2ff-403b-aa58-3e2d88e4faa2 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:38.848306 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:38.848512 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:38.903329 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c883b7-458c-4a4e-896a-0c572e62ea30 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:38.923942 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 391/798] 10.222.0.86 () {58 vars in 1282 bytes} [Tue Jun 7 14:21:38 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 07 14:21:38.925037 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac03b0f-c2ff-403b-aa58-3e2d88e4faa2 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:38.944701 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c2569c-96f6-4688-afb3-346e71630e95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:38.945659 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c2569c-96f6-4688-afb3-346e71630e95 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:38.946040 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c2569c-96f6-4688-afb3-346e71630e95 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:38.946408 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c2569c-96f6-4688-afb3-346e71630e95 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:38.947165 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c2569c-96f6-4688-afb3-346e71630e95 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:38.948718 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c2569c-96f6-4688-afb3-346e71630e95 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:38.962070 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-d9c2569c-96f6-4688-afb3-346e71630e95 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 07 14:21:38.962070 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:38.962070 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 07 14:21:38.962070 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 07 14:21:38.962070 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 07 14:21:38.962070 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 07 14:21:38.962070 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 07 14:21:38.962070 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 14:21:38.962070 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 07 14:21:38.962070 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:21:38.962070 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 07 14:21:38.962070 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:21:38.962070 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:38.962070 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:38.962070 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:38.962070 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:38.963328 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:38.963328 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:38.963328 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:38.963328 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:38.963328 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:38.963328 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:38.963328 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:38.963328 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 07 14:21:38.963328 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 07 14:21:38.963328 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 07 14:21:38.963328 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 07 14:21:38.963328 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:38.963328 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:38.963328 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:38.963328 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:38.963328 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:38.964310 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:38.964310 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:38.964310 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:38.964310 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:38.964310 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:38.964310 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:38.964310 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:38.964310 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:38.964310 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:38.964310 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:38.964310 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:38.964310 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 07 14:21:38.964310 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 14:21:38.964310 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 07 14:21:38.964310 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:21:38.970343 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 408/799] 10.222.0.86 () {56 vars in 1129 bytes} [Tue Jun 7 14:21:38 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:21:38.971295 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c2569c-96f6-4688-afb3-346e71630e95 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:39.033554 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac03b0f-c2ff-403b-aa58-3e2d88e4faa2 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:39.069154 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e7e1d1-a851-47af-a16a-d18eda79ab69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:39.070159 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e7e1d1-a851-47af-a16a-d18eda79ab69 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:39.070661 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e7e1d1-a851-47af-a16a-d18eda79ab69 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:39.071193 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e7e1d1-a851-47af-a16a-d18eda79ab69 None admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:39.072338 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e7e1d1-a851-47af-a16a-d18eda79ab69 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:39.072882 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e7e1d1-a851-47af-a16a-d18eda79ab69 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:39.075142 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e7e1d1-a851-47af-a16a-d18eda79ab69 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:39.076760 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c2569c-96f6-4688-afb3-346e71630e95 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:39.091647 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:39.096184 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:39.100844 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 392/800] 10.222.0.86 () {56 vars in 1135 bytes} [Tue Jun 7 14:21:38 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:39.102309 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e7e1d1-a851-47af-a16a-d18eda79ab69 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:39.118564 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b208e2b-8996-4536-9d0c-bf99163a1539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:39.119675 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b208e2b-8996-4536-9d0c-bf99163a1539 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:39.120150 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b208e2b-8996-4536-9d0c-bf99163a1539 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:39.120558 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b208e2b-8996-4536-9d0c-bf99163a1539 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:39.133371 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b208e2b-8996-4536-9d0c-bf99163a1539 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:39.135164 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b208e2b-8996-4536-9d0c-bf99163a1539 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:39.155781 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-7b208e2b-8996-4536-9d0c-bf99163a1539 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:21:39.155781 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:39.155781 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:39.155781 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:39.155781 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:39.155781 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:39.155781 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:39.155781 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:39.155781 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:39.155781 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:39.155781 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:39.155781 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:39.155781 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:21:39.155781 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:21:39.155781 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:21:39.157199 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:21:39.157199 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:39.157199 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:39.157199 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:39.157199 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:39.157199 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:39.157199 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:39.157199 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:39.157199 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:39.157199 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:39.157199 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:39.157199 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:39.157199 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:39.157199 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:39.157199 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:39.157199 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:39.157199 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:39.158289 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:21:39.158289 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:21:39.158289 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:21:39.158289 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:21:39.164744 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 409/801] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jun 7 14:21:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:21:39.165784 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b208e2b-8996-4536-9d0c-bf99163a1539 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:39.215119 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e7e1d1-a851-47af-a16a-d18eda79ab69 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:39.259000 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8bb46f-3555-4afb-a215-bea1089b0347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:39.259848 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8bb46f-3555-4afb-a215-bea1089b0347 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:39.260235 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8bb46f-3555-4afb-a215-bea1089b0347 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:39.261025 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8bb46f-3555-4afb-a215-bea1089b0347 None admin] PATH_INFO: `/v3/services` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:39.262414 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8bb46f-3555-4afb-a215-bea1089b0347 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:39.263149 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8bb46f-3555-4afb-a215-bea1089b0347 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:39.264842 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8bb46f-3555-4afb-a215-bea1089b0347 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:39.271252 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 393/802] 10.222.0.86 () {56 vars in 1124 bytes} [Tue Jun 7 14:21:39 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:39.275579 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8bb46f-3555-4afb-a215-bea1089b0347 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:39.278640 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b208e2b-8996-4536-9d0c-bf99163a1539 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:39.318063 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4867055d-71ea-4e34-9788-d3e1b529e59f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:39.319250 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4867055d-71ea-4e34-9788-d3e1b529e59f None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:39.319786 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4867055d-71ea-4e34-9788-d3e1b529e59f None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:39.320272 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4867055d-71ea-4e34-9788-d3e1b529e59f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:39.332194 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4867055d-71ea-4e34-9788-d3e1b529e59f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:39.333946 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4867055d-71ea-4e34-9788-d3e1b529e59f None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:39.334963 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:39.352321 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-4867055d-71ea-4e34-9788-d3e1b529e59f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:21:39.352321 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:39.352321 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:39.352321 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:39.352321 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:39.352321 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:39.352321 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:39.352321 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:39.352321 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:39.352321 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:39.352321 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:39.352321 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:39.352321 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:21:39.352321 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:21:39.352321 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:21:39.353213 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:21:39.353213 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:39.353213 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:39.353213 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:39.353213 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:39.353213 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:39.353213 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:39.353213 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:39.353213 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:39.353213 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:39.353213 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:39.353213 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:39.353213 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:39.353213 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:39.353213 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:39.353213 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:39.353213 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:39.354115 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:21:39.354115 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:21:39.354115 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:21:39.354115 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:21:39.357000 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 410/803] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jun 7 14:21:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:21:39.358107 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4867055d-71ea-4e34-9788-d3e1b529e59f None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:39.378390 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:39.403104 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8bb46f-3555-4afb-a215-bea1089b0347 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:39.447582 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df880b32-1687-44e7-a567-9d74ffe00f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:39.448275 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df880b32-1687-44e7-a567-9d74ffe00f6c None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:39.448562 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df880b32-1687-44e7-a567-9d74ffe00f6c None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:39.448841 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df880b32-1687-44e7-a567-9d74ffe00f6c None admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:39.449586 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df880b32-1687-44e7-a567-9d74ffe00f6c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:39.449892 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df880b32-1687-44e7-a567-9d74ffe00f6c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:39.451265 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df880b32-1687-44e7-a567-9d74ffe00f6c None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:39.463792 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 394/804] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jun 7 14:21:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:39.463792 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df880b32-1687-44e7-a567-9d74ffe00f6c None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:39.470802 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4867055d-71ea-4e34-9788-d3e1b529e59f None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:39.505535 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48bbf6e-e837-4723-af6e-3f7fdbb68fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:39.506202 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48bbf6e-e837-4723-af6e-3f7fdbb68fb4 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:39.506485 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48bbf6e-e837-4723-af6e-3f7fdbb68fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:39.506762 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48bbf6e-e837-4723-af6e-3f7fdbb68fb4 None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:39.507467 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48bbf6e-e837-4723-af6e-3f7fdbb68fb4 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:39.507815 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48bbf6e-e837-4723-af6e-3f7fdbb68fb4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:39.509180 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48bbf6e-e837-4723-af6e-3f7fdbb68fb4 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:39.513977 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 411/805] 10.222.0.86 () {56 vars in 1124 bytes} [Tue Jun 7 14:21:39 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:39.515165 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c13131c-956d-4cfc-958d-aa928f126822 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:39.515455 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c13131c-956d-4cfc-958d-aa928f126822 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:39.515732 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c13131c-956d-4cfc-958d-aa928f126822 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:39.517337 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 412/806] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:21:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:21:39.518051 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c13131c-956d-4cfc-958d-aa928f126822 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:39.567592 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df880b32-1687-44e7-a567-9d74ffe00f6c None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:39.576104 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:39.599717 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33eaaf5-f26c-421c-b86c-b08b69189275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:39.599933 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:39.600410 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33eaaf5-f26c-421c-b86c-b08b69189275 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:39.600686 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33eaaf5-f26c-421c-b86c-b08b69189275 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:39.600966 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33eaaf5-f26c-421c-b86c-b08b69189275 None admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:39.601690 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33eaaf5-f26c-421c-b86c-b08b69189275 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:39.601999 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33eaaf5-f26c-421c-b86c-b08b69189275 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:39.603407 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33eaaf5-f26c-421c-b86c-b08b69189275 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:39.615741 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 395/807] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jun 7 14:21:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:39.617263 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e311e9f-5664-4f91-a1a7-c9699f281e04 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:39.617528 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e311e9f-5664-4f91-a1a7-c9699f281e04 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:39.617813 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e311e9f-5664-4f91-a1a7-c9699f281e04 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:39.619351 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 396/808] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:21:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:21:39.620026 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e311e9f-5664-4f91-a1a7-c9699f281e04 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:39.620666 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c13131c-956d-4cfc-958d-aa928f126822 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:39.655643 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c76bf7-4dfb-4447-9d92-8c0ddfe1bad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:39.657185 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c76bf7-4dfb-4447-9d92-8c0ddfe1bad8 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:39.657467 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c76bf7-4dfb-4447-9d92-8c0ddfe1bad8 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:39.657739 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c76bf7-4dfb-4447-9d92-8c0ddfe1bad8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:39.665162 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c76bf7-4dfb-4447-9d92-8c0ddfe1bad8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:39.666599 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c76bf7-4dfb-4447-9d92-8c0ddfe1bad8 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:39.680651 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-63c76bf7-4dfb-4447-9d92-8c0ddfe1bad8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:21:39.680651 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:39.680651 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:39.680651 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:39.680651 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:39.680651 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:39.680651 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:39.680651 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:39.680651 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:39.680651 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:39.680651 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:39.680651 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:39.680651 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 14:21:39.680651 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 14:21:39.680651 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 14:21:39.681590 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 14:21:39.681590 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:39.681590 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:39.681590 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:39.681590 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:39.681590 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:39.681590 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:39.681590 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:39.681590 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:39.681590 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:39.681590 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:39.681590 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:39.681590 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:39.681590 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:39.681590 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:39.681590 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:39.681590 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:39.682454 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 14:21:39.682454 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 14:21:39.682454 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 14:21:39.682454 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 14:21:39.682454 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 14:21:39.682454 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 14:21:39.682454 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:21:39.682454 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:21:39.682454 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 413/809] 10.222.0.86 () {56 vars in 1111 bytes} [Tue Jun 7 14:21:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:21:39.682981 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe5b66c-972d-44dd-a862-6112d53a187b None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:39.683264 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe5b66c-972d-44dd-a862-6112d53a187b None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:39.684113 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe5b66c-972d-44dd-a862-6112d53a187b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:39.700070 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-cfe5b66c-972d-44dd-a862-6112d53a187b None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:21:39.701257 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-cfe5b66c-972d-44dd-a862-6112d53a187b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:21:39.727654 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e311e9f-5664-4f91-a1a7-c9699f281e04 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:39.762599 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3be3e4-0dc1-4538-9d31-86032eee1cfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:39.763248 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3be3e4-0dc1-4538-9d31-86032eee1cfe None admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:39.763534 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3be3e4-0dc1-4538-9d31-86032eee1cfe None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:39.763851 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3be3e4-0dc1-4538-9d31-86032eee1cfe None admin] PATH_INFO: `/v3/endpoints` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:39.764598 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3be3e4-0dc1-4538-9d31-86032eee1cfe None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:39.765621 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 414/810] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:21:39 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 14:21:39.766052 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3be3e4-0dc1-4538-9d31-86032eee1cfe None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:39.766438 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe5b66c-972d-44dd-a862-6112d53a187b None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:39.832208 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:39.861561 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe5b66c-972d-44dd-a862-6112d53a187b None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:39.892770 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519871de-dbdf-4a39-bca2-cea6fc2863cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:39.893542 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519871de-dbdf-4a39-bca2-cea6fc2863cd None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:39.893821 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519871de-dbdf-4a39-bca2-cea6fc2863cd None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:39.894091 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519871de-dbdf-4a39-bca2-cea6fc2863cd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:39.900377 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519871de-dbdf-4a39-bca2-cea6fc2863cd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:39.901793 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519871de-dbdf-4a39-bca2-cea6fc2863cd None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:39.914885 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 397/811] 10.222.0.86 () {60 vars in 1144 bytes} [Tue Jun 7 14:21:39 2022] POST /identity/v3/endpoints => generated 346 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:21:39.916266 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773bd67c-65c5-4eac-9a49-8fbcc9cb2990 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:39.931775 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-519871de-dbdf-4a39-bca2-cea6fc2863cd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:21:39.931775 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:39.931775 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:39.931775 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:39.931775 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:39.931775 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:39.931775 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:39.931775 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:39.931775 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:39.931775 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:39.931775 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:39.931775 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:39.931775 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 14:21:39.931775 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 14:21:39.931775 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 14:21:39.932729 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 14:21:39.932729 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:39.932729 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:39.932729 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:39.932729 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:39.932729 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:39.932729 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:39.932729 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:39.932729 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:39.932729 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:39.932729 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:39.932729 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:39.932729 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:39.932729 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:39.932729 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:39.932729 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:39.932729 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:39.933654 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 14:21:39.933654 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 14:21:39.933654 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 14:21:39.933654 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 14:21:39.933654 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 14:21:39.933654 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 14:21:39.933654 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:21:39.933654 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:21:39.934077 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773bd67c-65c5-4eac-9a49-8fbcc9cb2990 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:39.934077 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773bd67c-65c5-4eac-9a49-8fbcc9cb2990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:39.934214 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 415/812] 10.222.0.86 () {56 vars in 1111 bytes} [Tue Jun 7 14:21:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:21:39.934214 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519871de-dbdf-4a39-bca2-cea6fc2863cd None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:39.939328 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-773bd67c-65c5-4eac-9a49-8fbcc9cb2990 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:21:39.940632 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-773bd67c-65c5-4eac-9a49-8fbcc9cb2990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:21:39.964028 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:40.022472 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 398/813] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:21:39 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 14:21:40.023379 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773bd67c-65c5-4eac-9a49-8fbcc9cb2990 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:40.052494 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519871de-dbdf-4a39-bca2-cea6fc2863cd None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:40.083939 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:40.090737 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4b22e4-d64a-4a4b-81c2-234ce264d538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:40.091511 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4b22e4-d64a-4a4b-81c2-234ce264d538 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:40.091885 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4b22e4-d64a-4a4b-81c2-234ce264d538 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:40.092166 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4b22e4-d64a-4a4b-81c2-234ce264d538 None admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:40.098220 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4b22e4-d64a-4a4b-81c2-234ce264d538 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:40.098220 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4b22e4-d64a-4a4b-81c2-234ce264d538 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:40.098220 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4b22e4-d64a-4a4b-81c2-234ce264d538 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:40.112711 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 416/814] 10.222.0.86 () {56 vars in 1148 bytes} [Tue Jun 7 14:21:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:40.112711 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4b22e4-d64a-4a4b-81c2-234ce264d538 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:40.146482 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773bd67c-65c5-4eac-9a49-8fbcc9cb2990 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:40.186294 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d311c196-e05f-45a5-aa8f-cfa54a624c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:40.187100 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d311c196-e05f-45a5-aa8f-cfa54a624c42 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:40.187394 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d311c196-e05f-45a5-aa8f-cfa54a624c42 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:40.187679 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d311c196-e05f-45a5-aa8f-cfa54a624c42 None admin] PATH_INFO: `/v3/services/network` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:40.188377 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d311c196-e05f-45a5-aa8f-cfa54a624c42 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:40.189771 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d311c196-e05f-45a5-aa8f-cfa54a624c42 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:40.203091 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-d311c196-e05f-45a5-aa8f-cfa54a624c42 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 07 14:21:40.203091 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:40.203091 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 07 14:21:40.203091 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 07 14:21:40.203091 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 07 14:21:40.203091 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 07 14:21:40.203091 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 07 14:21:40.203091 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 14:21:40.203091 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 07 14:21:40.203091 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:21:40.203091 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 07 14:21:40.203091 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:21:40.203091 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:40.203091 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:40.203091 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:40.203091 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:40.203091 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:40.204175 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:40.204175 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:40.204175 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:40.204175 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:40.204175 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:40.204175 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:40.204175 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 07 14:21:40.204175 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 07 14:21:40.204175 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 07 14:21:40.204175 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 07 14:21:40.204175 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:40.204175 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:40.204175 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:40.204175 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:40.204175 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:40.204175 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:40.210169 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:40.210169 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:40.210169 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:40.210169 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:40.210169 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:40.210169 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:40.210169 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:40.210169 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:40.210169 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:40.210169 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:40.210169 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 07 14:21:40.210169 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 14:21:40.210169 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 07 14:21:40.210169 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:21:40.210169 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 399/815] 10.222.0.86 () {56 vars in 1111 bytes} [Tue Jun 7 14:21:40 2022] GET /identity/v3/services/network => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:21:40.210974 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d311c196-e05f-45a5-aa8f-cfa54a624c42 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:40.225293 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4b22e4-d64a-4a4b-81c2-234ce264d538 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:40.228615 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:40.263166 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbedf05-4ef6-468e-968d-da50515427c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:40.263904 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbedf05-4ef6-468e-968d-da50515427c0 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:40.264182 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbedf05-4ef6-468e-968d-da50515427c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:40.264436 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbedf05-4ef6-468e-968d-da50515427c0 None admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:40.265214 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbedf05-4ef6-468e-968d-da50515427c0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:40.265598 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbedf05-4ef6-468e-968d-da50515427c0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:40.266934 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbedf05-4ef6-468e-968d-da50515427c0 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:40.284956 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 417/816] 10.222.0.86 () {56 vars in 1148 bytes} [Tue Jun 7 14:21:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:40.284956 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbedf05-4ef6-468e-968d-da50515427c0 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:40.323783 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d311c196-e05f-45a5-aa8f-cfa54a624c42 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:40.344759 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:40.362428 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e941ab0b-753f-431a-adf6-f758dabd67dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:40.363288 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e941ab0b-753f-431a-adf6-f758dabd67dd None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:40.363532 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e941ab0b-753f-431a-adf6-f758dabd67dd None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:40.363829 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e941ab0b-753f-431a-adf6-f758dabd67dd None admin] PATH_INFO: `/v3/roles/service` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:40.374417 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e941ab0b-753f-431a-adf6-f758dabd67dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:21:40.382289 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-e941ab0b-753f-431a-adf6-f758dabd67dd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 07 14:21:40.382289 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:40.382289 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:40.382289 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:40.382289 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:40.382289 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:40.382289 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:40.382289 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:40.382289 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:40.382289 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:40.382289 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:40.382289 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:40.382289 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:21:40.382289 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:21:40.382289 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:21:40.382289 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:21:40.383278 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:21:40.383278 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:21:40.383278 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:21:40.383278 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:21:40.383278 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:40.383278 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:40.383278 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:40.383278 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:40.383278 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:40.383278 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:40.383278 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:40.383278 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:40.383278 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:40.383278 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:40.383278 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:40.383278 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:40.384145 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:40.384145 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:40.384145 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:40.384145 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:40.384145 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:21:40.384145 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:21:40.384145 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:21:40.384145 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:21:40.384145 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:21:40.384145 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:21:40.384145 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 07 14:21:40.384145 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:21:40.384145 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 400/817] 10.222.0.86 () {56 vars in 1102 bytes} [Tue Jun 7 14:21:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:21:40.384887 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e941ab0b-753f-431a-adf6-f758dabd67dd None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:40.403407 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbedf05-4ef6-468e-968d-da50515427c0 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:40.450319 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384bb067-9c95-44b8-9771-4993fb8345d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:40.451015 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384bb067-9c95-44b8-9771-4993fb8345d8 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:40.451300 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384bb067-9c95-44b8-9771-4993fb8345d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:40.451582 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384bb067-9c95-44b8-9771-4993fb8345d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:40.452450 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384bb067-9c95-44b8-9771-4993fb8345d8 None admin] RBAC: Adding query filter params (role.id=e3bf6239f5bf477b965704b086786f11, scope.project.id=e429537b190c4c5ea7e1332ab044ca7a, user.id=b99cfb70f54c45c8870369359da20378) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:40.452762 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384bb067-9c95-44b8-9771-4993fb8345d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:40.454186 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384bb067-9c95-44b8-9771-4993fb8345d8 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:40.460202 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 418/818] 10.222.0.86 () {56 vars in 1374 bytes} [Tue Jun 7 14:21:40 2022] GET /identity/v3/role_assignments?user.id=b99cfb70f54c45c8870369359da20378&scope.project.id=e429537b190c4c5ea7e1332ab044ca7a&role.id=e3bf6239f5bf477b965704b086786f11 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:40.460965 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384bb067-9c95-44b8-9771-4993fb8345d8 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:40.474253 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:40.511277 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e941ab0b-753f-431a-adf6-f758dabd67dd None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:40.559280 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbb6c85-974d-4b2c-b3c9-a7118448eb8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:40.560824 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbb6c85-974d-4b2c-b3c9-a7118448eb8c None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:40.561579 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbb6c85-974d-4b2c-b3c9-a7118448eb8c None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:40.562073 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbb6c85-974d-4b2c-b3c9-a7118448eb8c None admin] PATH_INFO: `/v3/services` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:40.563174 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbb6c85-974d-4b2c-b3c9-a7118448eb8c None admin] RBAC: Adding query filter params (name=network) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:40.564007 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbb6c85-974d-4b2c-b3c9-a7118448eb8c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:40.565640 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbb6c85-974d-4b2c-b3c9-a7118448eb8c None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:40.573216 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 401/819] 10.222.0.86 () {56 vars in 1112 bytes} [Tue Jun 7 14:21:40 2022] GET /identity/v3/services?name=network => generated 124 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:40.575168 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbb6c85-974d-4b2c-b3c9-a7118448eb8c None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:40.580407 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384bb067-9c95-44b8-9771-4993fb8345d8 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:40.596522 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:40.625881 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40683bfa-3d05-4717-9f91-0a3ef553b3a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:40.626362 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40683bfa-3d05-4717-9f91-0a3ef553b3a3 None admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:40.626651 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40683bfa-3d05-4717-9f91-0a3ef553b3a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:40.626930 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40683bfa-3d05-4717-9f91-0a3ef553b3a3 None admin] PATH_INFO: `/v3/projects/e429537b190c4c5ea7e1332ab044ca7a/users/c9774349dd2b4ec092ef04c3df050a7e/roles/e3bf6239f5bf477b965704b086786f11` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:40.629098 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40683bfa-3d05-4717-9f91-0a3ef553b3a3 None admin] RBAC: Authorizing `identity:create_grant(project_id=e429537b190c4c5ea7e1332ab044ca7a, user_id=c9774349dd2b4ec092ef04c3df050a7e, role_id=e3bf6239f5bf477b965704b086786f11)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:40.630575 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40683bfa-3d05-4717-9f91-0a3ef553b3a3 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:40.701209 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbb6c85-974d-4b2c-b3c9-a7118448eb8c None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:40.709693 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 419/820] 10.222.0.86 () {58 vars in 1439 bytes} [Tue Jun 7 14:21:40 2022] PUT /identity/v3/projects/e429537b190c4c5ea7e1332ab044ca7a/users/c9774349dd2b4ec092ef04c3df050a7e/roles/e3bf6239f5bf477b965704b086786f11 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:21:40.710726 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40683bfa-3d05-4717-9f91-0a3ef553b3a3 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:40.743495 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd68464-e1bc-41a9-9acc-008fb50a1da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:40.744293 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd68464-e1bc-41a9-9acc-008fb50a1da1 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:40.744630 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd68464-e1bc-41a9-9acc-008fb50a1da1 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:40.744963 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd68464-e1bc-41a9-9acc-008fb50a1da1 None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:40.745746 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd68464-e1bc-41a9-9acc-008fb50a1da1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:40.746620 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd68464-e1bc-41a9-9acc-008fb50a1da1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:40.748375 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd68464-e1bc-41a9-9acc-008fb50a1da1 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:40.755501 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:40.760100 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 402/821] 10.222.0.86 () {56 vars in 1103 bytes} [Tue Jun 7 14:21:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:40.772386 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd68464-e1bc-41a9-9acc-008fb50a1da1 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:40.904243 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40683bfa-3d05-4717-9f91-0a3ef553b3a3 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:40.931472 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd68464-e1bc-41a9-9acc-008fb50a1da1 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:40.962976 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf1d92e-9150-49d2-9203-00edce8ad425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:40.963652 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf1d92e-9150-49d2-9203-00edce8ad425 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:40.963971 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf1d92e-9150-49d2-9203-00edce8ad425 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:40.964245 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf1d92e-9150-49d2-9203-00edce8ad425 None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:40.965606 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf1d92e-9150-49d2-9203-00edce8ad425 None admin] RBAC: Adding query filter params (type=network) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:40.965915 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf1d92e-9150-49d2-9203-00edce8ad425 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:40.967339 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf1d92e-9150-49d2-9203-00edce8ad425 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:40.978852 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 420/822] 10.222.0.86 () {56 vars in 1112 bytes} [Tue Jun 7 14:21:40 2022] GET /identity/v3/services?type=network => generated 350 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:40.978852 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf1d92e-9150-49d2-9203-00edce8ad425 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:40.991463 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9557b635-586a-4e63-a5b5-6021ea5a79bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:40.992609 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9557b635-586a-4e63-a5b5-6021ea5a79bf None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:40.993081 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9557b635-586a-4e63-a5b5-6021ea5a79bf None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:40.993542 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9557b635-586a-4e63-a5b5-6021ea5a79bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:41.005365 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9557b635-586a-4e63-a5b5-6021ea5a79bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:41.007094 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9557b635-586a-4e63-a5b5-6021ea5a79bf None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:41.022649 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:41.028521 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-9557b635-586a-4e63-a5b5-6021ea5a79bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:21:41.028521 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:41.028521 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:41.028521 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:41.028521 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:41.028521 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:41.028521 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:41.028521 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:41.028521 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:41.028521 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:41.028521 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:41.028521 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:41.028521 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:21:41.028521 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:21:41.028521 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:21:41.037356 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:21:41.037356 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:41.037356 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:41.037356 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:41.037356 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:41.037356 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:41.037356 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:41.037356 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:41.037356 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:41.037356 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:41.037356 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:41.037356 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:41.037356 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:41.037356 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:41.037356 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:41.037356 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:41.037356 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:41.038267 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:21:41.038267 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:21:41.038267 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:21:41.038267 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:21:41.038267 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 403/823] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jun 7 14:21:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:21:41.038267 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9557b635-586a-4e63-a5b5-6021ea5a79bf None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:41.091432 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf1d92e-9150-49d2-9203-00edce8ad425 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:41.111512 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:41.133145 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db37551-b6a6-472e-8cc5-bace0456ecfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:41.133994 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db37551-b6a6-472e-8cc5-bace0456ecfb None admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:41.134273 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db37551-b6a6-472e-8cc5-bace0456ecfb None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:41.134606 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db37551-b6a6-472e-8cc5-bace0456ecfb None admin] PATH_INFO: `/v3/endpoints` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:41.135963 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db37551-b6a6-472e-8cc5-bace0456ecfb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:41.137719 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db37551-b6a6-472e-8cc5-bace0456ecfb None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:41.178569 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9557b635-586a-4e63-a5b5-6021ea5a79bf None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:41.228460 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 421/824] 10.222.0.86 () {60 vars in 1144 bytes} [Tue Jun 7 14:21:40 2022] POST /identity/v3/endpoints => generated 327 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 14:21:41.251216 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b04339-c3ab-4373-8408-de100faeb741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:41.251926 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b04339-c3ab-4373-8408-de100faeb741 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:41.252215 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b04339-c3ab-4373-8408-de100faeb741 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:41.252584 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b04339-c3ab-4373-8408-de100faeb741 None admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:41.255438 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b04339-c3ab-4373-8408-de100faeb741 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:41.255438 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b04339-c3ab-4373-8408-de100faeb741 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:41.255438 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b04339-c3ab-4373-8408-de100faeb741 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:41.273800 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 404/825] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jun 7 14:21:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:41.279680 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db37551-b6a6-472e-8cc5-bace0456ecfb None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:41.397784 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:41.406067 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db37551-b6a6-472e-8cc5-bace0456ecfb None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:41.445357 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d81f17-11ec-4936-b8cb-e317803cbb44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:41.446119 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d81f17-11ec-4936-b8cb-e317803cbb44 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:41.446400 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d81f17-11ec-4936-b8cb-e317803cbb44 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:41.446675 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d81f17-11ec-4936-b8cb-e317803cbb44 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:41.455663 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d81f17-11ec-4936-b8cb-e317803cbb44 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:41.457214 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d81f17-11ec-4936-b8cb-e317803cbb44 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:41.473912 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-a8d81f17-11ec-4936-b8cb-e317803cbb44 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 07 14:21:41.473912 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:41.473912 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:41.473912 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:41.473912 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:41.473912 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:41.473912 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:41.473912 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:41.473912 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:41.473912 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:41.473912 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:41.473912 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:41.473912 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 14:21:41.473912 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 14:21:41.473912 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 14:21:41.473912 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 14:21:41.474959 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:41.474959 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:41.474959 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 14:21:41.474959 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:21:41.474959 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 14:21:41.474959 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:21:41.474959 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:41.474959 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:41.474959 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:41.474959 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:41.474959 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:41.474959 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:41.474959 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:41.474959 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:41.474959 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:41.474959 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:41.474959 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:41.474959 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:41.476630 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:41.476630 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:41.476630 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 14:21:41.476630 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 14:21:41.476630 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 14:21:41.476630 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 14:21:41.476630 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 14:21:41.476630 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 14:21:41.476630 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 07 14:21:41.476630 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:21:41.476630 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 422/826] 10.222.0.86 () {56 vars in 1117 bytes} [Tue Jun 7 14:21:41 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:21:41.482729 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b04339-c3ab-4373-8408-de100faeb741 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:41.598122 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b04339-c3ab-4373-8408-de100faeb741 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:41.608029 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:41.632294 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce9295b-6bc5-421f-83b4-69ffb7c85173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:41.633019 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce9295b-6bc5-421f-83b4-69ffb7c85173 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:41.633303 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce9295b-6bc5-421f-83b4-69ffb7c85173 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:41.633634 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce9295b-6bc5-421f-83b4-69ffb7c85173 None admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:41.634518 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce9295b-6bc5-421f-83b4-69ffb7c85173 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:41.634838 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce9295b-6bc5-421f-83b4-69ffb7c85173 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:41.636300 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce9295b-6bc5-421f-83b4-69ffb7c85173 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:41.658248 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 405/827] 10.222.0.86 () {56 vars in 1149 bytes} [Tue Jun 7 14:21:41 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:41.664102 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d81f17-11ec-4936-b8cb-e317803cbb44 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:41.774545 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d81f17-11ec-4936-b8cb-e317803cbb44 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:41.810127 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fc7625-bb8a-4bed-84e8-174500702fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:41.810933 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fc7625-bb8a-4bed-84e8-174500702fc9 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:41.811212 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fc7625-bb8a-4bed-84e8-174500702fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:41.811483 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fc7625-bb8a-4bed-84e8-174500702fc9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:41.822155 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fc7625-bb8a-4bed-84e8-174500702fc9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:41.823610 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fc7625-bb8a-4bed-84e8-174500702fc9 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:41.843869 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-a4fc7625-bb8a-4bed-84e8-174500702fc9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:21:41.843869 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:41.843869 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:41.843869 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:41.843869 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:41.843869 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:41.843869 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:41.843869 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:41.843869 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:41.843869 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:41.843869 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:41.843869 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:41.843869 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:21:41.843869 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:21:41.843869 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:21:41.846120 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:21:41.846120 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:41.846120 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:41.846120 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:41.846120 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:41.846120 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:41.846120 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:41.846120 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:41.846120 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:41.846120 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:41.846120 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:41.846120 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:41.846120 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:41.846120 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:41.846120 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:41.846120 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:41.846120 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:41.848253 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:21:41.848253 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:21:41.848253 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:21:41.848253 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:21:41.848253 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 423/828] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jun 7 14:21:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:21:41.850885 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce9295b-6bc5-421f-83b4-69ffb7c85173 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:41.969018 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce9295b-6bc5-421f-83b4-69ffb7c85173 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:42.006713 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de15b6e-d256-4c87-8d43-77b4abefdd4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:42.007407 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de15b6e-d256-4c87-8d43-77b4abefdd4c None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:42.007693 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de15b6e-d256-4c87-8d43-77b4abefdd4c None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:42.008001 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de15b6e-d256-4c87-8d43-77b4abefdd4c None admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:42.008731 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de15b6e-d256-4c87-8d43-77b4abefdd4c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:42.009041 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de15b6e-d256-4c87-8d43-77b4abefdd4c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:42.010485 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de15b6e-d256-4c87-8d43-77b4abefdd4c None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:42.023497 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 406/829] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jun 7 14:21:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:21:42.029063 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fc7625-bb8a-4bed-84e8-174500702fc9 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:42.044371 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:42.135346 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fc7625-bb8a-4bed-84e8-174500702fc9 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:42.176572 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbde8a9-702d-40d2-b31a-86f12a57c088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:42.177753 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbde8a9-702d-40d2-b31a-86f12a57c088 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:42.178243 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbde8a9-702d-40d2-b31a-86f12a57c088 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:42.178740 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbde8a9-702d-40d2-b31a-86f12a57c088 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:42.186463 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbde8a9-702d-40d2-b31a-86f12a57c088 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:42.188138 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbde8a9-702d-40d2-b31a-86f12a57c088 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:42.202592 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-dfbde8a9-702d-40d2-b31a-86f12a57c088 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:21:42.202592 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:42.202592 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:42.202592 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:42.202592 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:42.202592 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:42.202592 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:42.202592 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:42.202592 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:42.202592 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:42.202592 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:42.202592 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:42.202592 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 14:21:42.202592 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 14:21:42.202592 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 14:21:42.203485 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 14:21:42.203485 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:42.203485 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:42.203485 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:42.203485 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:42.203485 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:42.203485 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:42.203485 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:42.203485 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:42.203485 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:42.203485 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:42.203485 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:42.203485 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:42.203485 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:42.203485 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:42.203485 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:42.203485 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:42.204471 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 14:21:42.204471 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 14:21:42.204471 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 14:21:42.204471 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 14:21:42.204471 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 14:21:42.204471 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 14:21:42.204471 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:21:42.204471 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:21:42.206928 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 424/830] 10.222.0.86 () {56 vars in 1111 bytes} [Tue Jun 7 14:21:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:21:42.213230 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de15b6e-d256-4c87-8d43-77b4abefdd4c None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:42.249836 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:42.331094 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de15b6e-d256-4c87-8d43-77b4abefdd4c None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:42.366798 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043282e7-7253-4f66-88b9-d7adcefcc779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:42.367460 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043282e7-7253-4f66-88b9-d7adcefcc779 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:42.367748 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043282e7-7253-4f66-88b9-d7adcefcc779 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:42.368053 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043282e7-7253-4f66-88b9-d7adcefcc779 None admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:42.368852 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043282e7-7253-4f66-88b9-d7adcefcc779 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:42.369166 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043282e7-7253-4f66-88b9-d7adcefcc779 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:42.370616 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043282e7-7253-4f66-88b9-d7adcefcc779 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:42.384775 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 407/831] 10.222.0.86 () {56 vars in 1148 bytes} [Tue Jun 7 14:21:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:42.394425 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbde8a9-702d-40d2-b31a-86f12a57c088 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:42.455580 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8d8283-8e58-479d-bd3e-8b41c03ff06a None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:42.455934 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8d8283-8e58-479d-bd3e-8b41c03ff06a None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:42.456222 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8d8283-8e58-479d-bd3e-8b41c03ff06a None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:42.457876 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 408/832] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:21:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 07 14:21:42.462740 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d952c7-00cd-4a9a-9511-d46d01f75fa6 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:42.463034 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d952c7-00cd-4a9a-9511-d46d01f75fa6 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:42.463319 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d952c7-00cd-4a9a-9511-d46d01f75fa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:42.469966 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:42.481061 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-96d952c7-00cd-4a9a-9511-d46d01f75fa6 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:21:42.482296 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-96d952c7-00cd-4a9a-9511-d46d01f75fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:21:42.512471 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbde8a9-702d-40d2-b31a-86f12a57c088 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:42.560104 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9990a1-b16a-4d73-b58d-8a8aaf1d04bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:42.561381 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9990a1-b16a-4d73-b58d-8a8aaf1d04bc None admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:42.561873 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9990a1-b16a-4d73-b58d-8a8aaf1d04bc None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:42.562354 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9990a1-b16a-4d73-b58d-8a8aaf1d04bc None admin] PATH_INFO: `/v3/projects/e429537b190c4c5ea7e1332ab044ca7a/users/d7b598c6a3f642ef9edc971ad3ebbe31/roles/28e9b75018ac44c0afe7ab728071f2d5` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:42.564024 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 409/833] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:21:42 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 07 14:21:42.578539 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9990a1-b16a-4d73-b58d-8a8aaf1d04bc None admin] RBAC: Authorizing `identity:create_grant(project_id=e429537b190c4c5ea7e1332ab044ca7a, user_id=d7b598c6a3f642ef9edc971ad3ebbe31, role_id=28e9b75018ac44c0afe7ab728071f2d5)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:42.579978 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d952c7-00cd-4a9a-9511-d46d01f75fa6 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:42.580095 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9990a1-b16a-4d73-b58d-8a8aaf1d04bc None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:42.610411 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:42.676600 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 425/834] 10.222.0.86 () {58 vars in 1439 bytes} [Tue Jun 7 14:21:42 2022] PUT /identity/v3/projects/e429537b190c4c5ea7e1332ab044ca7a/users/d7b598c6a3f642ef9edc971ad3ebbe31/roles/28e9b75018ac44c0afe7ab728071f2d5 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:21:42.690367 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d952c7-00cd-4a9a-9511-d46d01f75fa6 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:42.743013 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ea1f5f-aa29-44e5-b2e9-cbd576cbf61b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:42.744325 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ea1f5f-aa29-44e5-b2e9-cbd576cbf61b None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:42.744848 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ea1f5f-aa29-44e5-b2e9-cbd576cbf61b None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:42.745345 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ea1f5f-aa29-44e5-b2e9-cbd576cbf61b None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:42.746852 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ea1f5f-aa29-44e5-b2e9-cbd576cbf61b None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:42.748745 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ea1f5f-aa29-44e5-b2e9-cbd576cbf61b None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:42.763438 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-e9ea1f5f-aa29-44e5-b2e9-cbd576cbf61b None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 07 14:21:42.763438 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:42.763438 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 07 14:21:42.763438 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 07 14:21:42.763438 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 07 14:21:42.763438 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 07 14:21:42.763438 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 07 14:21:42.763438 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 14:21:42.763438 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 07 14:21:42.763438 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:21:42.763438 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 07 14:21:42.763438 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:21:42.763438 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:42.763438 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:42.763438 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:42.763438 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:42.763438 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:42.764582 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:42.764582 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:42.764582 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:42.764582 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:42.764582 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:42.764582 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:42.764582 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 07 14:21:42.764582 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 07 14:21:42.764582 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 07 14:21:42.764582 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 07 14:21:42.764582 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:42.764582 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:42.764582 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:42.764582 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:42.764582 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:42.764582 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:42.765439 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:42.765439 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:42.765439 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:42.765439 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:42.765439 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:42.765439 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:42.765439 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:42.765439 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:42.765439 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:42.765439 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:42.765439 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 07 14:21:42.765439 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 14:21:42.765439 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 07 14:21:42.765439 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:21:42.768748 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 410/835] 10.222.0.86 () {56 vars in 1114 bytes} [Tue Jun 7 14:21:42 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:21:42.774603 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9990a1-b16a-4d73-b58d-8a8aaf1d04bc None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:42.891386 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9990a1-b16a-4d73-b58d-8a8aaf1d04bc None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:42.910456 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:42.929285 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f814f2-e026-4099-b4ad-ce8887e930de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:42.929961 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f814f2-e026-4099-b4ad-ce8887e930de None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:42.930249 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f814f2-e026-4099-b4ad-ce8887e930de None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:42.930530 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f814f2-e026-4099-b4ad-ce8887e930de None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:42.931247 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f814f2-e026-4099-b4ad-ce8887e930de None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:42.931558 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f814f2-e026-4099-b4ad-ce8887e930de None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:42.932962 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f814f2-e026-4099-b4ad-ce8887e930de None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:42.938947 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 426/836] 10.222.0.86 () {56 vars in 1114 bytes} [Tue Jun 7 14:21:42 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:21:42.944139 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ea1f5f-aa29-44e5-b2e9-cbd576cbf61b None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:43.031533 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:43.055784 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ea1f5f-aa29-44e5-b2e9-cbd576cbf61b None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:43.081662 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037ad844-2974-47ae-ac1b-ce5e2b07cb69 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:43.082184 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037ad844-2974-47ae-ac1b-ce5e2b07cb69 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:43.082258 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037ad844-2974-47ae-ac1b-ce5e2b07cb69 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:43.084391 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 427/837] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:21:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:21:43.092723 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339cadd0-69da-49a2-8df0-9c6977f97389 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:43.093179 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339cadd0-69da-49a2-8df0-9c6977f97389 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:43.093572 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339cadd0-69da-49a2-8df0-9c6977f97389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:43.099151 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22426b8b-e05c-4759-a541-fd190acf0f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:43.100162 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22426b8b-e05c-4759-a541-fd190acf0f0c None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:43.100445 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22426b8b-e05c-4759-a541-fd190acf0f0c None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:43.100724 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22426b8b-e05c-4759-a541-fd190acf0f0c None admin] PATH_INFO: `/v3/services` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:43.101464 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22426b8b-e05c-4759-a541-fd190acf0f0c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:43.101773 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22426b8b-e05c-4759-a541-fd190acf0f0c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:43.103200 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22426b8b-e05c-4759-a541-fd190acf0f0c None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:43.110141 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 411/838] 10.222.0.86 () {56 vars in 1114 bytes} [Tue Jun 7 14:21:42 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:43.119798 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-339cadd0-69da-49a2-8df0-9c6977f97389 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:21:43.119798 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-339cadd0-69da-49a2-8df0-9c6977f97389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:21:43.192043 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 428/839] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:21:43 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 14:21:43.215911 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22426b8b-e05c-4759-a541-fd190acf0f0c None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:43.328265 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22426b8b-e05c-4759-a541-fd190acf0f0c None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:43.368483 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78acd27a-001e-476f-b054-5b3a0b2382b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:43.369689 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78acd27a-001e-476f-b054-5b3a0b2382b2 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:43.370222 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78acd27a-001e-476f-b054-5b3a0b2382b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:43.370844 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78acd27a-001e-476f-b054-5b3a0b2382b2 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:43.372240 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78acd27a-001e-476f-b054-5b3a0b2382b2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:43.373826 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78acd27a-001e-476f-b054-5b3a0b2382b2 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:43.386750 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-78acd27a-001e-476f-b054-5b3a0b2382b2 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 07 14:21:43.386750 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:43.386750 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 07 14:21:43.386750 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 07 14:21:43.386750 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 07 14:21:43.386750 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 07 14:21:43.386750 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 07 14:21:43.386750 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 14:21:43.386750 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 07 14:21:43.386750 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:21:43.386750 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 07 14:21:43.386750 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:21:43.386750 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:43.386750 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:43.386750 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:43.386750 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:43.388020 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:43.388020 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:43.388020 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:43.388020 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:43.388020 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:43.388020 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:43.388020 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:43.388020 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 07 14:21:43.388020 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 07 14:21:43.388020 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 07 14:21:43.388020 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 07 14:21:43.388020 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:43.388020 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:43.388020 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:43.388020 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:43.388020 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:43.388929 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:43.388929 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:43.388929 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:43.388929 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:43.388929 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:43.388929 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:43.388929 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:43.388929 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:43.388929 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:43.388929 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:43.388929 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:43.388929 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 07 14:21:43.388929 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 14:21:43.388929 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 07 14:21:43.388929 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:21:43.391649 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 412/840] 10.222.0.86 () {56 vars in 1132 bytes} [Tue Jun 7 14:21:43 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:21:43.399809 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339cadd0-69da-49a2-8df0-9c6977f97389 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:43.447256 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0c5ab8-e015-41c2-84d2-35a2af6123dd None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:43.447504 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0c5ab8-e015-41c2-84d2-35a2af6123dd None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:43.447738 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0c5ab8-e015-41c2-84d2-35a2af6123dd None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:43.449916 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 413/841] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:21:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:21:43.454955 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3492c0c1-7729-49cb-9524-aaf6d23fca6b None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:43.455246 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3492c0c1-7729-49cb-9524-aaf6d23fca6b None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:43.455530 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3492c0c1-7729-49cb-9524-aaf6d23fca6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:43.472978 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-3492c0c1-7729-49cb-9524-aaf6d23fca6b None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:21:43.474152 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-3492c0c1-7729-49cb-9524-aaf6d23fca6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:21:43.476317 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:43.513943 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339cadd0-69da-49a2-8df0-9c6977f97389 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:43.528385 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:43.551832 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 414/842] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:21:43 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 14:21:43.554930 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba18fce9-4da4-4802-a361-6c16241dcf3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:43.555902 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba18fce9-4da4-4802-a361-6c16241dcf3c None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:43.556373 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba18fce9-4da4-4802-a361-6c16241dcf3c None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:43.556832 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba18fce9-4da4-4802-a361-6c16241dcf3c None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:43.557741 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba18fce9-4da4-4802-a361-6c16241dcf3c None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:43.558752 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba18fce9-4da4-4802-a361-6c16241dcf3c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:43.560616 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba18fce9-4da4-4802-a361-6c16241dcf3c None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:43.570118 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 429/843] 10.222.0.86 () {56 vars in 1126 bytes} [Tue Jun 7 14:21:43 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:43.572095 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba18fce9-4da4-4802-a361-6c16241dcf3c None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:43.572206 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3492c0c1-7729-49cb-9524-aaf6d23fca6b None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:43.679115 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3492c0c1-7729-49cb-9524-aaf6d23fca6b None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:43.685098 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba18fce9-4da4-4802-a361-6c16241dcf3c None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:43.716824 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6611ac88-a4ee-4889-9d36-6a4e553b20a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:43.717677 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6611ac88-a4ee-4889-9d36-6a4e553b20a4 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:43.717975 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6611ac88-a4ee-4889-9d36-6a4e553b20a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:43.718253 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6611ac88-a4ee-4889-9d36-6a4e553b20a4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:43.724611 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c020fb20-11fe-4499-80a9-ad3efdd4d53c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:43.725648 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:43.726064 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c020fb20-11fe-4499-80a9-ad3efdd4d53c None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:43.726862 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c020fb20-11fe-4499-80a9-ad3efdd4d53c None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:43.727463 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c020fb20-11fe-4499-80a9-ad3efdd4d53c None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:43.728426 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c020fb20-11fe-4499-80a9-ad3efdd4d53c None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:43.728941 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c020fb20-11fe-4499-80a9-ad3efdd4d53c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:43.729622 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6611ac88-a4ee-4889-9d36-6a4e553b20a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:21:43.730762 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c020fb20-11fe-4499-80a9-ad3efdd4d53c None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:43.736903 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 430/844] 10.222.0.86 () {56 vars in 1126 bytes} [Tue Jun 7 14:21:43 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:43.740223 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-6611ac88-a4ee-4889-9d36-6a4e553b20a4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 14:21:43.740223 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:43.740223 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:43.740223 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:43.740223 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:43.740223 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:43.740223 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:43.740223 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:43.740223 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:43.740223 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:43.740223 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:43.740223 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:43.740223 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:21:43.740223 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:21:43.740223 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:21:43.740223 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:21:43.741173 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:21:43.741173 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:21:43.741173 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:21:43.741173 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:21:43.741173 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:43.741173 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:43.741173 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:43.741173 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:43.741173 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:43.741173 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:43.741173 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:43.741173 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:43.741173 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:43.741173 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:43.741173 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:43.741173 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:43.742044 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:43.742044 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:43.742044 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:43.742044 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:43.742044 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:21:43.742044 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:21:43.742044 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:21:43.742044 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:21:43.742044 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:21:43.742044 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:21:43.742044 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 14:21:43.742044 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:21:43.743797 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 415/845] 10.222.0.86 () {56 vars in 1096 bytes} [Tue Jun 7 14:21:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:21:43.749088 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c020fb20-11fe-4499-80a9-ad3efdd4d53c None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:43.793513 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:43.861162 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c020fb20-11fe-4499-80a9-ad3efdd4d53c None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:43.905691 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a941735d-7b8c-4031-ae32-4b4bb01ebd11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:43.906450 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a941735d-7b8c-4031-ae32-4b4bb01ebd11 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:43.906745 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a941735d-7b8c-4031-ae32-4b4bb01ebd11 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:43.907028 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a941735d-7b8c-4031-ae32-4b4bb01ebd11 None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:43.908014 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a941735d-7b8c-4031-ae32-4b4bb01ebd11 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:43.908329 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a941735d-7b8c-4031-ae32-4b4bb01ebd11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:43.909716 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a941735d-7b8c-4031-ae32-4b4bb01ebd11 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:43.920193 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 431/846] 10.222.0.86 () {56 vars in 1099 bytes} [Tue Jun 7 14:21:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:21:43.925928 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6611ac88-a4ee-4889-9d36-6a4e553b20a4 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:44.032336 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6611ac88-a4ee-4889-9d36-6a4e553b20a4 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:44.066129 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b820215-b3ef-4e6a-95cb-5ef607a7b9da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:44.066924 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b820215-b3ef-4e6a-95cb-5ef607a7b9da None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:44.067208 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b820215-b3ef-4e6a-95cb-5ef607a7b9da None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:44.067481 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b820215-b3ef-4e6a-95cb-5ef607a7b9da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:44.078733 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b820215-b3ef-4e6a-95cb-5ef607a7b9da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:44.080227 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b820215-b3ef-4e6a-95cb-5ef607a7b9da None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:44.097593 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-7b820215-b3ef-4e6a-95cb-5ef607a7b9da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:21:44.097593 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:44.097593 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:44.097593 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:44.097593 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:44.097593 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:44.097593 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:44.097593 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:44.097593 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:44.097593 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:44.097593 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:44.097593 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:44.097593 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:21:44.097593 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:21:44.097593 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:21:44.098508 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:21:44.098508 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:44.098508 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:44.098508 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:44.098508 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:44.098508 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:44.098508 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:44.098508 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:44.098508 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:44.098508 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:44.098508 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:44.098508 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:44.098508 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:44.098508 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:44.098508 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:44.098508 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:44.098508 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:44.100149 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:21:44.100149 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:21:44.100149 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:21:44.100149 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:21:44.100149 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 416/847] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jun 7 14:21:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:21:44.104556 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a941735d-7b8c-4031-ae32-4b4bb01ebd11 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:44.205152 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:44.207950 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a941735d-7b8c-4031-ae32-4b4bb01ebd11 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:44.243942 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9b90ea-78c0-47ce-801c-e877084d91b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:44.244653 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9b90ea-78c0-47ce-801c-e877084d91b5 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:44.244939 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9b90ea-78c0-47ce-801c-e877084d91b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:44.245218 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9b90ea-78c0-47ce-801c-e877084d91b5 None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:44.246466 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9b90ea-78c0-47ce-801c-e877084d91b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:44.246781 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9b90ea-78c0-47ce-801c-e877084d91b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:44.248179 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9b90ea-78c0-47ce-801c-e877084d91b5 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:44.259998 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 432/848] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jun 7 14:21:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:44.266897 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b820215-b3ef-4e6a-95cb-5ef607a7b9da None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:44.321558 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:44.374636 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b820215-b3ef-4e6a-95cb-5ef607a7b9da None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:44.409515 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d42b2e1-8347-4a0f-8d9b-21988b91e906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:44.410313 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d42b2e1-8347-4a0f-8d9b-21988b91e906 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:44.410594 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d42b2e1-8347-4a0f-8d9b-21988b91e906 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:44.410869 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d42b2e1-8347-4a0f-8d9b-21988b91e906 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:44.419027 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d42b2e1-8347-4a0f-8d9b-21988b91e906 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:44.420528 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d42b2e1-8347-4a0f-8d9b-21988b91e906 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:44.435141 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-4d42b2e1-8347-4a0f-8d9b-21988b91e906 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 07 14:21:44.435141 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:44.435141 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:44.435141 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:44.435141 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:44.435141 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:44.435141 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:44.435141 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:44.435141 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:44.435141 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:44.435141 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:44.435141 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:44.435141 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 14:21:44.435141 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 14:21:44.435141 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 14:21:44.435141 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 14:21:44.436133 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:44.436133 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:44.436133 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 14:21:44.436133 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:21:44.436133 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 14:21:44.436133 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:21:44.436133 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:44.436133 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:44.436133 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:44.436133 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:44.436133 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:44.436133 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:44.436133 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:44.436133 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:44.436133 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:44.436133 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:44.436133 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:44.436133 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:44.437714 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:44.437714 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:44.437714 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 14:21:44.437714 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 14:21:44.437714 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 14:21:44.437714 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 14:21:44.437714 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 14:21:44.437714 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 14:21:44.437714 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 07 14:21:44.437714 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:21:44.437714 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 417/849] 10.222.0.86 () {56 vars in 1096 bytes} [Tue Jun 7 14:21:44 2022] GET /identity/v3/users/swift => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:21:44.444868 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9b90ea-78c0-47ce-801c-e877084d91b5 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:44.549182 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9b90ea-78c0-47ce-801c-e877084d91b5 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:44.589743 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c05e1b-0903-4399-b746-9eb9c86f1e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:44.590339 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c05e1b-0903-4399-b746-9eb9c86f1e64 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:44.590628 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c05e1b-0903-4399-b746-9eb9c86f1e64 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:44.590908 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c05e1b-0903-4399-b746-9eb9c86f1e64 None admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:44.591766 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c05e1b-0903-4399-b746-9eb9c86f1e64 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:44.592092 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c05e1b-0903-4399-b746-9eb9c86f1e64 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:44.593519 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c05e1b-0903-4399-b746-9eb9c86f1e64 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:44.612571 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 433/850] 10.222.0.86 () {56 vars in 1135 bytes} [Tue Jun 7 14:21:44 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:44.618227 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d42b2e1-8347-4a0f-8d9b-21988b91e906 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:44.724149 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d42b2e1-8347-4a0f-8d9b-21988b91e906 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:44.737252 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:44.761351 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bcfc64-69d6-4d7e-8d57-026de18d366d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:44.762003 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bcfc64-69d6-4d7e-8d57-026de18d366d None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:44.762286 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bcfc64-69d6-4d7e-8d57-026de18d366d None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:44.762564 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bcfc64-69d6-4d7e-8d57-026de18d366d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:44.830393 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bcfc64-69d6-4d7e-8d57-026de18d366d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:44.831873 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bcfc64-69d6-4d7e-8d57-026de18d366d None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:44.931957 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 418/851] 10.222.0.86 () {58 vars in 1282 bytes} [Tue Jun 7 14:21:44 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 07 14:21:44.937923 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c05e1b-0903-4399-b746-9eb9c86f1e64 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:44.962435 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:45.046421 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c05e1b-0903-4399-b746-9eb9c86f1e64 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:45.049032 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c6202b-4014-490c-95f8-def0f6472b72 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:45.049470 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c6202b-4014-490c-95f8-def0f6472b72 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:45.049560 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c6202b-4014-490c-95f8-def0f6472b72 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:45.051200 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 419/852] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:21:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:21:45.056304 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dbd2d4-f201-4886-bc62-013b225d0a92 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:45.056594 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dbd2d4-f201-4886-bc62-013b225d0a92 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:45.056875 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dbd2d4-f201-4886-bc62-013b225d0a92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:45.075539 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-79dbd2d4-f201-4886-bc62-013b225d0a92 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:21:45.077394 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-79dbd2d4-f201-4886-bc62-013b225d0a92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:21:45.081192 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:45.087963 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b14f9e1-3e83-43db-b555-38002324315b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:45.088957 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b14f9e1-3e83-43db-b555-38002324315b None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:45.089899 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b14f9e1-3e83-43db-b555-38002324315b None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:45.090317 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b14f9e1-3e83-43db-b555-38002324315b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:45.103951 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b14f9e1-3e83-43db-b555-38002324315b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:45.106258 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b14f9e1-3e83-43db-b555-38002324315b None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:45.126230 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-5b14f9e1-3e83-43db-b555-38002324315b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:21:45.126230 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:45.126230 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:45.126230 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:45.126230 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:45.126230 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:45.126230 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:45.126230 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:45.126230 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:45.126230 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:45.126230 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:45.126230 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:45.126230 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:21:45.126230 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:21:45.126230 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:21:45.127378 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:21:45.127378 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:45.127378 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:45.127378 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:45.127378 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:45.127378 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:45.127378 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:45.127378 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:45.127378 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:45.127378 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:45.127378 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:45.127378 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:45.127378 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:45.127378 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:45.127378 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:45.127378 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:45.127378 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:45.128386 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:21:45.128386 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:21:45.128386 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:21:45.128386 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:21:45.130692 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 434/853] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jun 7 14:21:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:21:45.138137 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b14f9e1-3e83-43db-b555-38002324315b None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:45.166959 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 420/854] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:21:45 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 07 14:21:45.187290 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dbd2d4-f201-4886-bc62-013b225d0a92 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:45.224828 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:45.262890 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b14f9e1-3e83-43db-b555-38002324315b None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:45.299871 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8fe284-19cd-4f8a-9d97-28f63643676d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:45.300899 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8fe284-19cd-4f8a-9d97-28f63643676d None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:45.301406 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8fe284-19cd-4f8a-9d97-28f63643676d None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:45.301884 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8fe284-19cd-4f8a-9d97-28f63643676d None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:45.302919 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8fe284-19cd-4f8a-9d97-28f63643676d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:45.303501 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8fe284-19cd-4f8a-9d97-28f63643676d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:45.305180 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8fe284-19cd-4f8a-9d97-28f63643676d None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:45.313527 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dbd2d4-f201-4886-bc62-013b225d0a92 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:45.323681 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 435/855] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jun 7 14:21:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:45.325452 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8fe284-19cd-4f8a-9d97-28f63643676d None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:45.357590 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d925a434-2c74-4c8d-bbc2-c35777f6b864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:45.358385 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d925a434-2c74-4c8d-bbc2-c35777f6b864 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:45.358670 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d925a434-2c74-4c8d-bbc2-c35777f6b864 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:45.358941 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d925a434-2c74-4c8d-bbc2-c35777f6b864 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:45.368819 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:45.374167 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d925a434-2c74-4c8d-bbc2-c35777f6b864 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:21:45.384401 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-d925a434-2c74-4c8d-bbc2-c35777f6b864 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 07 14:21:45.384401 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:45.384401 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:45.384401 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:45.384401 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:45.384401 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:45.384401 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:45.384401 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:45.384401 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:45.384401 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:45.384401 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:45.384401 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:45.384401 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:21:45.384401 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:21:45.384401 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:21:45.384401 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:21:45.385539 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:21:45.385539 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:21:45.385539 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:21:45.385539 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:21:45.385539 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:45.385539 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:45.385539 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:45.385539 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:45.385539 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:45.385539 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:45.385539 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:45.385539 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:45.385539 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:45.385539 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:45.385539 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:45.385539 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:45.386411 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:45.386411 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:45.386411 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:45.386411 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:45.386411 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:21:45.386411 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:21:45.386411 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:21:45.386411 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:21:45.386411 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:21:45.386411 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:21:45.386411 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 07 14:21:45.386411 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:21:45.390595 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 421/856] 10.222.0.86 () {56 vars in 1102 bytes} [Tue Jun 7 14:21:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:21:45.391574 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d925a434-2c74-4c8d-bbc2-c35777f6b864 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:45.454286 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8fe284-19cd-4f8a-9d97-28f63643676d None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:45.490562 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:45.496892 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830cd0bd-0166-4950-82ea-c972a0ff7d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:45.497601 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830cd0bd-0166-4950-82ea-c972a0ff7d71 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:45.497882 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830cd0bd-0166-4950-82ea-c972a0ff7d71 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:45.504380 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830cd0bd-0166-4950-82ea-c972a0ff7d71 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:45.504838 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830cd0bd-0166-4950-82ea-c972a0ff7d71 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:45.506277 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830cd0bd-0166-4950-82ea-c972a0ff7d71 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:45.511982 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d925a434-2c74-4c8d-bbc2-c35777f6b864 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:45.520599 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-830cd0bd-0166-4950-82ea-c972a0ff7d71 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:21:45.520599 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:45.520599 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:45.520599 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:45.520599 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:45.520599 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:45.520599 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:45.520599 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:45.520599 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:45.520599 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:45.520599 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:45.520599 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:45.520599 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 14:21:45.520599 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 14:21:45.520599 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 14:21:45.521562 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 14:21:45.521562 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:45.521562 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:45.521562 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:45.521562 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:45.521562 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:45.521562 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:45.521562 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:45.521562 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:45.521562 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:45.521562 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:45.521562 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:45.521562 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:45.521562 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:45.521562 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:45.521562 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:45.521562 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:45.522606 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 14:21:45.522606 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 14:21:45.522606 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 14:21:45.522606 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 14:21:45.522606 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 14:21:45.522606 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 14:21:45.522606 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:21:45.522606 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:21:45.528938 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 436/857] 10.222.0.86 () {56 vars in 1111 bytes} [Tue Jun 7 14:21:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:21:45.529507 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55df7f8c-f2ef-475e-a6f5-a2ce913fb959 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:45.529507 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55df7f8c-f2ef-475e-a6f5-a2ce913fb959 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:45.529795 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55df7f8c-f2ef-475e-a6f5-a2ce913fb959 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:45.531123 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 437/858] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:21:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:21:45.531848 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55df7f8c-f2ef-475e-a6f5-a2ce913fb959 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:45.556719 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa3f46f-c969-44aa-bb49-b05e82199611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:45.557395 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa3f46f-c969-44aa-bb49-b05e82199611 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:45.557741 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa3f46f-c969-44aa-bb49-b05e82199611 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:45.557959 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa3f46f-c969-44aa-bb49-b05e82199611 None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:45.559428 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa3f46f-c969-44aa-bb49-b05e82199611 None admin] RBAC: Adding query filter params (name=service) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:45.559659 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa3f46f-c969-44aa-bb49-b05e82199611 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:45.561050 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa3f46f-c969-44aa-bb49-b05e82199611 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:45.574009 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 422/859] 10.222.0.86 () {56 vars in 1103 bytes} [Tue Jun 7 14:21:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:45.574009 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eea179c-8249-46f3-a25c-d30d1cd39c48 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:45.574009 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eea179c-8249-46f3-a25c-d30d1cd39c48 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:45.574009 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eea179c-8249-46f3-a25c-d30d1cd39c48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:45.588436 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-6eea179c-8249-46f3-a25c-d30d1cd39c48 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:21:45.589374 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-6eea179c-8249-46f3-a25c-d30d1cd39c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:21:45.645147 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55df7f8c-f2ef-475e-a6f5-a2ce913fb959 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:45.650736 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:45.671793 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 423/860] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:21:45 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 14:21:45.671793 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eea179c-8249-46f3-a25c-d30d1cd39c48 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:45.695663 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d051372-a0ce-4a1e-906b-c17aa9b0b6ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:45.696363 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d051372-a0ce-4a1e-906b-c17aa9b0b6ab None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:45.696657 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d051372-a0ce-4a1e-906b-c17aa9b0b6ab None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:45.696938 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d051372-a0ce-4a1e-906b-c17aa9b0b6ab None admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:45.697937 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d051372-a0ce-4a1e-906b-c17aa9b0b6ab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:45.699588 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d051372-a0ce-4a1e-906b-c17aa9b0b6ab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:45.701054 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d051372-a0ce-4a1e-906b-c17aa9b0b6ab None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:45.713008 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 438/861] 10.222.0.86 () {56 vars in 1148 bytes} [Tue Jun 7 14:21:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:45.713751 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d051372-a0ce-4a1e-906b-c17aa9b0b6ab None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:45.771814 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:45.779574 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eea179c-8249-46f3-a25c-d30d1cd39c48 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:45.816368 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54fd3fa-e603-45b2-b5b1-6d3390006f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:45.817383 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54fd3fa-e603-45b2-b5b1-6d3390006f85 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:45.817730 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54fd3fa-e603-45b2-b5b1-6d3390006f85 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:45.818082 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54fd3fa-e603-45b2-b5b1-6d3390006f85 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:45.824427 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d051372-a0ce-4a1e-906b-c17aa9b0b6ab None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:45.829690 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54fd3fa-e603-45b2-b5b1-6d3390006f85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:45.831157 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54fd3fa-e603-45b2-b5b1-6d3390006f85 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:45.851590 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-d54fd3fa-e603-45b2-b5b1-6d3390006f85 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:21:45.851590 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:45.851590 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:45.851590 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:45.851590 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:45.851590 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:45.851590 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:45.851590 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:45.851590 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:45.851590 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:45.851590 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:45.851590 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:45.851590 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:21:45.851590 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:21:45.851590 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:21:45.852702 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:21:45.852702 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:45.852702 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:45.852702 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:45.852702 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:45.852702 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:45.852702 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:45.852702 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:45.852702 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:45.852702 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:45.852702 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:45.852702 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:45.852702 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:45.852702 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:45.852702 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:45.852702 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:45.852702 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:45.853580 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:21:45.853580 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:21:45.853580 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:21:45.853580 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:21:45.853580 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 424/862] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jun 7 14:21:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:21:45.853866 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54fd3fa-e603-45b2-b5b1-6d3390006f85 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:45.869528 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0279efbb-7b4e-468f-a9e6-0a5a170bccb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:45.870211 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0279efbb-7b4e-468f-a9e6-0a5a170bccb6 None admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:45.870491 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0279efbb-7b4e-468f-a9e6-0a5a170bccb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:45.871299 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0279efbb-7b4e-468f-a9e6-0a5a170bccb6 None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:45.872076 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0279efbb-7b4e-468f-a9e6-0a5a170bccb6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:45.873449 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0279efbb-7b4e-468f-a9e6-0a5a170bccb6 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:45.902760 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:45.946385 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 439/863] 10.222.0.86 () {60 vars in 1141 bytes} [Tue Jun 7 14:21:45 2022] POST /identity/v3/services => generated 251 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:21:45.947227 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0279efbb-7b4e-468f-a9e6-0a5a170bccb6 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:45.968591 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54fd3fa-e603-45b2-b5b1-6d3390006f85 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:46.017569 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3316d2d6-8206-4f8b-b676-18e42037574a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:46.018597 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3316d2d6-8206-4f8b-b676-18e42037574a None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:46.019174 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3316d2d6-8206-4f8b-b676-18e42037574a None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:46.019683 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3316d2d6-8206-4f8b-b676-18e42037574a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:46.020880 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3316d2d6-8206-4f8b-b676-18e42037574a None admin] RBAC: Adding query filter params (role.id=e3bf6239f5bf477b965704b086786f11, scope.project.id=e429537b190c4c5ea7e1332ab044ca7a, user.id=c9774349dd2b4ec092ef04c3df050a7e) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:46.021383 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3316d2d6-8206-4f8b-b676-18e42037574a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:46.023353 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3316d2d6-8206-4f8b-b676-18e42037574a None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:46.036733 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 425/864] 10.222.0.86 () {56 vars in 1374 bytes} [Tue Jun 7 14:21:45 2022] GET /identity/v3/role_assignments?user.id=c9774349dd2b4ec092ef04c3df050a7e&scope.project.id=e429537b190c4c5ea7e1332ab044ca7a&role.id=e3bf6239f5bf477b965704b086786f11 => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:46.080542 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0279efbb-7b4e-468f-a9e6-0a5a170bccb6 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:46.093372 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:46.122145 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd426445-4f8c-4d3c-af36-14724810b5d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:46.122936 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd426445-4f8c-4d3c-af36-14724810b5d2 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:46.123180 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd426445-4f8c-4d3c-af36-14724810b5d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:46.123520 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd426445-4f8c-4d3c-af36-14724810b5d2 None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:46.124321 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd426445-4f8c-4d3c-af36-14724810b5d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:46.124637 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd426445-4f8c-4d3c-af36-14724810b5d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:46.126091 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd426445-4f8c-4d3c-af36-14724810b5d2 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:46.150012 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 440/865] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jun 7 14:21:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:46.156255 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3316d2d6-8206-4f8b-b676-18e42037574a None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:46.187217 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e2a430-f390-4b8c-b563-ea5db22d7f2f None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:46.187506 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e2a430-f390-4b8c-b563-ea5db22d7f2f None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:46.187822 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e2a430-f390-4b8c-b563-ea5db22d7f2f None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:46.189230 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 441/866] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:21:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 07 14:21:46.194858 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73966491-e81b-481b-b118-f45530caa023 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:46.195143 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73966491-e81b-481b-b118-f45530caa023 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:46.195424 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73966491-e81b-481b-b118-f45530caa023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:46.221654 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-73966491-e81b-481b-b118-f45530caa023 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:21:46.222817 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-73966491-e81b-481b-b118-f45530caa023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:21:46.307522 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3316d2d6-8206-4f8b-b676-18e42037574a None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:46.312333 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:46.321654 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 442/867] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:21:46 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 07 14:21:46.348820 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e423d13c-86e3-4749-86a6-1ec9ebd23a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:46.349054 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e423d13c-86e3-4749-86a6-1ec9ebd23a68 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:46.349248 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e423d13c-86e3-4749-86a6-1ec9ebd23a68 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:46.349526 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e423d13c-86e3-4749-86a6-1ec9ebd23a68 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:46.349625 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73966491-e81b-481b-b118-f45530caa023 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:46.360525 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e423d13c-86e3-4749-86a6-1ec9ebd23a68 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:46.362102 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e423d13c-86e3-4749-86a6-1ec9ebd23a68 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:46.382776 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-e423d13c-86e3-4749-86a6-1ec9ebd23a68 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 07 14:21:46.382776 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:46.382776 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:46.382776 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:46.382776 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:46.382776 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:46.382776 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:46.382776 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:46.382776 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:46.382776 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:46.382776 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:46.382776 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:46.382776 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 14:21:46.382776 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 14:21:46.382776 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 14:21:46.382776 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 14:21:46.383747 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:46.383747 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:46.383747 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 14:21:46.383747 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:21:46.383747 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 14:21:46.383747 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:21:46.383747 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:46.383747 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:46.383747 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:46.383747 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:46.383747 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:46.383747 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:46.383747 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:46.383747 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:46.383747 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:46.383747 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:46.383747 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:46.383747 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:46.385018 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:46.385018 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:46.385018 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 14:21:46.385018 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 14:21:46.385018 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 14:21:46.385018 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 14:21:46.385018 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 14:21:46.385018 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 14:21:46.385018 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 07 14:21:46.385018 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:21:46.387603 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 426/868] 10.222.0.86 () {56 vars in 1117 bytes} [Tue Jun 7 14:21:46 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:21:46.392773 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e423d13c-86e3-4749-86a6-1ec9ebd23a68 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:46.468630 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:46.471476 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73966491-e81b-481b-b118-f45530caa023 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:46.513547 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32b7b54-1528-4de3-97dd-767ac97c6bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:46.515128 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b7b54-1528-4de3-97dd-767ac97c6bb0 None admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:46.515623 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b7b54-1528-4de3-97dd-767ac97c6bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:46.516348 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b7b54-1528-4de3-97dd-767ac97c6bb0 None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:46.517891 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32b7b54-1528-4de3-97dd-767ac97c6bb0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:46.519492 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32b7b54-1528-4de3-97dd-767ac97c6bb0 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:46.519603 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e423d13c-86e3-4749-86a6-1ec9ebd23a68 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:46.556941 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57161d9-41b1-4239-b6ad-1ff0c46f5772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:46.557691 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57161d9-41b1-4239-b6ad-1ff0c46f5772 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:46.557982 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57161d9-41b1-4239-b6ad-1ff0c46f5772 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:46.558343 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57161d9-41b1-4239-b6ad-1ff0c46f5772 None admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:46.559202 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57161d9-41b1-4239-b6ad-1ff0c46f5772 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:46.559523 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57161d9-41b1-4239-b6ad-1ff0c46f5772 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:46.561048 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57161d9-41b1-4239-b6ad-1ff0c46f5772 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:46.584828 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 427/869] 10.222.0.86 () {56 vars in 1149 bytes} [Tue Jun 7 14:21:46 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:21:46.585926 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57161d9-41b1-4239-b6ad-1ff0c46f5772 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:46.602772 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 443/870] 10.222.0.86 () {60 vars in 1141 bytes} [Tue Jun 7 14:21:46 2022] POST /identity/v3/services => generated 269 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 14:21:46.636173 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:46.711427 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57161d9-41b1-4239-b6ad-1ff0c46f5772 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:46.755944 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d853f65-656d-41b4-8a18-3b335f8acd85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:46.756620 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d853f65-656d-41b4-8a18-3b335f8acd85 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:46.756906 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d853f65-656d-41b4-8a18-3b335f8acd85 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:46.757186 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d853f65-656d-41b4-8a18-3b335f8acd85 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:46.832631 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d853f65-656d-41b4-8a18-3b335f8acd85 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:46.840396 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d853f65-656d-41b4-8a18-3b335f8acd85 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:46.853842 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:46.946257 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 428/871] 10.222.0.86 () {58 vars in 1282 bytes} [Tue Jun 7 14:21:46 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 07 14:21:46.954645 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32b7b54-1528-4de3-97dd-767ac97c6bb0 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:47.056481 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32b7b54-1528-4de3-97dd-767ac97c6bb0 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:47.091954 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb8440c-beae-41e1-a0dc-6879f9a0753b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:47.092680 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb8440c-beae-41e1-a0dc-6879f9a0753b None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:47.093272 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb8440c-beae-41e1-a0dc-6879f9a0753b None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:47.093551 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb8440c-beae-41e1-a0dc-6879f9a0753b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:47.104112 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb8440c-beae-41e1-a0dc-6879f9a0753b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:47.105594 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb8440c-beae-41e1-a0dc-6879f9a0753b None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:47.123112 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-6fb8440c-beae-41e1-a0dc-6879f9a0753b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:21:47.123112 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:47.123112 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:47.123112 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:47.123112 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:47.123112 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:47.123112 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:47.123112 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:47.123112 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:47.123112 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:47.123112 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:47.123112 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:47.123112 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:21:47.123112 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:21:47.123112 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:21:47.124465 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:21:47.124465 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:47.124465 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:47.124465 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:47.124465 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:47.124465 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:47.124465 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:47.124465 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:47.124465 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:47.124465 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:47.124465 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:47.124465 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:47.124465 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:47.124465 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:47.124465 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:47.124465 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:47.124465 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:47.125941 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:21:47.125941 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:21:47.125941 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:21:47.125941 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:21:47.125941 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 444/872] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jun 7 14:21:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:21:47.130229 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d853f65-656d-41b4-8a18-3b335f8acd85 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:47.255739 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d853f65-656d-41b4-8a18-3b335f8acd85 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:47.278457 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:47.293269 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583b3a60-cd4e-40a0-a8d4-3c982c7691d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:47.293937 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583b3a60-cd4e-40a0-a8d4-3c982c7691d1 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:47.297478 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583b3a60-cd4e-40a0-a8d4-3c982c7691d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:47.297478 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583b3a60-cd4e-40a0-a8d4-3c982c7691d1 None admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:47.297478 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583b3a60-cd4e-40a0-a8d4-3c982c7691d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:47.297478 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583b3a60-cd4e-40a0-a8d4-3c982c7691d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:47.297478 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583b3a60-cd4e-40a0-a8d4-3c982c7691d1 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:47.309495 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 429/873] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jun 7 14:21:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:47.315225 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb8440c-beae-41e1-a0dc-6879f9a0753b None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:47.340153 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:47.421990 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb8440c-beae-41e1-a0dc-6879f9a0753b None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:47.456513 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846f25b1-64de-423f-8087-b5193a15fbac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:47.457315 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846f25b1-64de-423f-8087-b5193a15fbac None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:47.457600 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846f25b1-64de-423f-8087-b5193a15fbac None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:47.457877 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846f25b1-64de-423f-8087-b5193a15fbac None admin] PATH_INFO: `/v3/projects/service` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:47.465245 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846f25b1-64de-423f-8087-b5193a15fbac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:47.466680 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846f25b1-64de-423f-8087-b5193a15fbac None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:47.481121 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-846f25b1-64de-423f-8087-b5193a15fbac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:21:47.481121 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:47.481121 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:47.481121 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:47.481121 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:47.481121 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:47.481121 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:47.481121 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:47.481121 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:47.481121 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:47.481121 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:47.481121 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:47.481121 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 14:21:47.481121 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 14:21:47.481121 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 14:21:47.482027 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 14:21:47.482027 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:47.482027 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:47.482027 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:47.482027 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:47.482027 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:47.482027 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:47.482027 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:47.482027 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:47.482027 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:47.482027 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:47.482027 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:47.482027 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:47.482027 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:47.482027 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:47.482027 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:47.482027 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:47.483397 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 14:21:47.483397 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 14:21:47.483397 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 14:21:47.483397 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 14:21:47.483397 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 14:21:47.483397 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 14:21:47.483397 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:21:47.483397 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:21:47.483397 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 445/874] 10.222.0.86 () {56 vars in 1111 bytes} [Tue Jun 7 14:21:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:21:47.488357 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583b3a60-cd4e-40a0-a8d4-3c982c7691d1 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:47.591537 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583b3a60-cd4e-40a0-a8d4-3c982c7691d1 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:47.626350 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e81d2a-ca3c-4150-8ac2-eb2f5f15e67f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:47.627015 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e81d2a-ca3c-4150-8ac2-eb2f5f15e67f None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:47.627300 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e81d2a-ca3c-4150-8ac2-eb2f5f15e67f None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:47.627568 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e81d2a-ca3c-4150-8ac2-eb2f5f15e67f None admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:47.628391 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e81d2a-ca3c-4150-8ac2-eb2f5f15e67f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:47.628705 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e81d2a-ca3c-4150-8ac2-eb2f5f15e67f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:47.630126 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e81d2a-ca3c-4150-8ac2-eb2f5f15e67f None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:47.643074 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 430/875] 10.222.0.86 () {56 vars in 1148 bytes} [Tue Jun 7 14:21:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:47.648938 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846f25b1-64de-423f-8087-b5193a15fbac None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:47.721710 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:47.752066 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846f25b1-64de-423f-8087-b5193a15fbac None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:47.787416 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8b8515-901a-45a4-9e16-ca556da5449f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:47.788109 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8b8515-901a-45a4-9e16-ca556da5449f None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:47.788642 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8b8515-901a-45a4-9e16-ca556da5449f None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:47.788933 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8b8515-901a-45a4-9e16-ca556da5449f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:47.789826 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8b8515-901a-45a4-9e16-ca556da5449f None admin] RBAC: Adding query filter params (role.id=28e9b75018ac44c0afe7ab728071f2d5, scope.project.id=e429537b190c4c5ea7e1332ab044ca7a, user.id=d7b598c6a3f642ef9edc971ad3ebbe31) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:47.790411 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8b8515-901a-45a4-9e16-ca556da5449f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:47.791875 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8b8515-901a-45a4-9e16-ca556da5449f None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:47.798478 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 446/876] 10.222.0.86 () {56 vars in 1374 bytes} [Tue Jun 7 14:21:47 2022] GET /identity/v3/role_assignments?user.id=d7b598c6a3f642ef9edc971ad3ebbe31&scope.project.id=e429537b190c4c5ea7e1332ab044ca7a&role.id=28e9b75018ac44c0afe7ab728071f2d5 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:21:48.352045 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a145873b-76fc-4644-86bb-a66753bc99b1 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:48.352584 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a145873b-76fc-4644-86bb-a66753bc99b1 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:48.352584 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a145873b-76fc-4644-86bb-a66753bc99b1 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:48.354087 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 431/877] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:21:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:21:48.360185 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4e8320-19ab-4838-b8d5-0fc6660414bf None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:48.361016 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4e8320-19ab-4838-b8d5-0fc6660414bf None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:48.361520 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4e8320-19ab-4838-b8d5-0fc6660414bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:48.379043 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-dc4e8320-19ab-4838-b8d5-0fc6660414bf None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:21:48.380664 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-dc4e8320-19ab-4838-b8d5-0fc6660414bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:21:48.461742 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 447/878] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:21:48 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 14:21:48.485097 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a145873b-76fc-4644-86bb-a66753bc99b1 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:48.493743 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7453ef75-5eed-4456-9940-f9ff2d15ca69 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:48.494028 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7453ef75-5eed-4456-9940-f9ff2d15ca69 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:48.494315 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7453ef75-5eed-4456-9940-f9ff2d15ca69 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:48.496078 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 448/879] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:21:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:21:48.501399 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad352358-a25c-4a3d-931c-019ec6cc3e2c None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:48.501691 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad352358-a25c-4a3d-931c-019ec6cc3e2c None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:48.501977 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad352358-a25c-4a3d-931c-019ec6cc3e2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:48.523802 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-ad352358-a25c-4a3d-931c-019ec6cc3e2c None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:21:48.525011 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-ad352358-a25c-4a3d-931c-019ec6cc3e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:21:48.535230 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:48.603261 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:48.615260 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a145873b-76fc-4644-86bb-a66753bc99b1 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:48.619825 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 449/880] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:21:48 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 07 14:21:48.641088 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad352358-a25c-4a3d-931c-019ec6cc3e2c None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:48.658167 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7e1534-bded-42d1-836b-8db1e43f46df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:48.659577 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7e1534-bded-42d1-836b-8db1e43f46df None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:48.660574 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7e1534-bded-42d1-836b-8db1e43f46df None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:48.661206 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7e1534-bded-42d1-836b-8db1e43f46df None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:48.662177 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7e1534-bded-42d1-836b-8db1e43f46df None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:48.664701 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7e1534-bded-42d1-836b-8db1e43f46df None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:48.681143 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-2c7e1534-bded-42d1-836b-8db1e43f46df None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 07 14:21:48.681143 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:48.681143 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 07 14:21:48.681143 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 07 14:21:48.681143 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 07 14:21:48.681143 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 07 14:21:48.681143 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 07 14:21:48.681143 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 14:21:48.681143 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 07 14:21:48.681143 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:21:48.681143 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 07 14:21:48.681143 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:21:48.681143 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:48.681143 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:48.681143 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:48.681143 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:48.681143 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:48.682157 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:48.682157 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:48.682157 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:48.682157 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:48.682157 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:48.682157 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:48.682157 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 07 14:21:48.682157 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 07 14:21:48.682157 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 07 14:21:48.682157 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 07 14:21:48.682157 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:48.682157 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:48.682157 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:48.682157 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:48.682157 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:48.682157 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:48.683013 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:48.683013 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:48.683013 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:48.683013 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:48.683013 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:48.683013 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:48.683013 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:48.683013 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:48.683013 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:48.683013 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:48.683013 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 07 14:21:48.683013 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 14:21:48.683013 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 07 14:21:48.683013 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:21:48.690731 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 432/881] 10.222.0.86 () {56 vars in 1114 bytes} [Tue Jun 7 14:21:48 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:21:48.691481 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7e1534-bded-42d1-836b-8db1e43f46df None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:48.760380 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad352358-a25c-4a3d-931c-019ec6cc3e2c None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:48.796702 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68b0307-7c49-499d-b53e-5d0d2435c81d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:48.797854 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68b0307-7c49-499d-b53e-5d0d2435c81d None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:48.798363 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68b0307-7c49-499d-b53e-5d0d2435c81d None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:48.798837 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68b0307-7c49-499d-b53e-5d0d2435c81d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:48.799687 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7e1534-bded-42d1-836b-8db1e43f46df None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:48.799909 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68b0307-7c49-499d-b53e-5d0d2435c81d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:48.801219 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:48.802158 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68b0307-7c49-499d-b53e-5d0d2435c81d None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:48.815494 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-c68b0307-7c49-499d-b53e-5d0d2435c81d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 07 14:21:48.815494 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:48.815494 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 07 14:21:48.815494 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 07 14:21:48.815494 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 07 14:21:48.815494 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 07 14:21:48.815494 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 07 14:21:48.815494 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 14:21:48.815494 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 07 14:21:48.815494 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:21:48.815494 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 07 14:21:48.815494 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:21:48.815494 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:48.815494 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:48.815494 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:48.815494 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:48.815494 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:48.816523 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:48.816523 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:48.816523 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:48.816523 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:48.816523 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:48.816523 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:48.816523 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 07 14:21:48.816523 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 07 14:21:48.816523 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 07 14:21:48.816523 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 07 14:21:48.816523 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:48.816523 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:48.816523 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:48.816523 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:48.816523 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:48.816523 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:48.817341 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:48.817341 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:48.817341 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:48.817341 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:48.817341 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:48.817341 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:48.817341 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:48.817341 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:48.817341 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:48.817341 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:48.817341 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 07 14:21:48.817341 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 14:21:48.817341 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 07 14:21:48.817341 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:21:48.820264 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 450/882] 10.222.0.86 () {56 vars in 1126 bytes} [Tue Jun 7 14:21:48 2022] GET /identity/v3/services/object-store => generated 93 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 14:21:48.828426 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68b0307-7c49-499d-b53e-5d0d2435c81d None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:48.842039 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fd0325-d8f6-4527-a15f-8caef2e3f1a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:48.842744 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fd0325-d8f6-4527-a15f-8caef2e3f1a1 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:48.843036 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fd0325-d8f6-4527-a15f-8caef2e3f1a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:48.843315 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fd0325-d8f6-4527-a15f-8caef2e3f1a1 None admin] PATH_INFO: `/v3/services` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:48.844572 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fd0325-d8f6-4527-a15f-8caef2e3f1a1 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:48.844891 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fd0325-d8f6-4527-a15f-8caef2e3f1a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:48.846692 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fd0325-d8f6-4527-a15f-8caef2e3f1a1 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:48.855867 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 433/883] 10.222.0.86 () {56 vars in 1114 bytes} [Tue Jun 7 14:21:48 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:48.858557 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fd0325-d8f6-4527-a15f-8caef2e3f1a1 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:48.911662 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:48.968086 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68b0307-7c49-499d-b53e-5d0d2435c81d None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:48.992704 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fd0325-d8f6-4527-a15f-8caef2e3f1a1 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:49.010788 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361b0c6e-d5e4-4588-aca8-a0100ca50e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:49.012458 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361b0c6e-d5e4-4588-aca8-a0100ca50e1f None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:49.012746 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361b0c6e-d5e4-4588-aca8-a0100ca50e1f None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:49.013020 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361b0c6e-d5e4-4588-aca8-a0100ca50e1f None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:49.014001 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361b0c6e-d5e4-4588-aca8-a0100ca50e1f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:49.014315 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361b0c6e-d5e4-4588-aca8-a0100ca50e1f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:49.015943 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361b0c6e-d5e4-4588-aca8-a0100ca50e1f None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:49.023916 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 451/884] 10.222.0.86 () {56 vars in 1122 bytes} [Tue Jun 7 14:21:48 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:49.027293 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361b0c6e-d5e4-4588-aca8-a0100ca50e1f None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:49.043556 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad9361a-8963-4ac1-8260-448d479b383b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:49.044782 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad9361a-8963-4ac1-8260-448d479b383b None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:49.045073 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad9361a-8963-4ac1-8260-448d479b383b None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:49.045353 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad9361a-8963-4ac1-8260-448d479b383b None admin] PATH_INFO: `/v3/services` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:49.046098 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad9361a-8963-4ac1-8260-448d479b383b None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:49.046413 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad9361a-8963-4ac1-8260-448d479b383b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:49.048600 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad9361a-8963-4ac1-8260-448d479b383b None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:49.059950 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 434/885] 10.222.0.86 () {56 vars in 1114 bytes} [Tue Jun 7 14:21:48 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:21:49.061323 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f824a00-3eb2-4b1a-963e-058ac53804cb None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:49.061613 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f824a00-3eb2-4b1a-963e-058ac53804cb None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:49.061890 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f824a00-3eb2-4b1a-963e-058ac53804cb None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:49.063789 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 435/886] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:21:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:21:49.066228 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f824a00-3eb2-4b1a-963e-058ac53804cb None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:49.098826 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:49.146164 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361b0c6e-d5e4-4588-aca8-a0100ca50e1f None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:49.171674 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:49.178261 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f824a00-3eb2-4b1a-963e-058ac53804cb None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:49.182360 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31660c3f-a316-4fe8-a325-67da16d7e8ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:49.183851 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31660c3f-a316-4fe8-a325-67da16d7e8ea None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:49.184137 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31660c3f-a316-4fe8-a325-67da16d7e8ea None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:49.184412 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31660c3f-a316-4fe8-a325-67da16d7e8ea None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:49.185117 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31660c3f-a316-4fe8-a325-67da16d7e8ea None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:49.185427 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31660c3f-a316-4fe8-a325-67da16d7e8ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:49.186783 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31660c3f-a316-4fe8-a325-67da16d7e8ea None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:49.195868 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 452/887] 10.222.0.86 () {56 vars in 1122 bytes} [Tue Jun 7 14:21:49 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:49.195868 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854142c2-0d3a-48af-8cde-3eb926dc5c60 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:49.195868 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854142c2-0d3a-48af-8cde-3eb926dc5c60 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:49.195868 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854142c2-0d3a-48af-8cde-3eb926dc5c60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:49.218721 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-854142c2-0d3a-48af-8cde-3eb926dc5c60 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:21:49.219985 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-854142c2-0d3a-48af-8cde-3eb926dc5c60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:21:49.223625 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf7a045-9f60-401e-91ad-e265df297f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:49.224343 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf7a045-9f60-401e-91ad-e265df297f39 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:49.224633 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf7a045-9f60-401e-91ad-e265df297f39 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:49.224913 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf7a045-9f60-401e-91ad-e265df297f39 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:49.225731 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf7a045-9f60-401e-91ad-e265df297f39 None admin] RBAC: Adding query filter params (interface=public, service_id=bc6fefa532da4f79a807de67daedfc09, region_id=RegionOne) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:49.226048 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf7a045-9f60-401e-91ad-e265df297f39 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:49.227470 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf7a045-9f60-401e-91ad-e265df297f39 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:49.234558 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 436/888] 10.222.0.86 () {56 vars in 1251 bytes} [Tue Jun 7 14:21:49 2022] GET /identity/v3/endpoints?service_id=bc6fefa532da4f79a807de67daedfc09&interface=public®ion_id=RegionOne => generated 194 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:49.240641 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf7a045-9f60-401e-91ad-e265df297f39 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:49.315539 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 453/889] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:21:49 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 14:21:49.337716 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854142c2-0d3a-48af-8cde-3eb926dc5c60 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:49.356364 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:49.363595 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf7a045-9f60-401e-91ad-e265df297f39 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:49.400578 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2a5fc3-4968-4d80-a8ad-6044c5205a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:49.401359 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2a5fc3-4968-4d80-a8ad-6044c5205a04 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:49.401555 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2a5fc3-4968-4d80-a8ad-6044c5205a04 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:49.401936 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2a5fc3-4968-4d80-a8ad-6044c5205a04 None admin] PATH_INFO: `/v3/services` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:49.402648 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2a5fc3-4968-4d80-a8ad-6044c5205a04 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:49.404165 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2a5fc3-4968-4d80-a8ad-6044c5205a04 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:49.415794 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 437/890] 10.222.0.86 () {56 vars in 1087 bytes} [Tue Jun 7 14:21:49 2022] GET /identity/v3/services => generated 1268 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 07 14:21:49.452412 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854142c2-0d3a-48af-8cde-3eb926dc5c60 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:49.472693 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:49.492766 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddddf29-d261-49da-a919-0c11e80476ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:49.493934 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddddf29-d261-49da-a919-0c11e80476ef None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:49.494377 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddddf29-d261-49da-a919-0c11e80476ef None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:49.494800 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddddf29-d261-49da-a919-0c11e80476ef None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:49.496267 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddddf29-d261-49da-a919-0c11e80476ef None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:49.497886 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddddf29-d261-49da-a919-0c11e80476ef None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:49.511786 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-8ddddf29-d261-49da-a919-0c11e80476ef None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 07 14:21:49.511786 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:49.511786 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 07 14:21:49.511786 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 07 14:21:49.511786 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 07 14:21:49.511786 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 07 14:21:49.511786 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 07 14:21:49.511786 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 14:21:49.511786 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 07 14:21:49.511786 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:21:49.511786 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 07 14:21:49.511786 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:21:49.511786 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:49.511786 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:49.511786 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:49.511786 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:49.512781 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:49.512781 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:49.512781 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:49.512781 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:49.512781 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:49.512781 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:49.512781 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:49.512781 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 07 14:21:49.512781 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 07 14:21:49.512781 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 07 14:21:49.512781 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 07 14:21:49.512781 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:49.512781 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:49.512781 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:49.512781 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:49.512781 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:49.513609 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:49.513609 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:49.513609 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:49.513609 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:49.513609 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:49.513609 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:49.513609 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:49.513609 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:49.513609 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:49.513609 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:49.513609 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:49.513609 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 07 14:21:49.513609 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 14:21:49.513609 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 07 14:21:49.513609 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:21:49.514396 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 454/891] 10.222.0.86 () {56 vars in 1132 bytes} [Tue Jun 7 14:21:49 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 14:21:49.519868 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2a5fc3-4968-4d80-a8ad-6044c5205a04 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:49.644853 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2a5fc3-4968-4d80-a8ad-6044c5205a04 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:49.681305 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1417e403-8e2b-4cc1-8a4b-f3a49384cc05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:49.681971 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1417e403-8e2b-4cc1-8a4b-f3a49384cc05 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:49.682259 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1417e403-8e2b-4cc1-8a4b-f3a49384cc05 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:49.682536 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1417e403-8e2b-4cc1-8a4b-f3a49384cc05 None admin] PATH_INFO: `/v3/services` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:49.683790 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1417e403-8e2b-4cc1-8a4b-f3a49384cc05 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:49.684151 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1417e403-8e2b-4cc1-8a4b-f3a49384cc05 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:49.685512 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1417e403-8e2b-4cc1-8a4b-f3a49384cc05 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:49.690635 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 438/892] 10.222.0.86 () {56 vars in 1126 bytes} [Tue Jun 7 14:21:49 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:49.696315 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddddf29-d261-49da-a919-0c11e80476ef None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:49.799076 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddddf29-d261-49da-a919-0c11e80476ef None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:49.838766 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04e8e6c-bb42-4295-96c2-7aa7c2ad8aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:49.844014 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e8e6c-bb42-4295-96c2-7aa7c2ad8aaa None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:49.844014 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e8e6c-bb42-4295-96c2-7aa7c2ad8aaa None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:49.844014 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e8e6c-bb42-4295-96c2-7aa7c2ad8aaa None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:49.844014 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04e8e6c-bb42-4295-96c2-7aa7c2ad8aaa None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:49.844014 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04e8e6c-bb42-4295-96c2-7aa7c2ad8aaa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:49.844014 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04e8e6c-bb42-4295-96c2-7aa7c2ad8aaa None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:49.849023 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 455/893] 10.222.0.86 () {56 vars in 1126 bytes} [Tue Jun 7 14:21:49 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:49.855614 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1417e403-8e2b-4cc1-8a4b-f3a49384cc05 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:49.892656 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:49.971341 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1417e403-8e2b-4cc1-8a4b-f3a49384cc05 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:50.007485 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2867d7-9568-4014-bb88-8abcb4669792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:50.008450 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2867d7-9568-4014-bb88-8abcb4669792 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:50.008892 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2867d7-9568-4014-bb88-8abcb4669792 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:50.009309 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2867d7-9568-4014-bb88-8abcb4669792 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:50.010260 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2867d7-9568-4014-bb88-8abcb4669792 None admin] RBAC: Adding query filter params (interface=public, service_id=ae20de89b7154467aef7388123ca63fc, region_id=RegionOne) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:50.010925 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2867d7-9568-4014-bb88-8abcb4669792 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:50.012441 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2867d7-9568-4014-bb88-8abcb4669792 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:50.018405 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 439/894] 10.222.0.86 () {56 vars in 1251 bytes} [Tue Jun 7 14:21:49 2022] GET /identity/v3/endpoints?service_id=ae20de89b7154467aef7388123ca63fc&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:50.027807 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04e8e6c-bb42-4295-96c2-7aa7c2ad8aaa None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:50.074125 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:50.129456 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04e8e6c-bb42-4295-96c2-7aa7c2ad8aaa None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:50.163992 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaf9b88-761b-49fa-8d16-87c6b2e43725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:50.164663 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaf9b88-761b-49fa-8d16-87c6b2e43725 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:50.164947 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaf9b88-761b-49fa-8d16-87c6b2e43725 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:50.165221 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaf9b88-761b-49fa-8d16-87c6b2e43725 None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:50.165904 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaf9b88-761b-49fa-8d16-87c6b2e43725 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:50.167798 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaf9b88-761b-49fa-8d16-87c6b2e43725 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:50.173903 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 456/895] 10.222.0.86 () {56 vars in 1087 bytes} [Tue Jun 7 14:21:50 2022] GET /identity/v3/services => generated 1268 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:21:50.208470 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3102778-d645-4e4e-8fcc-1c096caa53ae None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:50.209111 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3102778-d645-4e4e-8fcc-1c096caa53ae None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:50.209616 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3102778-d645-4e4e-8fcc-1c096caa53ae None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:50.211818 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 440/896] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:21:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:21:50.217937 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea2aad2-b1c0-4608-9caa-d0ac143223ab None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:50.218264 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea2aad2-b1c0-4608-9caa-d0ac143223ab None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:50.218493 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea2aad2-b1c0-4608-9caa-d0ac143223ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:50.236919 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-9ea2aad2-b1c0-4608-9caa-d0ac143223ab None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:21:50.238110 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-9ea2aad2-b1c0-4608-9caa-d0ac143223ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:21:50.316411 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 457/897] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:21:50 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 14:21:50.341070 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3102778-d645-4e4e-8fcc-1c096caa53ae None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:50.438306 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:50.454988 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3102778-d645-4e4e-8fcc-1c096caa53ae None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:50.493211 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb558fab-d7c2-43cd-a284-2215dbdbf268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:50.494253 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb558fab-d7c2-43cd-a284-2215dbdbf268 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:50.494683 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb558fab-d7c2-43cd-a284-2215dbdbf268 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:50.495120 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb558fab-d7c2-43cd-a284-2215dbdbf268 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:50.505712 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb558fab-d7c2-43cd-a284-2215dbdbf268 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:21:50.514416 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-bb558fab-d7c2-43cd-a284-2215dbdbf268 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 07 14:21:50.514416 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:50.514416 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:50.514416 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:50.514416 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:50.514416 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:50.514416 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:50.514416 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:50.514416 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:50.514416 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:50.514416 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:50.514416 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:50.514416 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:21:50.514416 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:21:50.514416 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:21:50.514416 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:21:50.515593 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:21:50.515593 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:21:50.515593 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:21:50.515593 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:21:50.515593 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:50.515593 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:50.515593 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:50.515593 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:50.515593 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:50.515593 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:50.515593 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:50.515593 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:50.515593 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:50.515593 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:50.515593 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:50.515593 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:50.516672 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:50.516672 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:50.516672 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:50.516672 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:50.516672 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:21:50.516672 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:21:50.516672 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:21:50.516672 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:21:50.516672 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:21:50.516672 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:21:50.516672 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 07 14:21:50.516672 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:21:50.519058 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 441/898] 10.222.0.86 () {56 vars in 1120 bytes} [Tue Jun 7 14:21:50 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:21:50.525008 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea2aad2-b1c0-4608-9caa-d0ac143223ab None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:50.568891 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:50.630497 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea2aad2-b1c0-4608-9caa-d0ac143223ab None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:50.667278 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d8ae8a-4ca0-4bbc-8544-79660ee1c7bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:50.667983 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d8ae8a-4ca0-4bbc-8544-79660ee1c7bf None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:50.668268 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d8ae8a-4ca0-4bbc-8544-79660ee1c7bf None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:50.668547 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d8ae8a-4ca0-4bbc-8544-79660ee1c7bf None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:50.669292 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d8ae8a-4ca0-4bbc-8544-79660ee1c7bf None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:50.669602 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d8ae8a-4ca0-4bbc-8544-79660ee1c7bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:50.670961 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d8ae8a-4ca0-4bbc-8544-79660ee1c7bf None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:50.679662 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 458/899] 10.222.0.86 () {56 vars in 1115 bytes} [Tue Jun 7 14:21:50 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:50.685161 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb558fab-d7c2-43cd-a284-2215dbdbf268 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:50.787319 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb558fab-d7c2-43cd-a284-2215dbdbf268 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:50.821584 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a101d7d7-8052-4225-a6e1-9ac343243211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:50.822710 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a101d7d7-8052-4225-a6e1-9ac343243211 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:50.823220 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a101d7d7-8052-4225-a6e1-9ac343243211 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:50.824270 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a101d7d7-8052-4225-a6e1-9ac343243211 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:50.835084 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a101d7d7-8052-4225-a6e1-9ac343243211 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:50.836795 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a101d7d7-8052-4225-a6e1-9ac343243211 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:50.843442 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:50.854520 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-a101d7d7-8052-4225-a6e1-9ac343243211 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:21:50.854520 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:50.854520 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:50.854520 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:50.854520 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:50.854520 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:50.854520 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:50.854520 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:50.854520 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:50.854520 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:50.854520 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:50.854520 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:50.854520 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:21:50.854520 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:21:50.854520 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:21:50.859309 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:21:50.859309 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:50.859309 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:50.859309 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:50.859309 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:50.859309 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:50.859309 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:50.859309 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:50.859309 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:50.859309 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:50.859309 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:50.859309 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:50.859309 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:50.859309 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:50.859309 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:50.859309 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:50.859309 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:50.860395 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:21:50.860395 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:21:50.860395 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:21:50.860395 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:21:50.860395 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 442/900] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jun 7 14:21:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:21:50.862425 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d8ae8a-4ca0-4bbc-8544-79660ee1c7bf None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:50.963396 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d8ae8a-4ca0-4bbc-8544-79660ee1c7bf None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:50.965019 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:51.001108 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0350697e-5b19-4188-8da0-7fd49194f448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:51.001720 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0350697e-5b19-4188-8da0-7fd49194f448 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:51.002379 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0350697e-5b19-4188-8da0-7fd49194f448 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:51.002662 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0350697e-5b19-4188-8da0-7fd49194f448 None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:51.003400 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0350697e-5b19-4188-8da0-7fd49194f448 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:51.004137 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0350697e-5b19-4188-8da0-7fd49194f448 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:51.005590 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0350697e-5b19-4188-8da0-7fd49194f448 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:51.017808 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 459/901] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jun 7 14:21:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:51.022892 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a101d7d7-8052-4225-a6e1-9ac343243211 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:51.132713 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a101d7d7-8052-4225-a6e1-9ac343243211 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:51.167818 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efc930e-08c6-4f48-9941-043f360f91c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:51.168638 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efc930e-08c6-4f48-9941-043f360f91c1 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:51.168925 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efc930e-08c6-4f48-9941-043f360f91c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:51.169204 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efc930e-08c6-4f48-9941-043f360f91c1 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:51.177041 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efc930e-08c6-4f48-9941-043f360f91c1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:51.178491 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efc930e-08c6-4f48-9941-043f360f91c1 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:51.193626 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-8efc930e-08c6-4f48-9941-043f360f91c1 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 07 14:21:51.193626 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:51.193626 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:51.193626 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:51.193626 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:51.193626 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:51.193626 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:51.193626 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:51.193626 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:51.193626 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:51.193626 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:51.193626 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:51.193626 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 14:21:51.193626 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 14:21:51.193626 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 14:21:51.193626 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 14:21:51.194583 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:51.194583 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:51.194583 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 14:21:51.194583 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:21:51.194583 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 14:21:51.194583 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:21:51.194583 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:51.194583 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:51.194583 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:51.194583 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:51.194583 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:51.194583 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:51.194583 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:51.194583 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:51.194583 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:51.194583 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:51.194583 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:51.194583 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:51.196133 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:51.196133 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:51.196133 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 14:21:51.196133 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 14:21:51.196133 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 14:21:51.196133 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 14:21:51.196133 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 14:21:51.196133 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 14:21:51.196133 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 07 14:21:51.196133 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:21:51.196133 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 443/902] 10.222.0.86 () {56 vars in 1117 bytes} [Tue Jun 7 14:21:51 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:21:51.201227 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0350697e-5b19-4188-8da0-7fd49194f448 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:51.315740 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0350697e-5b19-4188-8da0-7fd49194f448 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:51.352035 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e1c1e6-de08-4598-af29-0723f64b4f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:51.352712 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e1c1e6-de08-4598-af29-0723f64b4f6c None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:51.352999 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e1c1e6-de08-4598-af29-0723f64b4f6c None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:51.353280 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e1c1e6-de08-4598-af29-0723f64b4f6c None admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:51.354117 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e1c1e6-de08-4598-af29-0723f64b4f6c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:51.354427 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e1c1e6-de08-4598-af29-0723f64b4f6c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:51.356386 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e1c1e6-de08-4598-af29-0723f64b4f6c None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:51.374789 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 460/903] 10.222.0.86 () {56 vars in 1149 bytes} [Tue Jun 7 14:21:51 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:51.380081 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efc930e-08c6-4f48-9941-043f360f91c1 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:51.443476 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:51.488226 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efc930e-08c6-4f48-9941-043f360f91c1 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:51.529414 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179b1208-858c-403f-ac8a-86fc2506dea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:51.530083 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179b1208-858c-403f-ac8a-86fc2506dea3 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:51.530366 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179b1208-858c-403f-ac8a-86fc2506dea3 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:51.530644 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179b1208-858c-403f-ac8a-86fc2506dea3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:51.601394 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179b1208-858c-403f-ac8a-86fc2506dea3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:51.602907 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179b1208-858c-403f-ac8a-86fc2506dea3 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:51.646812 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22d5118-6c32-431e-b7d3-7385441e1fb6 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:51.647359 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22d5118-6c32-431e-b7d3-7385441e1fb6 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:51.647359 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22d5118-6c32-431e-b7d3-7385441e1fb6 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:51.649027 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 461/904] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:21:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 07 14:21:51.653981 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c4288e-6a01-4750-8174-801645295ba7 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:51.654273 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c4288e-6a01-4750-8174-801645295ba7 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:51.654557 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c4288e-6a01-4750-8174-801645295ba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:51.661576 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:51.681190 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-52c4288e-6a01-4750-8174-801645295ba7 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:21:51.682409 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-52c4288e-6a01-4750-8174-801645295ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:21:51.710374 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 444/905] 10.222.0.86 () {58 vars in 1282 bytes} [Tue Jun 7 14:21:51 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 07 14:21:51.710551 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:51.715469 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179b1208-858c-403f-ac8a-86fc2506dea3 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:51.777977 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 462/906] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:21:51 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 07 14:21:51.801173 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c4288e-6a01-4750-8174-801645295ba7 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:51.834707 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179b1208-858c-403f-ac8a-86fc2506dea3 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:51.872865 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b473e46-0a60-4e5e-91e1-0aef790c2c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:51.873666 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b473e46-0a60-4e5e-91e1-0aef790c2c12 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:51.873955 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b473e46-0a60-4e5e-91e1-0aef790c2c12 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:51.874234 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b473e46-0a60-4e5e-91e1-0aef790c2c12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:51.885610 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b473e46-0a60-4e5e-91e1-0aef790c2c12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:51.887602 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b473e46-0a60-4e5e-91e1-0aef790c2c12 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:51.905482 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-9b473e46-0a60-4e5e-91e1-0aef790c2c12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:21:51.905482 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:51.905482 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:51.905482 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:51.905482 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:51.905482 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:51.905482 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:51.905482 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:51.905482 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:51.905482 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:51.905482 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:51.905482 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:51.905482 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:21:51.905482 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:21:51.905482 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:21:51.906388 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:21:51.906388 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:51.906388 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:51.906388 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:51.906388 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:51.906388 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:51.906388 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:51.906388 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:51.906388 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:51.906388 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:51.906388 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:51.906388 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:51.906388 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:51.906388 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:51.906388 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:51.906388 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:51.906388 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:51.907350 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:21:51.907350 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:21:51.907350 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:21:51.907350 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:21:51.907350 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 445/907] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jun 7 14:21:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:21:51.908072 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2616c4-c3d2-4af7-b46c-4def56d26a06 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:51.908347 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2616c4-c3d2-4af7-b46c-4def56d26a06 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:51.908626 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2616c4-c3d2-4af7-b46c-4def56d26a06 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:51.911721 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 446/908] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:21:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:21:51.912600 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2616c4-c3d2-4af7-b46c-4def56d26a06 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:51.923592 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c4288e-6a01-4750-8174-801645295ba7 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:51.926703 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:51.961185 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4aeaff-72a3-42a2-b50d-b19a388f68e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:51.961782 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4aeaff-72a3-42a2-b50d-b19a388f68e6 None admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:51.962187 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4aeaff-72a3-42a2-b50d-b19a388f68e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:51.962469 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4aeaff-72a3-42a2-b50d-b19a388f68e6 None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:51.963189 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4aeaff-72a3-42a2-b50d-b19a388f68e6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:51.964646 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4aeaff-72a3-42a2-b50d-b19a388f68e6 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:52.018704 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2616c4-c3d2-4af7-b46c-4def56d26a06 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:52.053061 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb07bb81-368e-4d98-92cc-ac212ecae7c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:52.053722 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb07bb81-368e-4d98-92cc-ac212ecae7c5 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:52.054010 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb07bb81-368e-4d98-92cc-ac212ecae7c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:52.054289 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb07bb81-368e-4d98-92cc-ac212ecae7c5 None admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:52.055016 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb07bb81-368e-4d98-92cc-ac212ecae7c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:52.055363 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb07bb81-368e-4d98-92cc-ac212ecae7c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:52.056767 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb07bb81-368e-4d98-92cc-ac212ecae7c5 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:52.068536 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 447/909] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jun 7 14:21:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:52.069757 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962c2477-c965-40bd-b46d-692b0dac1bee None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:52.070049 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962c2477-c965-40bd-b46d-692b0dac1bee None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:52.070330 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962c2477-c965-40bd-b46d-692b0dac1bee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:52.082870 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 463/910] 10.222.0.86 () {60 vars in 1141 bytes} [Tue Jun 7 14:21:51 2022] POST /identity/v3/services => generated 241 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 14:21:52.083695 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4aeaff-72a3-42a2-b50d-b19a388f68e6 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:52.097163 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-962c2477-c965-40bd-b46d-692b0dac1bee None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:21:52.099009 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-962c2477-c965-40bd-b46d-692b0dac1bee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:21:52.105522 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:52.195651 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:52.211993 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 448/911] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:21:52 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 14:21:52.242873 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962c2477-c965-40bd-b46d-692b0dac1bee None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:52.252168 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4aeaff-72a3-42a2-b50d-b19a388f68e6 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:52.294697 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a83c0d-79b5-4239-8c21-d3956c2e3947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:52.295985 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a83c0d-79b5-4239-8c21-d3956c2e3947 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:52.296265 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a83c0d-79b5-4239-8c21-d3956c2e3947 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:52.297279 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a83c0d-79b5-4239-8c21-d3956c2e3947 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:52.305153 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a83c0d-79b5-4239-8c21-d3956c2e3947 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:52.306650 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a83c0d-79b5-4239-8c21-d3956c2e3947 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:52.323336 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-73a83c0d-79b5-4239-8c21-d3956c2e3947 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:21:52.323336 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:52.323336 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:52.323336 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:52.323336 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:52.323336 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:52.323336 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:52.323336 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:52.323336 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:52.323336 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:52.323336 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:52.323336 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:52.323336 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 14:21:52.323336 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 14:21:52.323336 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 14:21:52.324379 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 14:21:52.324379 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:52.324379 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:52.324379 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:52.324379 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:52.324379 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:52.324379 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:52.324379 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:52.324379 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:52.324379 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:52.324379 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:52.324379 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:52.324379 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:52.324379 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:52.324379 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:52.324379 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:52.324379 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:52.325327 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 14:21:52.325327 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 14:21:52.325327 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 14:21:52.325327 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 14:21:52.325327 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 14:21:52.325327 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 14:21:52.325327 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:21:52.325327 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:21:52.325327 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 464/912] 10.222.0.86 () {56 vars in 1111 bytes} [Tue Jun 7 14:21:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:21:52.333810 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a83c0d-79b5-4239-8c21-d3956c2e3947 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:52.373289 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962c2477-c965-40bd-b46d-692b0dac1bee None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:52.415682 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:52.421666 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bab165d-9838-405b-9aba-551abc2d451b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:52.423749 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bab165d-9838-405b-9aba-551abc2d451b None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:52.424636 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bab165d-9838-405b-9aba-551abc2d451b None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:52.425139 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bab165d-9838-405b-9aba-551abc2d451b None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:52.426452 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bab165d-9838-405b-9aba-551abc2d451b None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:52.428383 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bab165d-9838-405b-9aba-551abc2d451b None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:52.443215 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-8bab165d-9838-405b-9aba-551abc2d451b None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 07 14:21:52.443215 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:52.443215 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 07 14:21:52.443215 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 07 14:21:52.443215 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 07 14:21:52.443215 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 07 14:21:52.443215 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 07 14:21:52.443215 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 14:21:52.443215 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 07 14:21:52.443215 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:21:52.443215 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 07 14:21:52.443215 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:21:52.443215 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:52.443215 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:52.443215 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:52.443215 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:52.443215 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:52.444822 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:52.444822 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:52.444822 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:52.444822 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:52.444822 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:52.444822 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:52.444822 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 07 14:21:52.444822 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 07 14:21:52.444822 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 07 14:21:52.444822 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 07 14:21:52.444822 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:52.444822 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:52.444822 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:52.444822 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:52.444822 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:52.444822 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:52.445643 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:52.445643 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:52.445643 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:52.445643 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:52.445643 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:52.445643 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:52.445643 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:52.445643 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:52.445643 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:52.445643 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:52.445643 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 07 14:21:52.445643 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 14:21:52.445643 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 07 14:21:52.445643 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:21:52.445643 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 449/913] 10.222.0.86 () {56 vars in 1114 bytes} [Tue Jun 7 14:21:52 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 14:21:52.452723 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bab165d-9838-405b-9aba-551abc2d451b None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:52.458547 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a83c0d-79b5-4239-8c21-d3956c2e3947 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:52.497595 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67047b7f-670b-40e6-926d-df66818bcb11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:52.498623 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67047b7f-670b-40e6-926d-df66818bcb11 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:52.499111 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67047b7f-670b-40e6-926d-df66818bcb11 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:52.499588 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67047b7f-670b-40e6-926d-df66818bcb11 None admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:52.500604 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67047b7f-670b-40e6-926d-df66818bcb11 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:52.501218 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67047b7f-670b-40e6-926d-df66818bcb11 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:52.502870 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67047b7f-670b-40e6-926d-df66818bcb11 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:52.522017 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 465/914] 10.222.0.86 () {56 vars in 1148 bytes} [Tue Jun 7 14:21:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:21:52.523345 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67047b7f-670b-40e6-926d-df66818bcb11 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:52.523887 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:52.576353 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bab165d-9838-405b-9aba-551abc2d451b None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:52.614260 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f65296-203c-444d-a1f7-a14c0eeb40e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:52.614781 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f65296-203c-444d-a1f7-a14c0eeb40e3 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:52.615067 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f65296-203c-444d-a1f7-a14c0eeb40e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:52.615345 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f65296-203c-444d-a1f7-a14c0eeb40e3 None admin] PATH_INFO: `/v3/services` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:52.616097 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f65296-203c-444d-a1f7-a14c0eeb40e3 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:52.616407 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f65296-203c-444d-a1f7-a14c0eeb40e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:52.617964 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f65296-203c-444d-a1f7-a14c0eeb40e3 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:52.628248 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 450/915] 10.222.0.86 () {56 vars in 1114 bytes} [Tue Jun 7 14:21:52 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:52.628248 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d84253-1318-44c1-a595-023686bf84eb None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:52.628248 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d84253-1318-44c1-a595-023686bf84eb None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:52.628248 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d84253-1318-44c1-a595-023686bf84eb None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:52.629655 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 451/916] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:21:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 07 14:21:52.631028 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d84253-1318-44c1-a595-023686bf84eb None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:52.653515 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67047b7f-670b-40e6-926d-df66818bcb11 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:52.685524 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:52.691071 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad84ee54-b2a6-463f-bffd-435f0ba6cd6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:52.697382 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad84ee54-b2a6-463f-bffd-435f0ba6cd6d None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:52.697382 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad84ee54-b2a6-463f-bffd-435f0ba6cd6d None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:52.697382 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad84ee54-b2a6-463f-bffd-435f0ba6cd6d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:52.697382 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad84ee54-b2a6-463f-bffd-435f0ba6cd6d None admin] RBAC: Adding query filter params (role.id=8639adefbbcc4029bf422565e1a299b7, scope.project.id=e429537b190c4c5ea7e1332ab044ca7a, user.id=d7b598c6a3f642ef9edc971ad3ebbe31) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:52.697382 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad84ee54-b2a6-463f-bffd-435f0ba6cd6d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:52.697382 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad84ee54-b2a6-463f-bffd-435f0ba6cd6d None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:52.701870 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 466/917] 10.222.0.86 () {56 vars in 1374 bytes} [Tue Jun 7 14:21:52 2022] GET /identity/v3/role_assignments?user.id=d7b598c6a3f642ef9edc971ad3ebbe31&scope.project.id=e429537b190c4c5ea7e1332ab044ca7a&role.id=8639adefbbcc4029bf422565e1a299b7 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:52.703003 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3557eeb4-5d81-4904-851f-e805744613e1 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:52.703366 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3557eeb4-5d81-4904-851f-e805744613e1 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:52.703814 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3557eeb4-5d81-4904-851f-e805744613e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:52.721935 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-3557eeb4-5d81-4904-851f-e805744613e1 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:21:52.723292 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-3557eeb4-5d81-4904-851f-e805744613e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:21:52.768264 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d84253-1318-44c1-a595-023686bf84eb None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:52.805659 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:52.808266 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 467/918] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:21:52 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 14:21:52.829455 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049cca80-bdf5-4787-a6d6-c1190753f41d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:52.830297 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049cca80-bdf5-4787-a6d6-c1190753f41d None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:52.830658 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049cca80-bdf5-4787-a6d6-c1190753f41d None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:52.831081 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049cca80-bdf5-4787-a6d6-c1190753f41d None admin] PATH_INFO: `/v3/services` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:52.831997 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049cca80-bdf5-4787-a6d6-c1190753f41d None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:52.832242 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3557eeb4-5d81-4904-851f-e805744613e1 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:52.832488 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049cca80-bdf5-4787-a6d6-c1190753f41d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:52.834415 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049cca80-bdf5-4787-a6d6-c1190753f41d None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:52.840953 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 452/919] 10.222.0.86 () {56 vars in 1114 bytes} [Tue Jun 7 14:21:52 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:52.849835 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049cca80-bdf5-4787-a6d6-c1190753f41d None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:52.966369 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049cca80-bdf5-4787-a6d6-c1190753f41d None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:52.978187 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3557eeb4-5d81-4904-851f-e805744613e1 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:53.008726 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e998f68-8cc4-4055-9e58-05cf335685ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:53.009801 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e998f68-8cc4-4055-9e58-05cf335685ff None admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:53.010566 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e998f68-8cc4-4055-9e58-05cf335685ff None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:53.011535 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e998f68-8cc4-4055-9e58-05cf335685ff None admin] PATH_INFO: `/v3/endpoints` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:53.012798 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e998f68-8cc4-4055-9e58-05cf335685ff None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:53.015068 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e998f68-8cc4-4055-9e58-05cf335685ff None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:53.016126 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:53.020810 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bdabc0-4f95-4e85-91bd-c786fa488ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:53.021930 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bdabc0-4f95-4e85-91bd-c786fa488ed2 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:53.022424 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bdabc0-4f95-4e85-91bd-c786fa488ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:53.022907 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bdabc0-4f95-4e85-91bd-c786fa488ed2 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:53.023984 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bdabc0-4f95-4e85-91bd-c786fa488ed2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:53.025820 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bdabc0-4f95-4e85-91bd-c786fa488ed2 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:53.039370 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-64bdabc0-4f95-4e85-91bd-c786fa488ed2 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 07 14:21:53.039370 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:53.039370 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 07 14:21:53.039370 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 07 14:21:53.039370 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 07 14:21:53.039370 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 07 14:21:53.039370 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 07 14:21:53.039370 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 14:21:53.039370 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 07 14:21:53.039370 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:21:53.039370 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 07 14:21:53.039370 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:21:53.039370 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:53.039370 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:53.039370 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:53.039370 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:53.040325 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:53.040325 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:53.040325 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:53.040325 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:53.040325 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:53.040325 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:53.040325 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:53.040325 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 07 14:21:53.040325 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 07 14:21:53.040325 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 07 14:21:53.040325 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 07 14:21:53.040325 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:53.040325 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:53.040325 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:53.040325 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:53.040325 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:53.041420 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:53.041420 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:53.041420 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:53.041420 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:53.041420 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:53.041420 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:53.041420 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:53.041420 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:53.041420 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:53.041420 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:53.041420 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:53.041420 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 07 14:21:53.041420 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 14:21:53.041420 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 07 14:21:53.041420 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:21:53.041420 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 468/920] 10.222.0.86 () {56 vars in 1132 bytes} [Tue Jun 7 14:21:52 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:21:53.046407 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bdabc0-4f95-4e85-91bd-c786fa488ed2 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:53.104442 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 453/921] 10.222.0.86 () {60 vars in 1144 bytes} [Tue Jun 7 14:21:52 2022] POST /identity/v3/endpoints => generated 346 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 14:21:53.165077 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bdabc0-4f95-4e85-91bd-c786fa488ed2 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:53.216112 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1557d8-a243-4317-b3a2-473fdc981ebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:53.217162 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1557d8-a243-4317-b3a2-473fdc981ebf None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:53.217681 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1557d8-a243-4317-b3a2-473fdc981ebf None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:53.218159 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1557d8-a243-4317-b3a2-473fdc981ebf None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:53.219087 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1557d8-a243-4317-b3a2-473fdc981ebf None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:53.219601 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1557d8-a243-4317-b3a2-473fdc981ebf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:53.221200 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1557d8-a243-4317-b3a2-473fdc981ebf None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:53.233945 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 469/922] 10.222.0.86 () {56 vars in 1126 bytes} [Tue Jun 7 14:21:53 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:21:53.239435 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e998f68-8cc4-4055-9e58-05cf335685ff None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:53.297621 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:53.358120 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e998f68-8cc4-4055-9e58-05cf335685ff None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:53.393234 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86476d4d-58b7-4078-b700-aefc59f581fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:53.393907 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86476d4d-58b7-4078-b700-aefc59f581fb None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:53.394191 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86476d4d-58b7-4078-b700-aefc59f581fb None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:53.394469 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86476d4d-58b7-4078-b700-aefc59f581fb None admin] PATH_INFO: `/v3/services` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:53.395179 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86476d4d-58b7-4078-b700-aefc59f581fb None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:53.395487 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86476d4d-58b7-4078-b700-aefc59f581fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:53.396903 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86476d4d-58b7-4078-b700-aefc59f581fb None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:53.402934 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 454/923] 10.222.0.86 () {56 vars in 1126 bytes} [Tue Jun 7 14:21:53 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:53.408617 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1557d8-a243-4317-b3a2-473fdc981ebf None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:53.464965 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:53.519498 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1557d8-a243-4317-b3a2-473fdc981ebf None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:53.559826 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f31e92c-4d7f-478d-9822-8f587b7d7530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:53.560412 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f31e92c-4d7f-478d-9822-8f587b7d7530 None admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:53.560699 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f31e92c-4d7f-478d-9822-8f587b7d7530 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:53.560975 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f31e92c-4d7f-478d-9822-8f587b7d7530 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:53.561729 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f31e92c-4d7f-478d-9822-8f587b7d7530 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:53.563188 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f31e92c-4d7f-478d-9822-8f587b7d7530 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:53.664755 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 470/924] 10.222.0.86 () {60 vars in 1144 bytes} [Tue Jun 7 14:21:53 2022] POST /identity/v3/endpoints => generated 347 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:21:54.455019 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fcb453-1be3-4dd5-aa61-03a69e5268d9 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:54.455535 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fcb453-1be3-4dd5-aa61-03a69e5268d9 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:54.455535 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fcb453-1be3-4dd5-aa61-03a69e5268d9 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:54.457261 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 455/925] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:21:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:21:54.462778 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f343b3e8-b16d-499e-9d14-e08d2edeb6d6 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:54.463066 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f343b3e8-b16d-499e-9d14-e08d2edeb6d6 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:54.463345 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f343b3e8-b16d-499e-9d14-e08d2edeb6d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:54.481046 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-f343b3e8-b16d-499e-9d14-e08d2edeb6d6 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:21:54.482153 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-f343b3e8-b16d-499e-9d14-e08d2edeb6d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:21:54.561184 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 471/926] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:21:54 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 14:21:54.583381 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fcb453-1be3-4dd5-aa61-03a69e5268d9 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:54.694057 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fcb453-1be3-4dd5-aa61-03a69e5268d9 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:54.705535 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:54.733395 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f60904-9738-42d2-8fe9-9dc4b8bc6b20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:54.734471 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f60904-9738-42d2-8fe9-9dc4b8bc6b20 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:54.734910 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f60904-9738-42d2-8fe9-9dc4b8bc6b20 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:54.735350 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f60904-9738-42d2-8fe9-9dc4b8bc6b20 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:54.736182 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f60904-9738-42d2-8fe9-9dc4b8bc6b20 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:54.737697 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f60904-9738-42d2-8fe9-9dc4b8bc6b20 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:54.750949 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-20f60904-9738-42d2-8fe9-9dc4b8bc6b20 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 07 14:21:54.750949 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:54.750949 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 07 14:21:54.750949 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 07 14:21:54.750949 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 07 14:21:54.750949 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 07 14:21:54.750949 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 07 14:21:54.750949 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 14:21:54.750949 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 07 14:21:54.750949 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:21:54.750949 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 07 14:21:54.750949 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:21:54.750949 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:54.750949 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:54.750949 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:54.750949 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:54.750949 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:54.752241 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:54.752241 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:54.752241 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:54.752241 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:54.752241 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:54.752241 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:54.752241 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 07 14:21:54.752241 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 07 14:21:54.752241 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 07 14:21:54.752241 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 07 14:21:54.752241 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:54.752241 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:54.752241 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:54.752241 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:54.752241 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:54.752241 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:54.753311 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:54.753311 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:54.753311 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:54.753311 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:54.753311 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:54.753311 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:54.753311 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:54.753311 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:54.753311 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:54.753311 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:54.753311 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 07 14:21:54.753311 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 14:21:54.753311 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 07 14:21:54.753311 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:21:54.755791 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 456/927] 10.222.0.86 () {56 vars in 1126 bytes} [Tue Jun 7 14:21:54 2022] GET /identity/v3/services/object-store => generated 93 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:21:54.761550 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f343b3e8-b16d-499e-9d14-e08d2edeb6d6 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:54.797396 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:54.873694 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f343b3e8-b16d-499e-9d14-e08d2edeb6d6 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:54.910108 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800132db-47a6-41da-832d-a6c4bda60ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:54.910777 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800132db-47a6-41da-832d-a6c4bda60ced None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:54.911060 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800132db-47a6-41da-832d-a6c4bda60ced None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:54.911332 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800132db-47a6-41da-832d-a6c4bda60ced None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:54.912071 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800132db-47a6-41da-832d-a6c4bda60ced None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:54.912376 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800132db-47a6-41da-832d-a6c4bda60ced None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:54.914057 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800132db-47a6-41da-832d-a6c4bda60ced None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:54.920042 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 472/928] 10.222.0.86 () {56 vars in 1122 bytes} [Tue Jun 7 14:21:54 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:54.925742 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f60904-9738-42d2-8fe9-9dc4b8bc6b20 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:55.029897 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f60904-9738-42d2-8fe9-9dc4b8bc6b20 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:55.048636 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b74f5d4-5bc5-4db0-978f-17ca647cfff2 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:55.048923 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b74f5d4-5bc5-4db0-978f-17ca647cfff2 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:55.049194 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b74f5d4-5bc5-4db0-978f-17ca647cfff2 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:55.050797 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 473/929] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:21:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:21:55.055726 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fbb032-ca16-4506-9438-6e72e96f774c None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:55.056050 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fbb032-ca16-4506-9438-6e72e96f774c None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:55.056329 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fbb032-ca16-4506-9438-6e72e96f774c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:55.065890 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd0872b-cdbb-4ea8-acb9-8205cc34fbbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:55.066551 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd0872b-cdbb-4ea8-acb9-8205cc34fbbc None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:55.066830 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd0872b-cdbb-4ea8-acb9-8205cc34fbbc None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:55.067105 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd0872b-cdbb-4ea8-acb9-8205cc34fbbc None admin] PATH_INFO: `/v3/services` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:55.067843 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd0872b-cdbb-4ea8-acb9-8205cc34fbbc None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:55.068274 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd0872b-cdbb-4ea8-acb9-8205cc34fbbc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:55.069634 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd0872b-cdbb-4ea8-acb9-8205cc34fbbc None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:55.074852 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-41fbb032-ca16-4506-9438-6e72e96f774c None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:21:55.076192 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-41fbb032-ca16-4506-9438-6e72e96f774c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:21:55.080233 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 457/930] 10.222.0.86 () {56 vars in 1122 bytes} [Tue Jun 7 14:21:54 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:55.081456 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd0872b-cdbb-4ea8-acb9-8205cc34fbbc None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:55.122376 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:55.155912 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 474/931] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:21:55 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 07 14:21:55.181899 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fbb032-ca16-4506-9438-6e72e96f774c None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:55.209250 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd0872b-cdbb-4ea8-acb9-8205cc34fbbc None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:55.215793 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:55.256225 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8cbd4b-fd9a-478e-9494-833a9ca7c4ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:55.257941 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8cbd4b-fd9a-478e-9494-833a9ca7c4ea None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:55.258448 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8cbd4b-fd9a-478e-9494-833a9ca7c4ea None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:55.259146 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8cbd4b-fd9a-478e-9494-833a9ca7c4ea None admin] PATH_INFO: `/v3/endpoints` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:55.260565 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8cbd4b-fd9a-478e-9494-833a9ca7c4ea None admin] RBAC: Adding query filter params (interface=public, service_id=e593beceff584b38bcac03863f4c7f1c, region_id=RegionOne) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:55.261881 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8cbd4b-fd9a-478e-9494-833a9ca7c4ea None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:55.264235 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8cbd4b-fd9a-478e-9494-833a9ca7c4ea None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:55.277187 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 458/932] 10.222.0.86 () {56 vars in 1251 bytes} [Tue Jun 7 14:21:55 2022] GET /identity/v3/endpoints?service_id=e593beceff584b38bcac03863f4c7f1c&interface=public®ion_id=RegionOne => generated 194 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:55.277926 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8cbd4b-fd9a-478e-9494-833a9ca7c4ea None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:55.314386 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fbb032-ca16-4506-9438-6e72e96f774c None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:55.355800 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f5fafc-157a-4540-b200-54baca2333e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:55.356716 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f5fafc-157a-4540-b200-54baca2333e8 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:55.357003 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f5fafc-157a-4540-b200-54baca2333e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:55.357279 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f5fafc-157a-4540-b200-54baca2333e8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:55.368323 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f5fafc-157a-4540-b200-54baca2333e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:21:55.377660 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-07f5fafc-157a-4540-b200-54baca2333e8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 07 14:21:55.377660 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:55.377660 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:55.377660 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:55.377660 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:55.377660 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:55.377660 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:55.377660 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:55.377660 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:55.377660 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:55.377660 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:55.377660 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:55.377660 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:21:55.377660 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:21:55.377660 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:21:55.377660 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:21:55.378640 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:21:55.378640 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:21:55.378640 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:21:55.378640 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:21:55.378640 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:55.378640 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:55.378640 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:55.378640 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:55.378640 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:55.378640 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:55.378640 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:55.378640 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:55.378640 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:55.378640 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:55.378640 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:55.378640 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:55.379453 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:55.379453 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:55.379453 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:55.379453 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:55.379453 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:21:55.379453 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:21:55.379453 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:21:55.379453 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:21:55.379453 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:21:55.379453 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:21:55.379453 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 07 14:21:55.379453 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:21:55.383883 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 475/933] 10.222.0.86 () {56 vars in 1120 bytes} [Tue Jun 7 14:21:55 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:21:55.384839 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f5fafc-157a-4540-b200-54baca2333e8 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:55.405636 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:55.409081 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8cbd4b-fd9a-478e-9494-833a9ca7c4ea None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:55.452904 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c981a05f-bca3-4f8a-afa0-5860138e4dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:55.454144 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c981a05f-bca3-4f8a-afa0-5860138e4dfa None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:55.454607 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c981a05f-bca3-4f8a-afa0-5860138e4dfa None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:55.455195 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c981a05f-bca3-4f8a-afa0-5860138e4dfa None admin] PATH_INFO: `/v3/services` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:55.456580 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c981a05f-bca3-4f8a-afa0-5860138e4dfa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:55.457955 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c981a05f-bca3-4f8a-afa0-5860138e4dfa None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:55.473838 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 459/934] 10.222.0.86 () {56 vars in 1087 bytes} [Tue Jun 7 14:21:55 2022] GET /identity/v3/services => generated 1497 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 07 14:21:55.485210 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:55.504224 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f5fafc-157a-4540-b200-54baca2333e8 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:55.548523 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5485fd67-0283-44e3-8abe-5a4a1021a816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:55.549214 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5485fd67-0283-44e3-8abe-5a4a1021a816 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:55.549503 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5485fd67-0283-44e3-8abe-5a4a1021a816 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:55.549779 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5485fd67-0283-44e3-8abe-5a4a1021a816 None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:55.550552 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5485fd67-0283-44e3-8abe-5a4a1021a816 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:55.550862 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5485fd67-0283-44e3-8abe-5a4a1021a816 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:55.552389 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5485fd67-0283-44e3-8abe-5a4a1021a816 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:55.561852 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 476/935] 10.222.0.86 () {56 vars in 1115 bytes} [Tue Jun 7 14:21:55 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:55.567909 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c981a05f-bca3-4f8a-afa0-5860138e4dfa None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:55.617401 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec34426e-69f2-431b-bf3b-68b5c2529222 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:55.617693 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec34426e-69f2-431b-bf3b-68b5c2529222 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:55.617975 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec34426e-69f2-431b-bf3b-68b5c2529222 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:55.621505 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 477/936] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:21:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:21:55.625905 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98db6f09-3792-40dc-a632-a7685d94f236 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:55.626197 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98db6f09-3792-40dc-a632-a7685d94f236 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:55.626473 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98db6f09-3792-40dc-a632-a7685d94f236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:55.647243 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-98db6f09-3792-40dc-a632-a7685d94f236 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:21:55.648948 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-98db6f09-3792-40dc-a632-a7685d94f236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:21:55.700028 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c981a05f-bca3-4f8a-afa0-5860138e4dfa None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:55.739233 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb19a4c-c1e3-4a66-9615-e1bfc38b7f52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:55.739967 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 478/937] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:21:55 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 07 14:21:55.740183 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb19a4c-c1e3-4a66-9615-e1bfc38b7f52 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:55.740448 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb19a4c-c1e3-4a66-9615-e1bfc38b7f52 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:55.740731 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb19a4c-c1e3-4a66-9615-e1bfc38b7f52 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:55.752535 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb19a4c-c1e3-4a66-9615-e1bfc38b7f52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:55.753990 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb19a4c-c1e3-4a66-9615-e1bfc38b7f52 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:55.765561 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98db6f09-3792-40dc-a632-a7685d94f236 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:55.772323 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-1fb19a4c-c1e3-4a66-9615-e1bfc38b7f52 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:21:55.772323 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:55.772323 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:55.772323 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:55.772323 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:55.772323 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:55.772323 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:55.772323 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:55.772323 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:55.772323 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:55.772323 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:55.772323 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:55.772323 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:21:55.772323 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:21:55.772323 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:21:55.773204 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:21:55.773204 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:55.773204 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:55.773204 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:55.773204 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:55.773204 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:55.773204 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:55.773204 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:55.773204 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:55.773204 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:55.773204 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:55.773204 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:55.773204 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:55.773204 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:55.773204 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:55.773204 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:55.773204 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:55.774105 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:21:55.774105 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:21:55.774105 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:21:55.774105 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:21:55.778380 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 460/938] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jun 7 14:21:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:21:55.779458 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb19a4c-c1e3-4a66-9615-e1bfc38b7f52 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:55.799841 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:55.859864 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:55.887912 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98db6f09-3792-40dc-a632-a7685d94f236 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:55.909177 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb19a4c-c1e3-4a66-9615-e1bfc38b7f52 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:55.931549 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc441ec-b1ce-4688-b872-dd4371cc4229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:55.932360 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc441ec-b1ce-4688-b872-dd4371cc4229 None admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:55.933278 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc441ec-b1ce-4688-b872-dd4371cc4229 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:55.933636 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc441ec-b1ce-4688-b872-dd4371cc4229 None admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:55.934636 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc441ec-b1ce-4688-b872-dd4371cc4229 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:55.936492 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc441ec-b1ce-4688-b872-dd4371cc4229 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:55.938074 dv-cinder-844974-1-smb devstack@keystone.service[80419]: WARNING keystone.server.flask.common [None req-5fc441ec-b1ce-4688-b872-dd4371cc4229 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 07 14:21:55.955151 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11ff950-076e-4e4f-9b4a-92cd579228e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:55.956405 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11ff950-076e-4e4f-9b4a-92cd579228e9 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:55.956722 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11ff950-076e-4e4f-9b4a-92cd579228e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:55.956981 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11ff950-076e-4e4f-9b4a-92cd579228e9 None admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:55.957720 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11ff950-076e-4e4f-9b4a-92cd579228e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:55.958035 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11ff950-076e-4e4f-9b4a-92cd579228e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:55.960055 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11ff950-076e-4e4f-9b4a-92cd579228e9 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:55.977078 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 461/939] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jun 7 14:21:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:21:55.978441 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11ff950-076e-4e4f-9b4a-92cd579228e9 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:55.990638 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.sql.core [None req-5fc441ec-b1ce-4688-b872-dd4371cc4229 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 07 14:21:55.990638 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 07 14:21:55.990638 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [parameters: {'id': 'b228d920901a447b8e56a3389f3beaa9', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 07 14:21:55.990638 dv-cinder-844974-1-smb devstack@keystone.service[80419]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80419) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 07 14:21:55.999966 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-5fc441ec-b1ce-4688-b872-dd4371cc4229 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b228d920901a447b8e56a3389f3beaa9.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b228d920901a447b8e56a3389f3beaa9. Jun 07 14:21:55.999966 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:55.999966 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 07 14:21:55.999966 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 07 14:21:55.999966 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 07 14:21:55.999966 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 07 14:21:55.999966 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 07 14:21:55.999966 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application result = self._query(query) Jun 07 14:21:55.999966 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 07 14:21:55.999966 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application conn.query(q) Jun 07 14:21:55.999966 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 07 14:21:55.999966 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 07 14:21:55.999966 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 07 14:21:56.000768 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application result.read() Jun 07 14:21:56.000768 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 07 14:21:56.000768 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 07 14:21:56.000768 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 07 14:21:56.000768 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 07 14:21:56.000768 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 07 14:21:56.000768 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 07 14:21:56.000768 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 07 14:21:56.000768 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 07 14:21:56.000768 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 07 14:21:56.000768 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:21:56.000768 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 07 14:21:56.000768 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:21:56.000768 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:56.000768 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 07 14:21:56.000768 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 07 14:21:56.000768 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 07 14:21:56.000768 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 07 14:21:56.001696 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 07 14:21:56.001696 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application next(self.gen) Jun 07 14:21:56.001696 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 07 14:21:56.001696 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application yield resource Jun 07 14:21:56.001696 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 07 14:21:56.001696 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application next(self.gen) Jun 07 14:21:56.001696 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 07 14:21:56.001696 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self.session.rollback() Jun 07 14:21:56.001696 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 07 14:21:56.001696 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self.force_reraise() Jun 07 14:21:56.001696 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 07 14:21:56.001696 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise self.value Jun 07 14:21:56.001696 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 07 14:21:56.001696 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 07 14:21:56.001696 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 07 14:21:56.001696 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application session.commit() Jun 07 14:21:56.001696 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 07 14:21:56.002569 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 07 14:21:56.002569 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 07 14:21:56.002569 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self._prepare_impl() Jun 07 14:21:56.002569 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 07 14:21:56.002569 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self.session.flush() Jun 07 14:21:56.002569 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 07 14:21:56.002569 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self._flush(objects) Jun 07 14:21:56.002569 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 07 14:21:56.002569 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 07 14:21:56.002569 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 07 14:21:56.002569 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application compat.raise_( Jun 07 14:21:56.002569 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 07 14:21:56.002569 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception Jun 07 14:21:56.002569 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 07 14:21:56.002569 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application flush_context.execute() Jun 07 14:21:56.002569 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 07 14:21:56.002569 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rec.execute(self) Jun 07 14:21:56.003455 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 07 14:21:56.003455 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 07 14:21:56.003455 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 07 14:21:56.003455 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 07 14:21:56.003455 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 07 14:21:56.003455 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 07 14:21:56.003455 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 07 14:21:56.003455 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 07 14:21:56.003455 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 07 14:21:56.003455 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 07 14:21:56.003455 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 07 14:21:56.003455 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 07 14:21:56.003455 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 07 14:21:56.003455 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 07 14:21:56.003455 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 07 14:21:56.004277 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 07 14:21:56.004277 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 07 14:21:56.004277 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception Jun 07 14:21:56.004277 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 07 14:21:56.004277 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 07 14:21:56.004277 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 07 14:21:56.004277 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 07 14:21:56.004277 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 07 14:21:56.004277 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application result = self._query(query) Jun 07 14:21:56.004277 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 07 14:21:56.004277 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application conn.query(q) Jun 07 14:21:56.004277 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 07 14:21:56.004277 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 07 14:21:56.004277 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 07 14:21:56.004277 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application result.read() Jun 07 14:21:56.004277 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 07 14:21:56.004277 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 07 14:21:56.005117 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 07 14:21:56.005117 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 07 14:21:56.005117 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 07 14:21:56.005117 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 07 14:21:56.005117 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 07 14:21:56.005117 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 07 14:21:56.005117 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 07 14:21:56.005117 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 07 14:21:56.005117 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [parameters: {'id': 'b228d920901a447b8e56a3389f3beaa9', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 07 14:21:56.005117 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 07 14:21:56.005117 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:21:56.005117 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 07 14:21:56.005117 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:21:56.005117 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:56.005117 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 07 14:21:56.005889 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 07 14:21:56.005889 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 07 14:21:56.005889 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 07 14:21:56.005889 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 07 14:21:56.005889 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:21:56.005889 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 07 14:21:56.005889 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:21:56.005889 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:56.005889 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:56.005889 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:56.005889 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:56.005889 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:56.005889 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:56.005889 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:56.005889 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:56.005889 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:56.005889 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:56.006794 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:56.006794 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 07 14:21:56.006794 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 07 14:21:56.006794 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:56.006794 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:56.006794 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 07 14:21:56.006794 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 07 14:21:56.006794 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b228d920901a447b8e56a3389f3beaa9. Jun 07 14:21:56.006794 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:21:56.006794 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 479/940] 10.222.0.86 () {60 vars in 1140 bytes} [Tue Jun 7 14:21:55 2022] POST /identity/v3/projects => generated 262 bytes in 236 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 07 14:21:56.006794 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e39741f-806b-40b3-93e2-1e20f07813a6 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:56.006794 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e39741f-806b-40b3-93e2-1e20f07813a6 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:56.007439 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e39741f-806b-40b3-93e2-1e20f07813a6 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:56.009115 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 480/941] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:21:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:21:56.009115 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e39741f-806b-40b3-93e2-1e20f07813a6 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:56.075976 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:56.102086 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11ff950-076e-4e4f-9b4a-92cd579228e9 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:56.120600 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e39741f-806b-40b3-93e2-1e20f07813a6 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:56.143514 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d907f67-8117-4390-bbf0-4a63f90b5a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:56.144354 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d907f67-8117-4390-bbf0-4a63f90b5a6f None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:56.144641 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d907f67-8117-4390-bbf0-4a63f90b5a6f None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:56.144920 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d907f67-8117-4390-bbf0-4a63f90b5a6f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:56.151891 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:56.152496 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d907f67-8117-4390-bbf0-4a63f90b5a6f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:56.153837 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d907f67-8117-4390-bbf0-4a63f90b5a6f None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:56.157393 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96665205-f703-49e1-a9fb-ede0f1deef6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:56.158212 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96665205-f703-49e1-a9fb-ede0f1deef6e None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:56.158499 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96665205-f703-49e1-a9fb-ede0f1deef6e None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:56.158776 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96665205-f703-49e1-a9fb-ede0f1deef6e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:56.165843 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96665205-f703-49e1-a9fb-ede0f1deef6e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:56.168079 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96665205-f703-49e1-a9fb-ede0f1deef6e None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:56.170683 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-2d907f67-8117-4390-bbf0-4a63f90b5a6f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 07 14:21:56.170683 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:56.170683 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:56.170683 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:56.170683 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:56.170683 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:56.170683 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:56.170683 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:56.170683 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:56.170683 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:56.170683 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:56.170683 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:56.170683 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 14:21:56.170683 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 14:21:56.170683 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 14:21:56.170683 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 14:21:56.171618 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:56.171618 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:56.171618 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 14:21:56.171618 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:21:56.171618 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 14:21:56.171618 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:21:56.171618 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:56.171618 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:56.171618 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:56.171618 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:56.171618 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:56.171618 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:56.171618 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:56.171618 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:56.171618 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:56.171618 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:56.171618 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:56.171618 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:56.173317 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:56.173317 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:56.173317 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 14:21:56.173317 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 14:21:56.173317 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 14:21:56.173317 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 14:21:56.173317 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 14:21:56.173317 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 14:21:56.173317 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 07 14:21:56.173317 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:21:56.173317 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 462/942] 10.222.0.86 () {56 vars in 1117 bytes} [Tue Jun 7 14:21:55 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 14:21:56.173906 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b63e3c-0e7e-4ea2-97ef-d44ed1e63a74 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:56.173906 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b63e3c-0e7e-4ea2-97ef-d44ed1e63a74 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:56.173906 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b63e3c-0e7e-4ea2-97ef-d44ed1e63a74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:56.188930 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-96665205-f703-49e1-a9fb-ede0f1deef6e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:21:56.188930 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:56.188930 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:56.188930 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:56.188930 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:56.188930 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:56.188930 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:56.188930 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:56.188930 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:56.188930 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:56.188930 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:56.188930 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:56.188930 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 14:21:56.188930 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 14:21:56.188930 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 14:21:56.189837 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 14:21:56.189837 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:56.189837 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:56.189837 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:56.189837 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:56.189837 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:56.189837 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:56.189837 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:56.189837 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:56.189837 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:56.189837 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:56.189837 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:56.189837 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:56.189837 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:56.189837 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:56.189837 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:56.189837 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:56.190727 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 14:21:56.190727 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 14:21:56.190727 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 14:21:56.190727 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 14:21:56.190727 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 14:21:56.190727 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 14:21:56.190727 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:21:56.190727 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:21:56.191152 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-47b63e3c-0e7e-4ea2-97ef-d44ed1e63a74 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:21:56.191233 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 481/943] 10.222.0.86 () {56 vars in 1111 bytes} [Tue Jun 7 14:21:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:21:56.192021 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96665205-f703-49e1-a9fb-ede0f1deef6e None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:56.196754 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-47b63e3c-0e7e-4ea2-97ef-d44ed1e63a74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:21:56.276554 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 463/944] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:21:56 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 14:21:56.277458 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b63e3c-0e7e-4ea2-97ef-d44ed1e63a74 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:56.298526 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96665205-f703-49e1-a9fb-ede0f1deef6e None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:56.334097 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a416cac-6acf-4f23-8750-931fdc77ee18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:56.335044 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a416cac-6acf-4f23-8750-931fdc77ee18 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:56.335325 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a416cac-6acf-4f23-8750-931fdc77ee18 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:56.335598 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a416cac-6acf-4f23-8750-931fdc77ee18 None admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:56.336941 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a416cac-6acf-4f23-8750-931fdc77ee18 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:56.337269 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a416cac-6acf-4f23-8750-931fdc77ee18 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:56.338713 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a416cac-6acf-4f23-8750-931fdc77ee18 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:56.355896 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:56.356176 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 482/945] 10.222.0.86 () {56 vars in 1149 bytes} [Tue Jun 7 14:21:56 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:56.357045 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a416cac-6acf-4f23-8750-931fdc77ee18 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:56.396381 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b63e3c-0e7e-4ea2-97ef-d44ed1e63a74 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:56.409129 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:56.435674 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cb7593-7f11-45bb-a017-f4eee6791b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:56.436363 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cb7593-7f11-45bb-a017-f4eee6791b0b None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:56.436648 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cb7593-7f11-45bb-a017-f4eee6791b0b None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:56.436923 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cb7593-7f11-45bb-a017-f4eee6791b0b None admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:56.438031 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cb7593-7f11-45bb-a017-f4eee6791b0b None admin] RBAC: Adding query filter params (name=service) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:56.438341 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cb7593-7f11-45bb-a017-f4eee6791b0b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:56.440511 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cb7593-7f11-45bb-a017-f4eee6791b0b None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:56.458914 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 464/946] 10.222.0.86 () {56 vars in 1112 bytes} [Tue Jun 7 14:21:56 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:56.460013 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cb7593-7f11-45bb-a017-f4eee6791b0b None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:56.473508 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a416cac-6acf-4f23-8750-931fdc77ee18 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:56.520564 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6552c302-7816-4e1e-98f7-be4ac89d23cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:56.521484 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6552c302-7816-4e1e-98f7-be4ac89d23cf None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:56.521842 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6552c302-7816-4e1e-98f7-be4ac89d23cf None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:56.522191 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6552c302-7816-4e1e-98f7-be4ac89d23cf None admin] PATH_INFO: `/v3/services/compute` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:56.522935 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6552c302-7816-4e1e-98f7-be4ac89d23cf None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:56.525238 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6552c302-7816-4e1e-98f7-be4ac89d23cf None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:56.543136 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-6552c302-7816-4e1e-98f7-be4ac89d23cf None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 07 14:21:56.543136 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:56.543136 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 07 14:21:56.543136 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 07 14:21:56.543136 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 07 14:21:56.543136 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 07 14:21:56.543136 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 07 14:21:56.543136 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 14:21:56.543136 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 07 14:21:56.543136 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:21:56.543136 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 07 14:21:56.543136 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:21:56.543136 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:56.543136 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:56.543136 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:56.543136 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:56.543136 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:56.544294 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:56.544294 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:56.544294 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:56.544294 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:56.544294 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:56.544294 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:56.544294 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 07 14:21:56.544294 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 07 14:21:56.544294 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 07 14:21:56.544294 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 07 14:21:56.544294 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:56.544294 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:56.544294 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:56.544294 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:56.544294 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:56.544294 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:56.545154 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:56.545154 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:56.545154 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:56.545154 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:56.545154 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:56.545154 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:56.545154 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:56.545154 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:56.545154 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:56.545154 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:56.545154 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 07 14:21:56.545154 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 14:21:56.545154 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 07 14:21:56.545154 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:21:56.545154 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 483/947] 10.222.0.86 () {56 vars in 1111 bytes} [Tue Jun 7 14:21:56 2022] GET /identity/v3/services/compute => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:21:56.550834 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6552c302-7816-4e1e-98f7-be4ac89d23cf None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:56.585173 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cb7593-7f11-45bb-a017-f4eee6791b0b None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:56.617095 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:56.627676 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5609c08-3417-44b3-9681-3c8eded2f093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:56.628917 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5609c08-3417-44b3-9681-3c8eded2f093 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:56.629441 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5609c08-3417-44b3-9681-3c8eded2f093 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:56.629931 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5609c08-3417-44b3-9681-3c8eded2f093 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:56.642676 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5609c08-3417-44b3-9681-3c8eded2f093 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:56.644337 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5609c08-3417-44b3-9681-3c8eded2f093 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:56.664884 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-a5609c08-3417-44b3-9681-3c8eded2f093 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:21:56.664884 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:56.664884 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:56.664884 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:56.664884 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:56.664884 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:56.664884 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:56.664884 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:56.664884 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:56.664884 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:56.664884 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:56.664884 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:56.664884 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:21:56.664884 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:21:56.664884 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:21:56.665822 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:21:56.665822 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:56.665822 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:56.665822 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:56.665822 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:56.665822 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:56.665822 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:56.665822 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:56.665822 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:56.665822 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:56.665822 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:56.665822 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:56.665822 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:56.665822 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:56.665822 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:56.665822 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:56.665822 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:56.666697 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:21:56.666697 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:21:56.666697 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:21:56.666697 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:21:56.669734 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6552c302-7816-4e1e-98f7-be4ac89d23cf None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:56.671938 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 465/948] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jun 7 14:21:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:21:56.673451 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5609c08-3417-44b3-9681-3c8eded2f093 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:56.694387 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:56.719202 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c922b6c1-f870-4fc7-aaa5-201d36e09b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:56.720197 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c922b6c1-f870-4fc7-aaa5-201d36e09b2a None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:56.720543 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c922b6c1-f870-4fc7-aaa5-201d36e09b2a None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:56.720829 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c922b6c1-f870-4fc7-aaa5-201d36e09b2a None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:56.721901 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c922b6c1-f870-4fc7-aaa5-201d36e09b2a None admin] RBAC: Adding query filter params (name=compute) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:56.721901 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c922b6c1-f870-4fc7-aaa5-201d36e09b2a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:56.724600 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c922b6c1-f870-4fc7-aaa5-201d36e09b2a None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:56.729244 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 484/949] 10.222.0.86 () {56 vars in 1112 bytes} [Tue Jun 7 14:21:56 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:56.735875 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c922b6c1-f870-4fc7-aaa5-201d36e09b2a None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:56.799739 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5609c08-3417-44b3-9681-3c8eded2f093 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:56.837340 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92c4f01-bd7e-428f-943a-547adea32279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:56.838350 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92c4f01-bd7e-428f-943a-547adea32279 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:56.839425 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92c4f01-bd7e-428f-943a-547adea32279 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:56.839914 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92c4f01-bd7e-428f-943a-547adea32279 None admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:56.840918 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92c4f01-bd7e-428f-943a-547adea32279 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:56.841409 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92c4f01-bd7e-428f-943a-547adea32279 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:56.843022 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92c4f01-bd7e-428f-943a-547adea32279 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:56.856167 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 466/950] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jun 7 14:21:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:56.862365 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92c4f01-bd7e-428f-943a-547adea32279 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:56.865832 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c922b6c1-f870-4fc7-aaa5-201d36e09b2a None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:56.902856 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7491cad0-f665-43f4-ac54-d6c65c42d79c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:56.903593 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7491cad0-f665-43f4-ac54-d6c65c42d79c None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:56.903911 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7491cad0-f665-43f4-ac54-d6c65c42d79c None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:56.904192 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7491cad0-f665-43f4-ac54-d6c65c42d79c None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:56.904957 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7491cad0-f665-43f4-ac54-d6c65c42d79c None admin] RBAC: Adding query filter params (type=compute) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:56.905269 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7491cad0-f665-43f4-ac54-d6c65c42d79c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:56.906640 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7491cad0-f665-43f4-ac54-d6c65c42d79c None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:56.919654 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 485/951] 10.222.0.86 () {56 vars in 1112 bytes} [Tue Jun 7 14:21:56 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:56.922896 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:56.986894 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92c4f01-bd7e-428f-943a-547adea32279 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:57.025168 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605cae70-ae7a-42a3-a588-40d1aa6c0e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:57.025988 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605cae70-ae7a-42a3-a588-40d1aa6c0e8d None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:57.026311 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605cae70-ae7a-42a3-a588-40d1aa6c0e8d None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:57.026591 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605cae70-ae7a-42a3-a588-40d1aa6c0e8d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:57.034300 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605cae70-ae7a-42a3-a588-40d1aa6c0e8d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:57.035790 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605cae70-ae7a-42a3-a588-40d1aa6c0e8d None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:57.051592 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-605cae70-ae7a-42a3-a588-40d1aa6c0e8d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:21:57.051592 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:57.051592 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:57.051592 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:57.051592 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:57.051592 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:57.051592 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:57.051592 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:57.051592 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:57.051592 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:57.051592 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:57.051592 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:57.051592 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 14:21:57.051592 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 14:21:57.051592 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 14:21:57.052644 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 14:21:57.052644 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:57.052644 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:57.052644 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:57.052644 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:57.052644 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:57.052644 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:57.052644 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:57.052644 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:57.052644 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:57.052644 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:57.052644 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:57.052644 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:57.052644 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:57.052644 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:57.052644 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:57.052644 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:57.053916 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 14:21:57.053916 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 14:21:57.053916 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 14:21:57.053916 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 14:21:57.053916 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 14:21:57.053916 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 14:21:57.053916 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:21:57.053916 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:21:57.053916 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 467/952] 10.222.0.86 () {56 vars in 1111 bytes} [Tue Jun 7 14:21:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:21:57.061091 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7491cad0-f665-43f4-ac54-d6c65c42d79c None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:57.111049 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:57.179110 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7491cad0-f665-43f4-ac54-d6c65c42d79c None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:57.220940 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad84f6d-9bd1-49da-921d-e99d80d63ca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:57.221602 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad84f6d-9bd1-49da-921d-e99d80d63ca4 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:57.221883 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad84f6d-9bd1-49da-921d-e99d80d63ca4 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:57.222153 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad84f6d-9bd1-49da-921d-e99d80d63ca4 None admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:57.222934 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad84f6d-9bd1-49da-921d-e99d80d63ca4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:57.223238 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad84f6d-9bd1-49da-921d-e99d80d63ca4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:57.224678 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad84f6d-9bd1-49da-921d-e99d80d63ca4 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:57.238566 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 486/953] 10.222.0.86 () {56 vars in 1148 bytes} [Tue Jun 7 14:21:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:57.244476 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605cae70-ae7a-42a3-a588-40d1aa6c0e8d None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:57.346024 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:57.350276 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605cae70-ae7a-42a3-a588-40d1aa6c0e8d None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:57.386441 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b603b9b-c3d1-45d3-b44e-f440b99b6a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:57.387340 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b603b9b-c3d1-45d3-b44e-f440b99b6a30 None admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:57.387629 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b603b9b-c3d1-45d3-b44e-f440b99b6a30 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:57.387936 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b603b9b-c3d1-45d3-b44e-f440b99b6a30 None admin] PATH_INFO: `/v3/projects/e429537b190c4c5ea7e1332ab044ca7a/users/d7b598c6a3f642ef9edc971ad3ebbe31/roles/8639adefbbcc4029bf422565e1a299b7` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:57.390242 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b603b9b-c3d1-45d3-b44e-f440b99b6a30 None admin] RBAC: Authorizing `identity:create_grant(project_id=e429537b190c4c5ea7e1332ab044ca7a, user_id=d7b598c6a3f642ef9edc971ad3ebbe31, role_id=8639adefbbcc4029bf422565e1a299b7)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:57.391676 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b603b9b-c3d1-45d3-b44e-f440b99b6a30 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:57.484858 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 468/954] 10.222.0.86 () {58 vars in 1439 bytes} [Tue Jun 7 14:21:57 2022] PUT /identity/v3/projects/e429537b190c4c5ea7e1332ab044ca7a/users/d7b598c6a3f642ef9edc971ad3ebbe31/roles/8639adefbbcc4029bf422565e1a299b7 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:21:57.840586 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960295b1-d23f-4147-beeb-2be52063eefe None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:57.840973 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960295b1-d23f-4147-beeb-2be52063eefe None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:57.841166 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960295b1-d23f-4147-beeb-2be52063eefe None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:57.842795 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 487/955] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:21:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:21:57.848288 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3638a057-1729-4eaf-831d-63d4f45076c0 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:57.848584 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3638a057-1729-4eaf-831d-63d4f45076c0 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:57.848869 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3638a057-1729-4eaf-831d-63d4f45076c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:57.866644 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-3638a057-1729-4eaf-831d-63d4f45076c0 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:21:57.869396 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-3638a057-1729-4eaf-831d-63d4f45076c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:21:57.944538 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 469/956] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:21:57 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 14:21:57.966966 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960295b1-d23f-4147-beeb-2be52063eefe None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:58.069359 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960295b1-d23f-4147-beeb-2be52063eefe None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:58.070905 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:58.104126 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90bcb65-80f4-4530-bc0e-f7e4a6b33994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:58.105950 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90bcb65-80f4-4530-bc0e-f7e4a6b33994 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:58.106596 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90bcb65-80f4-4530-bc0e-f7e4a6b33994 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:58.106879 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90bcb65-80f4-4530-bc0e-f7e4a6b33994 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:58.107545 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90bcb65-80f4-4530-bc0e-f7e4a6b33994 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:58.110464 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90bcb65-80f4-4530-bc0e-f7e4a6b33994 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:58.124109 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-d90bcb65-80f4-4530-bc0e-f7e4a6b33994 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 07 14:21:58.124109 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:58.124109 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 07 14:21:58.124109 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 07 14:21:58.124109 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 07 14:21:58.124109 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 07 14:21:58.124109 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 07 14:21:58.124109 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 14:21:58.124109 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 07 14:21:58.124109 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:21:58.124109 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 07 14:21:58.124109 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:21:58.124109 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:58.124109 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:58.124109 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:58.124109 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:58.124109 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:58.125128 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:58.125128 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:58.125128 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:58.125128 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:58.125128 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:58.125128 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:58.125128 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 07 14:21:58.125128 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 07 14:21:58.125128 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 07 14:21:58.125128 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 07 14:21:58.125128 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:58.125128 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:58.125128 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:58.125128 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:58.125128 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:58.125128 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:58.125977 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:58.125977 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:58.125977 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:58.125977 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:58.125977 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:58.125977 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:58.125977 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:58.125977 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:58.125977 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:58.125977 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:58.125977 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 07 14:21:58.125977 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 14:21:58.125977 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 07 14:21:58.125977 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:21:58.125977 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 488/957] 10.222.0.86 () {56 vars in 1126 bytes} [Tue Jun 7 14:21:57 2022] GET /identity/v3/services/object-store => generated 93 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:21:58.131706 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3638a057-1729-4eaf-831d-63d4f45076c0 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:58.237121 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:58.243849 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3638a057-1729-4eaf-831d-63d4f45076c0 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:58.280940 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff348c54-81dd-4f15-9586-e6209da340ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:58.281607 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff348c54-81dd-4f15-9586-e6209da340ff None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:58.281896 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff348c54-81dd-4f15-9586-e6209da340ff None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:58.282172 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff348c54-81dd-4f15-9586-e6209da340ff None admin] PATH_INFO: `/v3/services` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:58.282891 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff348c54-81dd-4f15-9586-e6209da340ff None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:58.283200 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff348c54-81dd-4f15-9586-e6209da340ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:58.284601 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff348c54-81dd-4f15-9586-e6209da340ff None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:58.290435 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 470/958] 10.222.0.86 () {56 vars in 1122 bytes} [Tue Jun 7 14:21:58 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:58.296267 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90bcb65-80f4-4530-bc0e-f7e4a6b33994 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:58.402903 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90bcb65-80f4-4530-bc0e-f7e4a6b33994 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:58.437884 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16db79e-65a2-4327-a612-4434b7de887d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:58.438550 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16db79e-65a2-4327-a612-4434b7de887d None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:58.438835 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16db79e-65a2-4327-a612-4434b7de887d None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:58.439110 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16db79e-65a2-4327-a612-4434b7de887d None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:58.439842 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16db79e-65a2-4327-a612-4434b7de887d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:58.440152 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16db79e-65a2-4327-a612-4434b7de887d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:58.441512 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16db79e-65a2-4327-a612-4434b7de887d None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:58.446845 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 489/959] 10.222.0.86 () {56 vars in 1122 bytes} [Tue Jun 7 14:21:58 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:21:58.452131 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff348c54-81dd-4f15-9586-e6209da340ff None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:58.558222 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff348c54-81dd-4f15-9586-e6209da340ff None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:58.596425 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be12461-6212-47be-931a-fbf47cc79149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:58.597101 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be12461-6212-47be-931a-fbf47cc79149 None admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:58.597384 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be12461-6212-47be-931a-fbf47cc79149 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:58.597658 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be12461-6212-47be-931a-fbf47cc79149 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:58.598428 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be12461-6212-47be-931a-fbf47cc79149 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:58.599814 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be12461-6212-47be-931a-fbf47cc79149 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:58.687408 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 471/960] 10.222.0.86 () {60 vars in 1144 bytes} [Tue Jun 7 14:21:58 2022] POST /identity/v3/endpoints => generated 349 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:21:58.915574 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65c2fc2-afd5-4bcd-a601-016f98a2c7bc None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:58.915965 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65c2fc2-afd5-4bcd-a601-016f98a2c7bc None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:58.916208 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65c2fc2-afd5-4bcd-a601-016f98a2c7bc None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:58.917707 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 490/961] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:21:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:21:58.923197 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff3a96-c5a1-4358-b016-d7c3e8e28af1 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:58.923486 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff3a96-c5a1-4358-b016-d7c3e8e28af1 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:58.923782 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff3a96-c5a1-4358-b016-d7c3e8e28af1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:58.941350 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-19ff3a96-c5a1-4358-b016-d7c3e8e28af1 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:21:58.942862 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-19ff3a96-c5a1-4358-b016-d7c3e8e28af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:21:58.945316 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:59.022086 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 472/962] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:21:58 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 14:21:59.047704 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65c2fc2-afd5-4bcd-a601-016f98a2c7bc None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:59.082697 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:59.155674 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65c2fc2-afd5-4bcd-a601-016f98a2c7bc None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:59.191208 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6fc01a-e3e1-4dc2-8920-8cae1d80f671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:59.191984 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6fc01a-e3e1-4dc2-8920-8cae1d80f671 None admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:59.192213 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6fc01a-e3e1-4dc2-8920-8cae1d80f671 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:59.192493 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6fc01a-e3e1-4dc2-8920-8cae1d80f671 None admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:59.193212 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6fc01a-e3e1-4dc2-8920-8cae1d80f671 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:59.194629 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6fc01a-e3e1-4dc2-8920-8cae1d80f671 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:59.273611 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.sql.core [None req-5c6fc01a-e3e1-4dc2-8920-8cae1d80f671 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 07 14:21:59.273611 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 07 14:21:59.273611 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [parameters: {'user_id': '669cbf39d3a24818a248f3e7e190eb0a', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 07 14:21:59.273611 dv-cinder-844974-1-smb devstack@keystone.service[80419]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80419) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 07 14:21:59.281565 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-5c6fc01a-e3e1-4dc2-8920-8cae1d80f671 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 07 14:21:59.281565 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:59.281565 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 07 14:21:59.281565 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 07 14:21:59.281565 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 07 14:21:59.281565 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 07 14:21:59.281565 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 07 14:21:59.281565 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application result = self._query(query) Jun 07 14:21:59.281565 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 07 14:21:59.281565 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application conn.query(q) Jun 07 14:21:59.281565 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 07 14:21:59.281565 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 07 14:21:59.281565 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 07 14:21:59.281565 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application result.read() Jun 07 14:21:59.281565 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 07 14:21:59.282416 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 07 14:21:59.282416 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 07 14:21:59.282416 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 07 14:21:59.282416 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 07 14:21:59.282416 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 07 14:21:59.282416 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 07 14:21:59.282416 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 07 14:21:59.282416 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 07 14:21:59.282416 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:21:59.282416 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 07 14:21:59.282416 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:21:59.282416 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:59.282416 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 07 14:21:59.282416 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 07 14:21:59.282416 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 07 14:21:59.282416 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 07 14:21:59.282416 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 07 14:21:59.282416 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application next(self.gen) Jun 07 14:21:59.283374 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 07 14:21:59.283374 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application yield resource Jun 07 14:21:59.283374 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 07 14:21:59.283374 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application next(self.gen) Jun 07 14:21:59.283374 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 07 14:21:59.283374 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self.session.rollback() Jun 07 14:21:59.283374 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 07 14:21:59.283374 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self.force_reraise() Jun 07 14:21:59.283374 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 07 14:21:59.283374 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise self.value Jun 07 14:21:59.283374 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 07 14:21:59.283374 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 07 14:21:59.283374 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 07 14:21:59.283374 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application session.commit() Jun 07 14:21:59.283374 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 07 14:21:59.283374 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 07 14:21:59.283374 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 07 14:21:59.284278 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self._prepare_impl() Jun 07 14:21:59.284278 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 07 14:21:59.284278 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self.session.flush() Jun 07 14:21:59.284278 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 07 14:21:59.284278 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self._flush(objects) Jun 07 14:21:59.284278 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 07 14:21:59.284278 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 07 14:21:59.284278 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 07 14:21:59.284278 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application compat.raise_( Jun 07 14:21:59.284278 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 07 14:21:59.284278 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception Jun 07 14:21:59.284278 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 07 14:21:59.284278 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application flush_context.execute() Jun 07 14:21:59.284278 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 07 14:21:59.284278 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rec.execute(self) Jun 07 14:21:59.284278 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 07 14:21:59.284278 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 07 14:21:59.285170 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 07 14:21:59.285170 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 07 14:21:59.285170 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 07 14:21:59.285170 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 07 14:21:59.285170 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 07 14:21:59.285170 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 07 14:21:59.285170 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 07 14:21:59.285170 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 07 14:21:59.285170 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 07 14:21:59.285170 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 07 14:21:59.285170 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 07 14:21:59.285170 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 07 14:21:59.285170 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 07 14:21:59.285170 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 07 14:21:59.285170 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 07 14:21:59.285170 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception Jun 07 14:21:59.287085 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 07 14:21:59.287085 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 07 14:21:59.287085 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 07 14:21:59.287085 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 07 14:21:59.287085 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 07 14:21:59.287085 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application result = self._query(query) Jun 07 14:21:59.287085 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 07 14:21:59.287085 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application conn.query(q) Jun 07 14:21:59.287085 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 07 14:21:59.287085 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 07 14:21:59.287085 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 07 14:21:59.287085 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application result.read() Jun 07 14:21:59.287085 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 07 14:21:59.287085 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 07 14:21:59.287085 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 07 14:21:59.287085 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 07 14:21:59.289369 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 07 14:21:59.289369 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 07 14:21:59.289369 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 07 14:21:59.289369 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 07 14:21:59.289369 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 07 14:21:59.289369 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 07 14:21:59.289369 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [parameters: {'user_id': '669cbf39d3a24818a248f3e7e190eb0a', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 07 14:21:59.289369 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 07 14:21:59.289369 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:21:59.289369 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 07 14:21:59.289369 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:21:59.289369 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:59.289369 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:59.289369 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:59.289369 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:59.291211 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:59.291211 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:59.291211 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:59.291211 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:59.291211 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:59.291211 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:59.291211 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:59.291211 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 07 14:21:59.291211 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 07 14:21:59.291211 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:59.291211 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:59.291211 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 14:21:59.291211 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:21:59.291211 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 14:21:59.291211 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:21:59.291211 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 07 14:21:59.291211 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 07 14:21:59.293954 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 07 14:21:59.293954 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 07 14:21:59.293954 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 07 14:21:59.293954 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 07 14:21:59.293954 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 07 14:21:59.293954 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:21:59.293954 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 491/963] 10.222.0.86 () {60 vars in 1131 bytes} [Tue Jun 7 14:21:59 2022] POST /identity/v3/users => generated 160 bytes in 236 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:21:59.294922 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ff3a96-c5a1-4358-b016-d7c3e8e28af1 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:59.392920 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ff3a96-c5a1-4358-b016-d7c3e8e28af1 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:59.423745 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30595f0-7178-4e67-9106-8e70e7074cbc None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:59.424085 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30595f0-7178-4e67-9106-8e70e7074cbc None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:59.424315 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30595f0-7178-4e67-9106-8e70e7074cbc None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:59.428547 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 492/964] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:21:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:21:59.429335 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6ac0c8-e2a2-4691-b532-e5e0b8a34eb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:59.430199 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6ac0c8-e2a2-4691-b532-e5e0b8a34eb7 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:59.430483 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6ac0c8-e2a2-4691-b532-e5e0b8a34eb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:59.430758 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6ac0c8-e2a2-4691-b532-e5e0b8a34eb7 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:59.432823 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:59.434228 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101a17f6-fbde-44af-aded-b8fc99f23704 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:59.434523 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101a17f6-fbde-44af-aded-b8fc99f23704 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:59.434800 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101a17f6-fbde-44af-aded-b8fc99f23704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:59.439201 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6ac0c8-e2a2-4691-b532-e5e0b8a34eb7 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:59.440676 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6ac0c8-e2a2-4691-b532-e5e0b8a34eb7 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:59.452753 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-101a17f6-fbde-44af-aded-b8fc99f23704 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:21:59.454200 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-101a17f6-fbde-44af-aded-b8fc99f23704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:21:59.456233 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-ba6ac0c8-e2a2-4691-b532-e5e0b8a34eb7 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 07 14:21:59.456233 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:21:59.456233 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:21:59.456233 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:21:59.456233 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:21:59.456233 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:21:59.456233 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:21:59.456233 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:21:59.456233 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:21:59.456233 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:21:59.456233 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:21:59.456233 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:21:59.456233 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 14:21:59.456233 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 14:21:59.456233 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 14:21:59.456233 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 14:21:59.457608 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:21:59.457608 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:21:59.457608 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 14:21:59.457608 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:21:59.457608 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 14:21:59.457608 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:21:59.457608 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:21:59.457608 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:21:59.457608 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:21:59.457608 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:21:59.457608 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:21:59.457608 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jun 07 14:21:59.457608 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:21:59.457608 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:21:59.457608 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:21:59.457608 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:21:59.457608 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:21:59.457608 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:21:59.458538 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:21:59.458538 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:21:59.458538 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 14:21:59.458538 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 14:21:59.458538 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 14:21:59.458538 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 14:21:59.458538 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 14:21:59.458538 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 14:21:59.458538 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 07 14:21:59.458538 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:21:59.458538 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 473/965] 10.222.0.86 () {56 vars in 1099 bytes} [Tue Jun 7 14:21:59 2022] GET /identity/v3/users/cinder => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:21:59.464903 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6ac0c8-e2a2-4691-b532-e5e0b8a34eb7 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:59.549673 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 493/966] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:21:59 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 14:21:59.572541 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101a17f6-fbde-44af-aded-b8fc99f23704 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:59.582155 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6ac0c8-e2a2-4691-b532-e5e0b8a34eb7 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:59.603811 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:59.621996 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905e8d9b-3255-46a9-b1ec-f2ceefe7cc89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:59.622893 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905e8d9b-3255-46a9-b1ec-f2ceefe7cc89 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:59.623352 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905e8d9b-3255-46a9-b1ec-f2ceefe7cc89 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:59.623829 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905e8d9b-3255-46a9-b1ec-f2ceefe7cc89 None admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:59.625233 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905e8d9b-3255-46a9-b1ec-f2ceefe7cc89 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:59.625714 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905e8d9b-3255-46a9-b1ec-f2ceefe7cc89 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:59.627648 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905e8d9b-3255-46a9-b1ec-f2ceefe7cc89 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:59.674291 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 474/967] 10.222.0.86 () {56 vars in 1101 bytes} [Tue Jun 7 14:21:59 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:59.688634 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101a17f6-fbde-44af-aded-b8fc99f23704 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:59.728146 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d63869-28b7-49c5-956b-86290f593226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:59.729059 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d63869-28b7-49c5-956b-86290f593226 None admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:59.729526 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d63869-28b7-49c5-956b-86290f593226 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:59.729970 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d63869-28b7-49c5-956b-86290f593226 None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:59.730856 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d63869-28b7-49c5-956b-86290f593226 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:59.732553 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d63869-28b7-49c5-956b-86290f593226 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:59.809865 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 494/968] 10.222.0.86 () {60 vars in 1141 bytes} [Tue Jun 7 14:21:59 2022] POST /identity/v3/services => generated 242 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 14:21:59.878589 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7ee740-07c0-41c1-9235-a00a8dfe28e5 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:59.878954 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7ee740-07c0-41c1-9235-a00a8dfe28e5 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:59.879166 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7ee740-07c0-41c1-9235-a00a8dfe28e5 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:59.881696 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 475/969] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:21:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:21:59.887682 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d4d8a2-1b8f-492b-a60f-f7ea16f9f628 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:59.892476 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d4d8a2-1b8f-492b-a60f-f7ea16f9f628 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:59.892476 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d4d8a2-1b8f-492b-a60f-f7ea16f9f628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:59.908499 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-79d4d8a2-1b8f-492b-a60f-f7ea16f9f628 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:21:59.909758 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-79d4d8a2-1b8f-492b-a60f-f7ea16f9f628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:00.000315 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 495/970] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:21:59 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 14:22:00.025434 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7ee740-07c0-41c1-9235-a00a8dfe28e5 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:00.085625 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:00.133280 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7ee740-07c0-41c1-9235-a00a8dfe28e5 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:00.167123 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da3063d-b65e-4b99-bef8-9032c220d64e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:00.167960 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da3063d-b65e-4b99-bef8-9032c220d64e None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:00.168248 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da3063d-b65e-4b99-bef8-9032c220d64e None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:00.168526 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da3063d-b65e-4b99-bef8-9032c220d64e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:00.178518 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da3063d-b65e-4b99-bef8-9032c220d64e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:22:00.187310 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-5da3063d-b65e-4b99-bef8-9032c220d64e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 07 14:22:00.187310 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:22:00.187310 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:22:00.187310 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:22:00.187310 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:22:00.187310 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:22:00.187310 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:22:00.187310 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:22:00.187310 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:22:00.187310 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:22:00.187310 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:22:00.187310 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:22:00.187310 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:22:00.187310 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:22:00.187310 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:22:00.187310 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:22:00.188423 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:22:00.188423 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:22:00.188423 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:22:00.188423 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:22:00.188423 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:22:00.188423 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:22:00.188423 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:22:00.188423 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:22:00.188423 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:22:00.188423 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:22:00.188423 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:22:00.188423 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jun 07 14:22:00.188423 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:22:00.188423 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:22:00.188423 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:22:00.188423 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:22:00.189552 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:22:00.189552 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:22:00.189552 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:22:00.189552 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:22:00.189552 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:22:00.189552 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:22:00.189552 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:22:00.189552 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:22:00.189552 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:22:00.189552 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:22:00.189552 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 07 14:22:00.189552 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:22:00.189552 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 476/971] 10.222.0.86 () {56 vars in 1120 bytes} [Tue Jun 7 14:22:00 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:22:00.194668 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d4d8a2-1b8f-492b-a60f-f7ea16f9f628 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:00.211049 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:00.308506 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d4d8a2-1b8f-492b-a60f-f7ea16f9f628 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:00.343656 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0e509e-4806-4536-abb3-381b122daac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:00.344365 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0e509e-4806-4536-abb3-381b122daac9 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:00.344651 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0e509e-4806-4536-abb3-381b122daac9 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:00.346674 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0e509e-4806-4536-abb3-381b122daac9 None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:00.346674 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0e509e-4806-4536-abb3-381b122daac9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:22:00.346674 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0e509e-4806-4536-abb3-381b122daac9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:00.347317 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0e509e-4806-4536-abb3-381b122daac9 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:00.361874 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 496/972] 10.222.0.86 () {56 vars in 1115 bytes} [Tue Jun 7 14:22:00 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:22:00.363525 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da3063d-b65e-4b99-bef8-9032c220d64e None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:00.466847 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da3063d-b65e-4b99-bef8-9032c220d64e None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:00.479995 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:00.502019 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5245244-c91d-4cd8-98eb-72c80f8ac355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:00.504159 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5245244-c91d-4cd8-98eb-72c80f8ac355 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:00.504159 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5245244-c91d-4cd8-98eb-72c80f8ac355 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:00.504159 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5245244-c91d-4cd8-98eb-72c80f8ac355 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:00.515490 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5245244-c91d-4cd8-98eb-72c80f8ac355 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:00.517011 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5245244-c91d-4cd8-98eb-72c80f8ac355 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:00.535387 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-d5245244-c91d-4cd8-98eb-72c80f8ac355 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:22:00.535387 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:22:00.535387 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:22:00.535387 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:22:00.535387 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:22:00.535387 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:22:00.535387 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:22:00.535387 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:22:00.535387 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:22:00.535387 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:22:00.535387 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:22:00.535387 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:22:00.535387 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:22:00.535387 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:22:00.535387 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:22:00.536561 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:22:00.536561 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:22:00.536561 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:22:00.536561 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:22:00.536561 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:22:00.536561 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:22:00.536561 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:22:00.536561 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:22:00.536561 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jun 07 14:22:00.536561 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:22:00.536561 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:22:00.536561 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:22:00.536561 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:22:00.536561 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:22:00.536561 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:22:00.536561 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:22:00.536561 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:22:00.542289 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:22:00.542289 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:22:00.542289 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:22:00.542289 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:22:00.542289 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 477/973] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jun 7 14:22:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:22:00.544097 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0e509e-4806-4536-abb3-381b122daac9 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:00.616807 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:00.649149 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0e509e-4806-4536-abb3-381b122daac9 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:00.689885 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f2851b-15cc-4475-9170-fdb888f0ad98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:00.690569 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f2851b-15cc-4475-9170-fdb888f0ad98 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:00.690854 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f2851b-15cc-4475-9170-fdb888f0ad98 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:00.691134 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f2851b-15cc-4475-9170-fdb888f0ad98 None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:00.691916 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f2851b-15cc-4475-9170-fdb888f0ad98 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:22:00.692255 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f2851b-15cc-4475-9170-fdb888f0ad98 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:00.693626 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f2851b-15cc-4475-9170-fdb888f0ad98 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:00.710729 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 497/974] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jun 7 14:22:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:22:00.712269 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5245244-c91d-4cd8-98eb-72c80f8ac355 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:00.815246 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5245244-c91d-4cd8-98eb-72c80f8ac355 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:00.848914 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1138fc47-61e9-4e40-833d-b673e5be751e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:00.849772 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1138fc47-61e9-4e40-833d-b673e5be751e None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:00.850062 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1138fc47-61e9-4e40-833d-b673e5be751e None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:00.850340 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1138fc47-61e9-4e40-833d-b673e5be751e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:00.858644 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1138fc47-61e9-4e40-833d-b673e5be751e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:00.860112 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1138fc47-61e9-4e40-833d-b673e5be751e None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:00.874887 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-1138fc47-61e9-4e40-833d-b673e5be751e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 07 14:22:00.874887 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:22:00.874887 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:22:00.874887 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:22:00.874887 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:22:00.874887 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:22:00.874887 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:22:00.874887 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:22:00.874887 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:22:00.874887 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:22:00.874887 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:22:00.874887 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:22:00.874887 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 14:22:00.874887 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 14:22:00.874887 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 14:22:00.874887 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 14:22:00.876224 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:22:00.876224 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:22:00.876224 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 14:22:00.876224 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:22:00.876224 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 14:22:00.876224 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:22:00.876224 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:22:00.876224 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:22:00.876224 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:22:00.876224 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:22:00.876224 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:22:00.876224 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jun 07 14:22:00.876224 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:22:00.876224 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:22:00.876224 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:22:00.876224 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:22:00.876224 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:22:00.876224 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:22:00.877151 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:22:00.877151 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:22:00.877151 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 14:22:00.877151 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 14:22:00.877151 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 14:22:00.877151 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 14:22:00.877151 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 14:22:00.877151 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 14:22:00.877151 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 07 14:22:00.877151 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:22:00.879818 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 478/975] 10.222.0.86 () {56 vars in 1117 bytes} [Tue Jun 7 14:22:00 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:22:00.884363 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f2851b-15cc-4475-9170-fdb888f0ad98 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:00.987566 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f2851b-15cc-4475-9170-fdb888f0ad98 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:00.991951 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5188056-0249-4c98-b964-2e336ab612b2 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:00.992442 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5188056-0249-4c98-b964-2e336ab612b2 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:00.992908 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5188056-0249-4c98-b964-2e336ab612b2 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:00.994498 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 479/976] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:22:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 07 14:22:01.000378 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bae7339-6848-4afe-93e5-d52c5d7e7921 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:01.000676 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bae7339-6848-4afe-93e5-d52c5d7e7921 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:01.000959 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bae7339-6848-4afe-93e5-d52c5d7e7921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:01.019084 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-6bae7339-6848-4afe-93e5-d52c5d7e7921 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:22:01.020401 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-6bae7339-6848-4afe-93e5-d52c5d7e7921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:01.024628 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:01.030113 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5392731-1315-4ef6-baee-137b6dfbe2d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:01.030936 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5392731-1315-4ef6-baee-137b6dfbe2d1 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:01.031063 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5392731-1315-4ef6-baee-137b6dfbe2d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:01.031338 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5392731-1315-4ef6-baee-137b6dfbe2d1 None admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:01.032302 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5392731-1315-4ef6-baee-137b6dfbe2d1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:22:01.032770 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5392731-1315-4ef6-baee-137b6dfbe2d1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:01.034045 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5392731-1315-4ef6-baee-137b6dfbe2d1 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:01.040341 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:01.055914 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 498/977] 10.222.0.86 () {56 vars in 1149 bytes} [Tue Jun 7 14:22:00 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:22:01.058091 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5392731-1315-4ef6-baee-137b6dfbe2d1 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:01.092504 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 480/978] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:22:00 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 07 14:22:01.115779 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bae7339-6848-4afe-93e5-d52c5d7e7921 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:01.165958 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5392731-1315-4ef6-baee-137b6dfbe2d1 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:01.207906 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4d70a5-df54-42cc-b56c-013dc25db5db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:01.208708 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4d70a5-df54-42cc-b56c-013dc25db5db None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:01.209021 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4d70a5-df54-42cc-b56c-013dc25db5db None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:01.209325 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4d70a5-df54-42cc-b56c-013dc25db5db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:01.220594 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bae7339-6848-4afe-93e5-d52c5d7e7921 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:01.258176 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927a3f65-6cc1-47ec-a238-aa955c1abb27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:01.259012 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927a3f65-6cc1-47ec-a238-aa955c1abb27 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:01.259301 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927a3f65-6cc1-47ec-a238-aa955c1abb27 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:01.259578 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927a3f65-6cc1-47ec-a238-aa955c1abb27 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:01.260769 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927a3f65-6cc1-47ec-a238-aa955c1abb27 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:01.262163 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927a3f65-6cc1-47ec-a238-aa955c1abb27 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:01.274740 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-927a3f65-6cc1-47ec-a238-aa955c1abb27 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 07 14:22:01.274740 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:22:01.274740 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 07 14:22:01.274740 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 07 14:22:01.274740 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 07 14:22:01.274740 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 07 14:22:01.274740 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 07 14:22:01.274740 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 14:22:01.274740 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 07 14:22:01.274740 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:22:01.274740 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 07 14:22:01.274740 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:22:01.274740 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:22:01.274740 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:22:01.274740 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:22:01.274740 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:22:01.274740 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:22:01.275714 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:22:01.275714 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:22:01.275714 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:22:01.275714 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:22:01.275714 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:22:01.275714 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:22:01.275714 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 07 14:22:01.275714 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 07 14:22:01.275714 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 07 14:22:01.275714 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 07 14:22:01.275714 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:22:01.275714 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:22:01.275714 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:22:01.275714 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:22:01.275714 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:22:01.275714 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:22:01.276765 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:22:01.276765 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jun 07 14:22:01.276765 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:22:01.276765 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:22:01.276765 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:22:01.276765 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:22:01.276765 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:22:01.276765 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:22:01.276765 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:22:01.276765 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:22:01.276765 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 07 14:22:01.276765 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 14:22:01.276765 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 07 14:22:01.276765 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:22:01.277489 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:01.277570 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 481/979] 10.222.0.86 () {56 vars in 1126 bytes} [Tue Jun 7 14:22:01 2022] GET /identity/v3/services/object-store => generated 93 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 14:22:01.282237 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927a3f65-6cc1-47ec-a238-aa955c1abb27 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:01.289772 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4d70a5-df54-42cc-b56c-013dc25db5db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:01.291217 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4d70a5-df54-42cc-b56c-013dc25db5db None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:01.303332 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:01.386364 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927a3f65-6cc1-47ec-a238-aa955c1abb27 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:01.409387 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 499/980] 10.222.0.86 () {58 vars in 1282 bytes} [Tue Jun 7 14:22:01 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 07 14:22:01.415176 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4d70a5-df54-42cc-b56c-013dc25db5db None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:01.422570 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b61c74-18be-4d2b-8a40-51e6a6acd5dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:01.423594 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b61c74-18be-4d2b-8a40-51e6a6acd5dd None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:01.423914 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b61c74-18be-4d2b-8a40-51e6a6acd5dd None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:01.424195 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b61c74-18be-4d2b-8a40-51e6a6acd5dd None admin] PATH_INFO: `/v3/services` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:01.425269 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b61c74-18be-4d2b-8a40-51e6a6acd5dd None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:22:01.425587 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b61c74-18be-4d2b-8a40-51e6a6acd5dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:01.427335 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b61c74-18be-4d2b-8a40-51e6a6acd5dd None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:01.436893 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 482/981] 10.222.0.86 () {56 vars in 1122 bytes} [Tue Jun 7 14:22:01 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:22:01.438508 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b61c74-18be-4d2b-8a40-51e6a6acd5dd None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:01.511542 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:01.523505 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4d70a5-df54-42cc-b56c-013dc25db5db None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:01.526040 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:01.546832 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b61c74-18be-4d2b-8a40-51e6a6acd5dd None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:01.558653 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f012d5-17fa-4125-9f13-dd30c9458300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:01.560303 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f012d5-17fa-4125-9f13-dd30c9458300 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:01.561088 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f012d5-17fa-4125-9f13-dd30c9458300 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:01.562105 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f012d5-17fa-4125-9f13-dd30c9458300 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:01.578564 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f012d5-17fa-4125-9f13-dd30c9458300 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:01.581187 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f012d5-17fa-4125-9f13-dd30c9458300 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:01.598293 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f811e7f0-7aad-4577-ae66-cdd96d42039e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:01.599298 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f811e7f0-7aad-4577-ae66-cdd96d42039e None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:01.599774 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f811e7f0-7aad-4577-ae66-cdd96d42039e None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:01.600242 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f811e7f0-7aad-4577-ae66-cdd96d42039e None admin] PATH_INFO: `/v3/services` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:01.601415 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f811e7f0-7aad-4577-ae66-cdd96d42039e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:22:01.601924 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f811e7f0-7aad-4577-ae66-cdd96d42039e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:01.604297 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f811e7f0-7aad-4577-ae66-cdd96d42039e None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:01.611323 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-a1f012d5-17fa-4125-9f13-dd30c9458300 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:22:01.611323 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:22:01.611323 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:22:01.611323 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:22:01.611323 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:22:01.611323 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:22:01.611323 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:22:01.611323 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:22:01.611323 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:22:01.611323 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:22:01.611323 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:22:01.611323 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:22:01.611323 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:22:01.611323 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:22:01.611323 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:22:01.612221 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:22:01.612221 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:22:01.612221 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:22:01.612221 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:22:01.612221 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:22:01.612221 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:22:01.612221 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:22:01.612221 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:22:01.612221 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jun 07 14:22:01.612221 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:22:01.612221 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:22:01.612221 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:22:01.612221 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:22:01.612221 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:22:01.612221 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:22:01.612221 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:22:01.612221 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:22:01.613088 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:22:01.613088 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:22:01.613088 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:22:01.613088 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:22:01.616074 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 500/982] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jun 7 14:22:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 14:22:01.616522 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 483/983] 10.222.0.86 () {56 vars in 1122 bytes} [Tue Jun 7 14:22:01 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:22:01.621389 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f811e7f0-7aad-4577-ae66-cdd96d42039e None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:01.621600 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f012d5-17fa-4125-9f13-dd30c9458300 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:01.728291 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f811e7f0-7aad-4577-ae66-cdd96d42039e None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:01.728826 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f012d5-17fa-4125-9f13-dd30c9458300 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:01.766150 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bd6a33-06b1-4efc-aef0-9fe17be32b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:01.766376 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8162cfcf-6716-47d4-a2fa-8670d450a335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:01.766835 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bd6a33-06b1-4efc-aef0-9fe17be32b43 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:01.766966 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8162cfcf-6716-47d4-a2fa-8670d450a335 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:01.767136 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bd6a33-06b1-4efc-aef0-9fe17be32b43 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:01.767246 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8162cfcf-6716-47d4-a2fa-8670d450a335 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:01.767396 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bd6a33-06b1-4efc-aef0-9fe17be32b43 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:01.767550 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8162cfcf-6716-47d4-a2fa-8670d450a335 None admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:01.768266 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bd6a33-06b1-4efc-aef0-9fe17be32b43 None admin] RBAC: Adding query filter params (interface=admin, service_id=e593beceff584b38bcac03863f4c7f1c, region_id=RegionOne) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:22:01.768372 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8162cfcf-6716-47d4-a2fa-8670d450a335 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:22:01.768584 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bd6a33-06b1-4efc-aef0-9fe17be32b43 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:01.768682 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8162cfcf-6716-47d4-a2fa-8670d450a335 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:01.769990 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bd6a33-06b1-4efc-aef0-9fe17be32b43 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:01.770123 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8162cfcf-6716-47d4-a2fa-8670d450a335 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:01.776622 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 501/984] 10.222.0.86 () {56 vars in 1249 bytes} [Tue Jun 7 14:22:01 2022] GET /identity/v3/endpoints?service_id=e593beceff584b38bcac03863f4c7f1c&interface=admin®ion_id=RegionOne => generated 193 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:22:01.782354 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bd6a33-06b1-4efc-aef0-9fe17be32b43 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:01.786215 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:01.794829 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 484/985] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jun 7 14:22:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:22:01.795626 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8162cfcf-6716-47d4-a2fa-8670d450a335 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:01.804242 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:01.894242 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bd6a33-06b1-4efc-aef0-9fe17be32b43 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:01.898799 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8162cfcf-6716-47d4-a2fa-8670d450a335 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:01.930768 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad66b78-0f8e-4361-a8bc-5fc3c9eb41aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:01.931495 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad66b78-0f8e-4361-a8bc-5fc3c9eb41aa None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:01.931808 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad66b78-0f8e-4361-a8bc-5fc3c9eb41aa None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:01.932108 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad66b78-0f8e-4361-a8bc-5fc3c9eb41aa None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:01.933319 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad66b78-0f8e-4361-a8bc-5fc3c9eb41aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:01.934684 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad66b78-0f8e-4361-a8bc-5fc3c9eb41aa None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:01.934785 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e923905-5302-428d-9272-5989c85fe729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:01.935561 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e923905-5302-428d-9272-5989c85fe729 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:01.935879 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e923905-5302-428d-9272-5989c85fe729 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:01.936156 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e923905-5302-428d-9272-5989c85fe729 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:01.941388 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 502/986] 10.222.0.86 () {56 vars in 1087 bytes} [Tue Jun 7 14:22:01 2022] GET /identity/v3/services => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 07 14:22:01.945802 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e923905-5302-428d-9272-5989c85fe729 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:01.947373 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e923905-5302-428d-9272-5989c85fe729 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:01.963425 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-2e923905-5302-428d-9272-5989c85fe729 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:22:01.963425 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:22:01.963425 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:22:01.963425 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:22:01.963425 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:22:01.963425 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:22:01.963425 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:22:01.963425 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:22:01.963425 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:22:01.963425 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:22:01.963425 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:22:01.963425 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:22:01.963425 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 14:22:01.963425 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 14:22:01.963425 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 14:22:01.964423 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 14:22:01.964423 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:22:01.964423 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:22:01.964423 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:22:01.964423 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:22:01.964423 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:22:01.964423 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:22:01.964423 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:22:01.964423 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jun 07 14:22:01.964423 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:22:01.964423 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:22:01.964423 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:22:01.964423 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:22:01.964423 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:22:01.964423 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:22:01.964423 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:22:01.964423 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:22:01.968820 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 14:22:01.968820 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 14:22:01.968820 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 14:22:01.968820 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 14:22:01.968820 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 14:22:01.968820 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 14:22:01.968820 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:22:01.968820 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:22:01.968820 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 485/987] 10.222.0.86 () {56 vars in 1111 bytes} [Tue Jun 7 14:22:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 14:22:01.970823 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad66b78-0f8e-4361-a8bc-5fc3c9eb41aa None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:02.045447 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:02.081526 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad66b78-0f8e-4361-a8bc-5fc3c9eb41aa None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:02.105102 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2afdca-295a-4858-9c74-91b9ded66f1f None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:02.105414 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2afdca-295a-4858-9c74-91b9ded66f1f None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:02.105811 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2afdca-295a-4858-9c74-91b9ded66f1f None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:02.107389 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 486/988] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:22:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 07 14:22:02.112997 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657dd6d9-a779-48c0-bf75-642c8a7061b5 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:02.113279 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657dd6d9-a779-48c0-bf75-642c8a7061b5 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:02.113558 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657dd6d9-a779-48c0-bf75-642c8a7061b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:02.120607 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9685bc85-3be9-41b4-8924-6bfee3c2ca84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:02.122248 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9685bc85-3be9-41b4-8924-6bfee3c2ca84 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:02.122538 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9685bc85-3be9-41b4-8924-6bfee3c2ca84 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:02.122808 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9685bc85-3be9-41b4-8924-6bfee3c2ca84 None admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:02.123633 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9685bc85-3be9-41b4-8924-6bfee3c2ca84 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:22:02.123960 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9685bc85-3be9-41b4-8924-6bfee3c2ca84 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:02.125437 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9685bc85-3be9-41b4-8924-6bfee3c2ca84 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:02.131914 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-657dd6d9-a779-48c0-bf75-642c8a7061b5 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:22:02.133194 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-657dd6d9-a779-48c0-bf75-642c8a7061b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:02.140547 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 503/989] 10.222.0.86 () {56 vars in 1148 bytes} [Tue Jun 7 14:22:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:22:02.146468 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9685bc85-3be9-41b4-8924-6bfee3c2ca84 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:02.207631 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:02.215794 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 487/990] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:22:02 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 07 14:22:02.239531 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657dd6d9-a779-48c0-bf75-642c8a7061b5 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:02.257893 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9685bc85-3be9-41b4-8924-6bfee3c2ca84 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:02.284832 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:02.295333 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad04d47a-a95f-4780-907f-a02cd22e6656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:02.300516 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad04d47a-a95f-4780-907f-a02cd22e6656 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:02.300516 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad04d47a-a95f-4780-907f-a02cd22e6656 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:02.300516 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad04d47a-a95f-4780-907f-a02cd22e6656 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:02.300516 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad04d47a-a95f-4780-907f-a02cd22e6656 None admin] RBAC: Adding query filter params (role.id=8639adefbbcc4029bf422565e1a299b7, scope.project.id=e429537b190c4c5ea7e1332ab044ca7a, user.id=d7b598c6a3f642ef9edc971ad3ebbe31) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:22:02.300516 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad04d47a-a95f-4780-907f-a02cd22e6656 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:02.300516 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad04d47a-a95f-4780-907f-a02cd22e6656 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:02.315791 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 504/991] 10.222.0.86 () {56 vars in 1374 bytes} [Tue Jun 7 14:22:02 2022] GET /identity/v3/role_assignments?user.id=d7b598c6a3f642ef9edc971ad3ebbe31&scope.project.id=e429537b190c4c5ea7e1332ab044ca7a&role.id=8639adefbbcc4029bf422565e1a299b7 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:22:02.360935 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657dd6d9-a779-48c0-bf75-642c8a7061b5 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:02.400680 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37324fa3-2045-47f2-9e2c-e9e658ba8d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:02.402031 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37324fa3-2045-47f2-9e2c-e9e658ba8d00 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:02.402316 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37324fa3-2045-47f2-9e2c-e9e658ba8d00 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:02.402591 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37324fa3-2045-47f2-9e2c-e9e658ba8d00 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:02.403262 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37324fa3-2045-47f2-9e2c-e9e658ba8d00 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:02.404679 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37324fa3-2045-47f2-9e2c-e9e658ba8d00 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:02.418031 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-37324fa3-2045-47f2-9e2c-e9e658ba8d00 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 07 14:22:02.418031 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:22:02.418031 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 07 14:22:02.418031 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 07 14:22:02.418031 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 07 14:22:02.418031 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 07 14:22:02.418031 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 07 14:22:02.418031 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 14:22:02.418031 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 07 14:22:02.418031 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:22:02.418031 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 07 14:22:02.418031 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:22:02.418031 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:22:02.418031 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:22:02.418031 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:22:02.418031 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:22:02.418031 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:22:02.419124 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:22:02.419124 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:22:02.419124 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:22:02.419124 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:22:02.419124 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:22:02.419124 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:22:02.419124 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 07 14:22:02.419124 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 07 14:22:02.419124 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 07 14:22:02.419124 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 07 14:22:02.419124 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:22:02.419124 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:22:02.419124 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:22:02.419124 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:22:02.419124 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:22:02.419124 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:22:02.425112 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:22:02.425112 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jun 07 14:22:02.425112 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:22:02.425112 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:22:02.425112 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:22:02.425112 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:22:02.425112 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:22:02.425112 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:22:02.425112 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:22:02.425112 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:22:02.425112 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 07 14:22:02.425112 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 14:22:02.425112 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 07 14:22:02.425112 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:22:02.425112 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 488/992] 10.222.0.86 () {56 vars in 1111 bytes} [Tue Jun 7 14:22:02 2022] GET /identity/v3/services/compute => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 14:22:02.427526 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad04d47a-a95f-4780-907f-a02cd22e6656 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:02.545714 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad04d47a-a95f-4780-907f-a02cd22e6656 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:02.579913 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d730f280-88da-42eb-b9a7-08c6c0fb2e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:02.580499 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d730f280-88da-42eb-b9a7-08c6c0fb2e41 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:02.580780 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d730f280-88da-42eb-b9a7-08c6c0fb2e41 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:02.581054 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d730f280-88da-42eb-b9a7-08c6c0fb2e41 None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:02.581754 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d730f280-88da-42eb-b9a7-08c6c0fb2e41 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:22:02.582058 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d730f280-88da-42eb-b9a7-08c6c0fb2e41 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:02.583406 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d730f280-88da-42eb-b9a7-08c6c0fb2e41 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:02.588769 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 505/993] 10.222.0.86 () {56 vars in 1112 bytes} [Tue Jun 7 14:22:02 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:22:02.594509 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37324fa3-2045-47f2-9e2c-e9e658ba8d00 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:02.654983 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:02.695965 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37324fa3-2045-47f2-9e2c-e9e658ba8d00 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:02.732144 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a75b67-873b-4885-8b49-7b002e157102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:02.732930 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a75b67-873b-4885-8b49-7b002e157102 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:02.733103 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a75b67-873b-4885-8b49-7b002e157102 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:02.733353 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a75b67-873b-4885-8b49-7b002e157102 None admin] PATH_INFO: `/v3/services` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:02.734062 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a75b67-873b-4885-8b49-7b002e157102 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:22:02.734369 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a75b67-873b-4885-8b49-7b002e157102 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:02.735732 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a75b67-873b-4885-8b49-7b002e157102 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:02.745774 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 489/994] 10.222.0.86 () {56 vars in 1112 bytes} [Tue Jun 7 14:22:02 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:22:02.746733 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d730f280-88da-42eb-b9a7-08c6c0fb2e41 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:02.802762 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:02.848563 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d730f280-88da-42eb-b9a7-08c6c0fb2e41 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:02.881412 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341b183d-c31a-47dc-bcaf-092ba6a1f8ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:02.882067 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341b183d-c31a-47dc-bcaf-092ba6a1f8ed None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:02.882347 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341b183d-c31a-47dc-bcaf-092ba6a1f8ed None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:02.882616 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341b183d-c31a-47dc-bcaf-092ba6a1f8ed None admin] PATH_INFO: `/v3/endpoints` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:02.883393 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341b183d-c31a-47dc-bcaf-092ba6a1f8ed None admin] RBAC: Adding query filter params (interface=public, service_id=6bf830e00a3a4d2ea8eb33c817baa849, region_id=RegionOne) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:22:02.883702 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341b183d-c31a-47dc-bcaf-092ba6a1f8ed None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:02.885082 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341b183d-c31a-47dc-bcaf-092ba6a1f8ed None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:02.895048 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 506/995] 10.222.0.86 () {56 vars in 1251 bytes} [Tue Jun 7 14:22:02 2022] GET /identity/v3/endpoints?service_id=6bf830e00a3a4d2ea8eb33c817baa849&interface=public®ion_id=RegionOne => generated 194 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:22:02.896189 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a75b67-873b-4885-8b49-7b002e157102 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:02.993625 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a75b67-873b-4885-8b49-7b002e157102 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:03.017114 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:03.027907 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a379c2c9-715a-409e-ac00-b0f9190756c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:03.028572 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a379c2c9-715a-409e-ac00-b0f9190756c5 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:03.028854 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a379c2c9-715a-409e-ac00-b0f9190756c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:03.029127 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a379c2c9-715a-409e-ac00-b0f9190756c5 None admin] PATH_INFO: `/v3/services` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:03.029808 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a379c2c9-715a-409e-ac00-b0f9190756c5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:03.031159 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a379c2c9-715a-409e-ac00-b0f9190756c5 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:03.043843 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 490/996] 10.222.0.86 () {56 vars in 1087 bytes} [Tue Jun 7 14:22:02 2022] GET /identity/v3/services => generated 1727 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:22:04.220473 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2ea49a-4616-41ab-952f-0cca6a59223e None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:04.221026 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2ea49a-4616-41ab-952f-0cca6a59223e None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:04.221026 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2ea49a-4616-41ab-952f-0cca6a59223e None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:04.222542 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 507/997] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:22:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:22:04.230373 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94bd136-a561-440e-a0ef-be4d3d395910 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:04.231610 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94bd136-a561-440e-a0ef-be4d3d395910 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:04.231915 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94bd136-a561-440e-a0ef-be4d3d395910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:04.249122 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-f94bd136-a561-440e-a0ef-be4d3d395910 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:22:04.250304 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-f94bd136-a561-440e-a0ef-be4d3d395910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:04.323794 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 491/998] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:22:04 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 14:22:04.346246 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2ea49a-4616-41ab-952f-0cca6a59223e None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:04.448136 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2ea49a-4616-41ab-952f-0cca6a59223e None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:04.467196 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:04.482642 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a23e3c3-76fe-48a0-863a-a52d91c5080c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:04.482642 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a23e3c3-76fe-48a0-863a-a52d91c5080c None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:04.483027 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a23e3c3-76fe-48a0-863a-a52d91c5080c None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:04.483027 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a23e3c3-76fe-48a0-863a-a52d91c5080c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:04.483581 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a23e3c3-76fe-48a0-863a-a52d91c5080c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:04.484968 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a23e3c3-76fe-48a0-863a-a52d91c5080c None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:04.497290 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-8a23e3c3-76fe-48a0-863a-a52d91c5080c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 07 14:22:04.497290 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:22:04.497290 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 07 14:22:04.497290 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 07 14:22:04.497290 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 07 14:22:04.497290 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 07 14:22:04.497290 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 07 14:22:04.497290 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 14:22:04.497290 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 07 14:22:04.497290 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:22:04.497290 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 07 14:22:04.497290 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:22:04.497290 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:22:04.497290 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:22:04.497290 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:22:04.497290 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:22:04.497290 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:22:04.498253 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:22:04.498253 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:22:04.498253 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:22:04.498253 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:22:04.498253 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:22:04.498253 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:22:04.498253 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 07 14:22:04.498253 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 07 14:22:04.498253 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 07 14:22:04.498253 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 07 14:22:04.498253 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:22:04.498253 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:22:04.498253 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:22:04.498253 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:22:04.498253 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:22:04.498253 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:22:04.499161 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:22:04.499161 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jun 07 14:22:04.499161 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:22:04.499161 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:22:04.499161 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:22:04.499161 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:22:04.499161 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:22:04.499161 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:22:04.499161 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:22:04.499161 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:22:04.499161 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 07 14:22:04.499161 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 14:22:04.499161 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 07 14:22:04.499161 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:22:04.501548 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 508/999] 10.222.0.86 () {56 vars in 1126 bytes} [Tue Jun 7 14:22:04 2022] GET /identity/v3/services/object-store => generated 93 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:22:04.504648 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94bd136-a561-440e-a0ef-be4d3d395910 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:04.603137 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab834ada-79ba-4b32-a701-7aa4e42dc490 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:04.603568 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab834ada-79ba-4b32-a701-7aa4e42dc490 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:04.604456 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab834ada-79ba-4b32-a701-7aa4e42dc490 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:04.606128 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 509/1000] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:22:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 07 14:22:04.609728 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94bd136-a561-440e-a0ef-be4d3d395910 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:04.611602 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f462bcc-c8b7-4dfd-9429-a7492e676180 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:04.611941 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f462bcc-c8b7-4dfd-9429-a7492e676180 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:04.612223 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f462bcc-c8b7-4dfd-9429-a7492e676180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:04.628783 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:04.629909 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-0f462bcc-c8b7-4dfd-9429-a7492e676180 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:22:04.631096 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-0f462bcc-c8b7-4dfd-9429-a7492e676180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:04.648342 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcacc4e-6ba7-4c62-bc1e-bfbe01464ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:04.649303 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcacc4e-6ba7-4c62-bc1e-bfbe01464ed7 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:04.649594 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcacc4e-6ba7-4c62-bc1e-bfbe01464ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:04.649876 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcacc4e-6ba7-4c62-bc1e-bfbe01464ed7 None admin] PATH_INFO: `/v3/services` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:04.650590 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcacc4e-6ba7-4c62-bc1e-bfbe01464ed7 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:22:04.651419 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcacc4e-6ba7-4c62-bc1e-bfbe01464ed7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:04.653572 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcacc4e-6ba7-4c62-bc1e-bfbe01464ed7 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:04.664747 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 492/1001] 10.222.0.86 () {56 vars in 1122 bytes} [Tue Jun 7 14:22:04 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:22:04.665787 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcacc4e-6ba7-4c62-bc1e-bfbe01464ed7 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:04.705243 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 510/1002] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:22:04 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 07 14:22:04.728254 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f462bcc-c8b7-4dfd-9429-a7492e676180 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:04.769847 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcacc4e-6ba7-4c62-bc1e-bfbe01464ed7 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:04.807658 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdd86c8-ade6-499a-9056-6251748464e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:04.808384 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdd86c8-ade6-499a-9056-6251748464e2 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:04.808675 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdd86c8-ade6-499a-9056-6251748464e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:04.809273 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdd86c8-ade6-499a-9056-6251748464e2 None admin] PATH_INFO: `/v3/services` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:04.809991 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdd86c8-ade6-499a-9056-6251748464e2 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:22:04.810304 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdd86c8-ade6-499a-9056-6251748464e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:04.811672 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdd86c8-ade6-499a-9056-6251748464e2 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:04.816919 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 493/1003] 10.222.0.86 () {56 vars in 1122 bytes} [Tue Jun 7 14:22:04 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:22:04.822328 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdd86c8-ade6-499a-9056-6251748464e2 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:04.833964 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f462bcc-c8b7-4dfd-9429-a7492e676180 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:04.849876 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:04.871436 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8e5b22-5831-4607-97c9-1859b9520772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:04.872330 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8e5b22-5831-4607-97c9-1859b9520772 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:04.872514 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:04.872659 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8e5b22-5831-4607-97c9-1859b9520772 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:04.873114 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8e5b22-5831-4607-97c9-1859b9520772 None admin] PATH_INFO: `/v3/services/image` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:04.873790 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8e5b22-5831-4607-97c9-1859b9520772 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:04.875178 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8e5b22-5831-4607-97c9-1859b9520772 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:04.887379 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-7d8e5b22-5831-4607-97c9-1859b9520772 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 07 14:22:04.887379 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:22:04.887379 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 07 14:22:04.887379 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 07 14:22:04.887379 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 07 14:22:04.887379 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 07 14:22:04.887379 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 07 14:22:04.887379 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 14:22:04.887379 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 07 14:22:04.887379 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:22:04.887379 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 07 14:22:04.887379 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:22:04.887379 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:22:04.887379 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:22:04.887379 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:22:04.887379 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:22:04.887379 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:22:04.888513 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:22:04.888513 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:22:04.888513 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:22:04.888513 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:22:04.888513 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:22:04.888513 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:22:04.888513 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 07 14:22:04.888513 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 07 14:22:04.888513 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 07 14:22:04.888513 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 07 14:22:04.888513 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:22:04.888513 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:22:04.888513 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:22:04.888513 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:22:04.888513 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:22:04.888513 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:22:04.889332 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:22:04.889332 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jun 07 14:22:04.889332 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:22:04.889332 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:22:04.889332 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:22:04.889332 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:22:04.889332 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:22:04.889332 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:22:04.889332 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:22:04.889332 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:22:04.889332 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 07 14:22:04.889332 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 14:22:04.889332 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 07 14:22:04.889332 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:22:04.889332 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 511/1004] 10.222.0.86 () {56 vars in 1105 bytes} [Tue Jun 7 14:22:04 2022] GET /identity/v3/services/image => generated 86 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 14:22:04.894918 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8e5b22-5831-4607-97c9-1859b9520772 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:04.935424 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdd86c8-ade6-499a-9056-6251748464e2 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:04.974439 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a142711-6e8a-4611-a729-49122b52ffd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:04.975466 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a142711-6e8a-4611-a729-49122b52ffd7 None admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:04.975989 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a142711-6e8a-4611-a729-49122b52ffd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:04.976476 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a142711-6e8a-4611-a729-49122b52ffd7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:04.977448 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a142711-6e8a-4611-a729-49122b52ffd7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:04.979073 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a142711-6e8a-4611-a729-49122b52ffd7 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:05.003013 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8e5b22-5831-4607-97c9-1859b9520772 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:05.037930 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3c5b4d-4d55-4683-b60c-a52da21c04d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:05.038626 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3c5b4d-4d55-4683-b60c-a52da21c04d2 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:05.038904 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3c5b4d-4d55-4683-b60c-a52da21c04d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:05.039172 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3c5b4d-4d55-4683-b60c-a52da21c04d2 None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:05.039898 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3c5b4d-4d55-4683-b60c-a52da21c04d2 None admin] RBAC: Adding query filter params (name=image) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:22:05.040203 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3c5b4d-4d55-4683-b60c-a52da21c04d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:05.041574 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3c5b4d-4d55-4683-b60c-a52da21c04d2 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:05.046264 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 512/1005] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jun 7 14:22:04 2022] GET /identity/v3/services?name=image => generated 122 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:22:05.051700 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3c5b4d-4d55-4683-b60c-a52da21c04d2 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:05.093703 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:05.100843 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 494/1006] 10.222.0.86 () {60 vars in 1144 bytes} [Tue Jun 7 14:22:04 2022] POST /identity/v3/endpoints => generated 325 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 14:22:05.158482 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3c5b4d-4d55-4683-b60c-a52da21c04d2 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:05.205633 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2943f0e-4358-4377-9366-f38b9852f4f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:05.206343 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2943f0e-4358-4377-9366-f38b9852f4f9 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:05.206654 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2943f0e-4358-4377-9366-f38b9852f4f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:05.207186 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2943f0e-4358-4377-9366-f38b9852f4f9 None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:05.208168 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2943f0e-4358-4377-9366-f38b9852f4f9 None admin] RBAC: Adding query filter params (type=image) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:22:05.209039 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2943f0e-4358-4377-9366-f38b9852f4f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:05.210453 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2943f0e-4358-4377-9366-f38b9852f4f9 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:05.223281 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 513/1007] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jun 7 14:22:05 2022] GET /identity/v3/services?type=image => generated 122 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:22:05.279336 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c3996e-c7ae-4448-b3d8-eeaaf4468e42 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:05.279932 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c3996e-c7ae-4448-b3d8-eeaaf4468e42 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:05.279932 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c3996e-c7ae-4448-b3d8-eeaaf4468e42 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:05.281544 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 495/1008] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:22:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:22:05.287440 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9455cf99-50ae-487f-b6a8-748120c1fc9f None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:05.288139 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9455cf99-50ae-487f-b6a8-748120c1fc9f None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:05.288310 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9455cf99-50ae-487f-b6a8-748120c1fc9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:05.307311 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-9455cf99-50ae-487f-b6a8-748120c1fc9f None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:22:05.307948 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-9455cf99-50ae-487f-b6a8-748120c1fc9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:05.383724 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 514/1009] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:22:05 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 14:22:05.406918 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c3996e-c7ae-4448-b3d8-eeaaf4468e42 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:05.510508 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c3996e-c7ae-4448-b3d8-eeaaf4468e42 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:05.517930 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:05.545844 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f339b2-321c-41fc-a3d0-7dfbc3b4589a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:05.546562 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f339b2-321c-41fc-a3d0-7dfbc3b4589a None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:05.546844 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f339b2-321c-41fc-a3d0-7dfbc3b4589a None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:05.547113 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f339b2-321c-41fc-a3d0-7dfbc3b4589a None admin] PATH_INFO: `/v3/services/compute` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:05.547768 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f339b2-321c-41fc-a3d0-7dfbc3b4589a None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:05.549135 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f339b2-321c-41fc-a3d0-7dfbc3b4589a None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:05.560667 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-84f339b2-321c-41fc-a3d0-7dfbc3b4589a None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 07 14:22:05.560667 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:22:05.560667 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 07 14:22:05.560667 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 07 14:22:05.560667 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 07 14:22:05.560667 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 07 14:22:05.560667 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 07 14:22:05.560667 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 14:22:05.560667 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 07 14:22:05.560667 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:22:05.560667 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 07 14:22:05.560667 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:22:05.560667 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:22:05.560667 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:22:05.560667 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:22:05.560667 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:22:05.560667 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:22:05.561637 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:22:05.561637 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:22:05.561637 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:22:05.561637 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:22:05.561637 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:22:05.561637 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:22:05.561637 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 07 14:22:05.561637 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 07 14:22:05.561637 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 07 14:22:05.561637 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 07 14:22:05.561637 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:22:05.561637 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:22:05.561637 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:22:05.561637 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:22:05.561637 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:22:05.561637 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:22:05.562476 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:22:05.562476 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jun 07 14:22:05.562476 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:22:05.562476 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:22:05.562476 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:22:05.562476 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:22:05.562476 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:22:05.562476 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:22:05.562476 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:22:05.562476 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:22:05.562476 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 07 14:22:05.562476 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 14:22:05.562476 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 07 14:22:05.562476 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:22:05.562476 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 496/1010] 10.222.0.86 () {56 vars in 1111 bytes} [Tue Jun 7 14:22:05 2022] GET /identity/v3/services/compute => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:22:05.568076 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9455cf99-50ae-487f-b6a8-748120c1fc9f None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:05.598916 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:05.670246 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9455cf99-50ae-487f-b6a8-748120c1fc9f None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:05.703708 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3452fa-70d8-4ea8-a12b-7f5e8be6eafb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:05.704411 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3452fa-70d8-4ea8-a12b-7f5e8be6eafb None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:05.704695 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3452fa-70d8-4ea8-a12b-7f5e8be6eafb None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:05.704971 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3452fa-70d8-4ea8-a12b-7f5e8be6eafb None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:05.705678 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3452fa-70d8-4ea8-a12b-7f5e8be6eafb None admin] RBAC: Adding query filter params (name=compute) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:22:05.705985 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3452fa-70d8-4ea8-a12b-7f5e8be6eafb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:05.707338 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3452fa-70d8-4ea8-a12b-7f5e8be6eafb None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:05.715974 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 515/1011] 10.222.0.86 () {56 vars in 1112 bytes} [Tue Jun 7 14:22:05 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:22:05.718852 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f339b2-321c-41fc-a3d0-7dfbc3b4589a None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:05.822215 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f339b2-321c-41fc-a3d0-7dfbc3b4589a None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:05.856376 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc09818-f8e1-42bc-9fdc-cd69892cd4f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:05.857039 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc09818-f8e1-42bc-9fdc-cd69892cd4f1 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:05.857326 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc09818-f8e1-42bc-9fdc-cd69892cd4f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:05.857605 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc09818-f8e1-42bc-9fdc-cd69892cd4f1 None admin] PATH_INFO: `/v3/services` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:05.858378 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc09818-f8e1-42bc-9fdc-cd69892cd4f1 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:22:05.858734 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc09818-f8e1-42bc-9fdc-cd69892cd4f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:05.860072 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc09818-f8e1-42bc-9fdc-cd69892cd4f1 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:05.866429 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 497/1012] 10.222.0.86 () {56 vars in 1112 bytes} [Tue Jun 7 14:22:05 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:22:05.870664 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3452fa-70d8-4ea8-a12b-7f5e8be6eafb None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:05.969976 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:05.976474 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3452fa-70d8-4ea8-a12b-7f5e8be6eafb None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:06.010970 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3754698-5b8f-4076-aa8b-ee7f3ebf1131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:06.011808 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3754698-5b8f-4076-aa8b-ee7f3ebf1131 None admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:06.012198 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3754698-5b8f-4076-aa8b-ee7f3ebf1131 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:06.012579 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3754698-5b8f-4076-aa8b-ee7f3ebf1131 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:06.013444 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3754698-5b8f-4076-aa8b-ee7f3ebf1131 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:06.014905 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3754698-5b8f-4076-aa8b-ee7f3ebf1131 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:06.103869 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 516/1013] 10.222.0.86 () {60 vars in 1144 bytes} [Tue Jun 7 14:22:05 2022] POST /identity/v3/endpoints => generated 334 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:22:07.376994 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694bf767-744f-4a1d-8db8-939ea17806df None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:07.377508 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694bf767-744f-4a1d-8db8-939ea17806df None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:07.377586 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694bf767-744f-4a1d-8db8-939ea17806df None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:07.378938 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 498/1014] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:22:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:22:07.384223 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc57d7e-70ce-4897-aac4-73e3cc0f2f50 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:07.384679 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc57d7e-70ce-4897-aac4-73e3cc0f2f50 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:07.384824 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc57d7e-70ce-4897-aac4-73e3cc0f2f50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:07.402627 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-5dc57d7e-70ce-4897-aac4-73e3cc0f2f50 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:22:07.403803 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-5dc57d7e-70ce-4897-aac4-73e3cc0f2f50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:07.478511 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 517/1015] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:22:07 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 14:22:07.489259 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a65d2f-a438-43c4-8b9d-331eae3f63f4 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:07.489498 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a65d2f-a438-43c4-8b9d-331eae3f63f4 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:07.489780 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a65d2f-a438-43c4-8b9d-331eae3f63f4 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:07.491266 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 499/1016] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:22:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:22:07.496810 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b669f25-e1bb-4b05-8786-e129b5d62dd2 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:07.497108 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b669f25-e1bb-4b05-8786-e129b5d62dd2 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:07.497390 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b669f25-e1bb-4b05-8786-e129b5d62dd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:07.501608 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a65d2f-a438-43c4-8b9d-331eae3f63f4 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:07.515173 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-0b669f25-e1bb-4b05-8786-e129b5d62dd2 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:22:07.516421 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-0b669f25-e1bb-4b05-8786-e129b5d62dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:07.543852 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:07.592622 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 518/1017] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:22:07 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 14:22:07.611218 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a65d2f-a438-43c4-8b9d-331eae3f63f4 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:07.614631 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b669f25-e1bb-4b05-8786-e129b5d62dd2 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:07.624967 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:07.648312 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fafbc3a-e93d-4476-adfe-742f616b674e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:07.649301 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fafbc3a-e93d-4476-adfe-742f616b674e None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:07.649591 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fafbc3a-e93d-4476-adfe-742f616b674e None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:07.649866 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fafbc3a-e93d-4476-adfe-742f616b674e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:07.651064 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fafbc3a-e93d-4476-adfe-742f616b674e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:07.652640 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fafbc3a-e93d-4476-adfe-742f616b674e None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:07.654596 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 500/1018] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jun 7 14:22:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:22:07.659898 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fafbc3a-e93d-4476-adfe-742f616b674e None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:07.729526 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b669f25-e1bb-4b05-8786-e129b5d62dd2 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:07.763911 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fafbc3a-e93d-4476-adfe-742f616b674e None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:07.765991 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:07.766702 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d152072-4858-40a5-bf7b-7c83e1a27048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:07.767383 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d152072-4858-40a5-bf7b-7c83e1a27048 None admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:07.767665 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d152072-4858-40a5-bf7b-7c83e1a27048 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:07.767987 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d152072-4858-40a5-bf7b-7c83e1a27048 None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:07.768717 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d152072-4858-40a5-bf7b-7c83e1a27048 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:07.770076 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d152072-4858-40a5-bf7b-7c83e1a27048 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:07.798794 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17915c9d-2bc3-4ec9-9dea-17e70dcbea58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:07.799458 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17915c9d-2bc3-4ec9-9dea-17e70dcbea58 None admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:07.800039 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17915c9d-2bc3-4ec9-9dea-17e70dcbea58 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:07.800506 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17915c9d-2bc3-4ec9-9dea-17e70dcbea58 None admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:07.801632 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17915c9d-2bc3-4ec9-9dea-17e70dcbea58 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:07.803044 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17915c9d-2bc3-4ec9-9dea-17e70dcbea58 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:07.899911 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 519/1019] 10.222.0.86 () {60 vars in 1141 bytes} [Tue Jun 7 14:22:07 2022] POST /identity/v3/services => generated 242 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 14:22:07.930470 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 501/1020] 10.222.0.86 () {60 vars in 1141 bytes} [Tue Jun 7 14:22:07 2022] POST /identity/v3/projects => generated 311 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 14:22:08.462230 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf727cf-76b6-4d09-8cf4-eeaee89bdd23 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:08.462747 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf727cf-76b6-4d09-8cf4-eeaee89bdd23 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:08.462825 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf727cf-76b6-4d09-8cf4-eeaee89bdd23 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:08.465027 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 520/1021] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:22:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:22:08.470243 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b4f767-0a23-48cb-ab40-86177aeaaaad None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:08.470655 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b4f767-0a23-48cb-ab40-86177aeaaaad None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:08.470827 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b4f767-0a23-48cb-ab40-86177aeaaaad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:08.488018 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-76b4f767-0a23-48cb-ab40-86177aeaaaad None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:22:08.489146 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-76b4f767-0a23-48cb-ab40-86177aeaaaad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:08.563628 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 502/1022] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:22:08 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 14:22:08.587260 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf727cf-76b6-4d09-8cf4-eeaee89bdd23 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:08.655517 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:08.690135 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf727cf-76b6-4d09-8cf4-eeaee89bdd23 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:08.725729 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd346f1-ea5e-40a3-a4c1-b5647ac61fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:08.726542 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd346f1-ea5e-40a3-a4c1-b5647ac61fc0 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:08.726825 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd346f1-ea5e-40a3-a4c1-b5647ac61fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:08.727097 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd346f1-ea5e-40a3-a4c1-b5647ac61fc0 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:08.738369 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd346f1-ea5e-40a3-a4c1-b5647ac61fc0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:22:08.748077 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-3fd346f1-ea5e-40a3-a4c1-b5647ac61fc0 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 07 14:22:08.748077 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:22:08.748077 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:22:08.748077 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:22:08.748077 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:22:08.748077 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:22:08.748077 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:22:08.748077 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:22:08.748077 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:22:08.748077 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:22:08.748077 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:22:08.748077 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:22:08.748077 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:22:08.748077 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:22:08.748077 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:22:08.748077 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:22:08.748999 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:22:08.748999 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:22:08.748999 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:22:08.748999 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:22:08.748999 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:22:08.748999 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:22:08.748999 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:22:08.748999 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:22:08.748999 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:22:08.748999 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:22:08.748999 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:22:08.748999 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jun 07 14:22:08.748999 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:22:08.748999 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:22:08.748999 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:22:08.748999 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:22:08.749837 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:22:08.749837 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:22:08.749837 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:22:08.749837 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:22:08.749837 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:22:08.749837 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:22:08.749837 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:22:08.749837 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:22:08.749837 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:22:08.749837 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:22:08.749837 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 07 14:22:08.749837 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:22:08.750491 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 521/1023] 10.222.0.86 () {56 vars in 1120 bytes} [Tue Jun 7 14:22:08 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:22:08.756866 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b4f767-0a23-48cb-ab40-86177aeaaaad None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:08.840389 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:08.859710 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b4f767-0a23-48cb-ab40-86177aeaaaad None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:08.898969 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9c2a1b-d906-414c-a276-dcf0906d9ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:08.901599 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9c2a1b-d906-414c-a276-dcf0906d9ff4 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:08.901599 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9c2a1b-d906-414c-a276-dcf0906d9ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:08.901599 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9c2a1b-d906-414c-a276-dcf0906d9ff4 None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:08.902223 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9c2a1b-d906-414c-a276-dcf0906d9ff4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:22:08.902571 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9c2a1b-d906-414c-a276-dcf0906d9ff4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:08.904578 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9c2a1b-d906-414c-a276-dcf0906d9ff4 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:08.914186 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 503/1024] 10.222.0.86 () {56 vars in 1115 bytes} [Tue Jun 7 14:22:08 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:22:08.922521 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd346f1-ea5e-40a3-a4c1-b5647ac61fc0 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:09.026049 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd346f1-ea5e-40a3-a4c1-b5647ac61fc0 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:09.053613 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:09.064341 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdc337f-2d5b-4f77-a75e-446b129aab34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:09.065193 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdc337f-2d5b-4f77-a75e-446b129aab34 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:09.065596 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdc337f-2d5b-4f77-a75e-446b129aab34 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:09.065876 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdc337f-2d5b-4f77-a75e-446b129aab34 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:09.079449 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdc337f-2d5b-4f77-a75e-446b129aab34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:09.081933 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdc337f-2d5b-4f77-a75e-446b129aab34 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:09.101080 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-9bdc337f-2d5b-4f77-a75e-446b129aab34 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:22:09.101080 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:22:09.101080 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:22:09.101080 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:22:09.101080 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:22:09.101080 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:22:09.101080 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:22:09.101080 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:22:09.101080 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:22:09.101080 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:22:09.101080 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:22:09.101080 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:22:09.101080 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:22:09.101080 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:22:09.101080 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:22:09.102087 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:22:09.102087 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:22:09.102087 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:22:09.102087 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:22:09.102087 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:22:09.102087 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:22:09.102087 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:22:09.102087 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:22:09.102087 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jun 07 14:22:09.102087 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:22:09.102087 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:22:09.102087 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:22:09.102087 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:22:09.102087 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:22:09.102087 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:22:09.102087 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:22:09.102087 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:22:09.103092 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:22:09.103092 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:22:09.103092 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:22:09.103092 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:22:09.106973 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 522/1025] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jun 7 14:22:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:22:09.108402 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9c2a1b-d906-414c-a276-dcf0906d9ff4 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:09.218717 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9c2a1b-d906-414c-a276-dcf0906d9ff4 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:09.255349 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910e5901-f398-434a-9b2c-3b8c92a249ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:09.256033 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910e5901-f398-434a-9b2c-3b8c92a249ef None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:09.256316 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910e5901-f398-434a-9b2c-3b8c92a249ef None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:09.256591 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910e5901-f398-434a-9b2c-3b8c92a249ef None admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:09.257308 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910e5901-f398-434a-9b2c-3b8c92a249ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:22:09.257613 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910e5901-f398-434a-9b2c-3b8c92a249ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:09.258966 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910e5901-f398-434a-9b2c-3b8c92a249ef None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:09.271343 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 504/1026] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jun 7 14:22:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:22:09.276769 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdc337f-2d5b-4f77-a75e-446b129aab34 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:09.380935 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdc337f-2d5b-4f77-a75e-446b129aab34 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:09.414334 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f27f6a-e772-472c-b754-bb79d50f2f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:09.415119 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f27f6a-e772-472c-b754-bb79d50f2f42 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:09.415408 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f27f6a-e772-472c-b754-bb79d50f2f42 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:09.415680 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f27f6a-e772-472c-b754-bb79d50f2f42 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:09.424355 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f27f6a-e772-472c-b754-bb79d50f2f42 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:09.425790 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f27f6a-e772-472c-b754-bb79d50f2f42 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:09.440263 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-c1f27f6a-e772-472c-b754-bb79d50f2f42 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 07 14:22:09.440263 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:22:09.440263 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:22:09.440263 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:22:09.440263 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:22:09.440263 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:22:09.440263 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:22:09.440263 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:22:09.440263 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:22:09.440263 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:22:09.440263 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:22:09.440263 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:22:09.440263 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 14:22:09.440263 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 14:22:09.440263 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 14:22:09.440263 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 14:22:09.441225 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:22:09.441225 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:22:09.441225 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 14:22:09.441225 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:22:09.441225 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 14:22:09.441225 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:22:09.441225 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:22:09.441225 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:22:09.441225 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:22:09.441225 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:22:09.441225 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:22:09.441225 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jun 07 14:22:09.441225 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:22:09.441225 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:22:09.441225 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:22:09.441225 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:22:09.441225 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:22:09.441225 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:22:09.442194 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:22:09.442194 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:22:09.442194 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 14:22:09.442194 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 14:22:09.442194 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 14:22:09.442194 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 14:22:09.442194 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 14:22:09.442194 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 14:22:09.442194 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 07 14:22:09.442194 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:22:09.442194 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 523/1027] 10.222.0.86 () {56 vars in 1093 bytes} [Tue Jun 7 14:22:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:22:09.446960 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910e5901-f398-434a-9b2c-3b8c92a249ef None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:09.450001 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:09.548438 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910e5901-f398-434a-9b2c-3b8c92a249ef None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:09.583984 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3558da4b-c082-472c-b583-43f24e9818de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:09.585034 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3558da4b-c082-472c-b583-43f24e9818de None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:09.585531 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3558da4b-c082-472c-b583-43f24e9818de None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:09.586017 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3558da4b-c082-472c-b583-43f24e9818de None admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:09.587059 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3558da4b-c082-472c-b583-43f24e9818de None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:22:09.587579 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3558da4b-c082-472c-b583-43f24e9818de None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:09.589277 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3558da4b-c082-472c-b583-43f24e9818de None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:09.607374 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 505/1028] 10.222.0.86 () {56 vars in 1133 bytes} [Tue Jun 7 14:22:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:22:09.612760 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f27f6a-e772-472c-b754-bb79d50f2f42 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:09.654320 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:09.712863 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f27f6a-e772-472c-b754-bb79d50f2f42 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:09.746786 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37a4883-4e18-4159-8c9e-859238204b63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:09.747442 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37a4883-4e18-4159-8c9e-859238204b63 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:09.747726 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37a4883-4e18-4159-8c9e-859238204b63 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:09.748027 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37a4883-4e18-4159-8c9e-859238204b63 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:09.815049 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37a4883-4e18-4159-8c9e-859238204b63 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:09.816433 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37a4883-4e18-4159-8c9e-859238204b63 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:09.860143 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:09.922650 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 524/1029] 10.222.0.86 () {58 vars in 1282 bytes} [Tue Jun 7 14:22:09 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 07 14:22:09.928070 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3558da4b-c082-472c-b583-43f24e9818de None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:09.990899 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:10.031625 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3558da4b-c082-472c-b583-43f24e9818de None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:10.065370 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781b6ba3-76e8-4678-b2dc-befbf99a144d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:10.066075 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781b6ba3-76e8-4678-b2dc-befbf99a144d None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:10.066351 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781b6ba3-76e8-4678-b2dc-befbf99a144d None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:10.066620 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781b6ba3-76e8-4678-b2dc-befbf99a144d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:10.076867 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781b6ba3-76e8-4678-b2dc-befbf99a144d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:10.078295 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781b6ba3-76e8-4678-b2dc-befbf99a144d None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:10.095821 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-781b6ba3-76e8-4678-b2dc-befbf99a144d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:22:10.095821 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:22:10.095821 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:22:10.095821 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:22:10.095821 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:22:10.095821 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:22:10.095821 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:22:10.095821 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:22:10.095821 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:22:10.095821 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:22:10.095821 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:22:10.095821 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:22:10.095821 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:22:10.095821 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:22:10.095821 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:22:10.096712 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:22:10.096712 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:22:10.096712 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:22:10.096712 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:22:10.096712 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:22:10.096712 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:22:10.096712 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:22:10.096712 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:22:10.096712 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jun 07 14:22:10.096712 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:22:10.096712 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:22:10.096712 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:22:10.096712 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:22:10.096712 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:22:10.096712 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:22:10.096712 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:22:10.096712 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:22:10.097608 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:22:10.097608 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:22:10.097608 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:22:10.097608 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:22:10.098477 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 506/1030] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jun 7 14:22:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:22:10.102589 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37a4883-4e18-4159-8c9e-859238204b63 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:10.188437 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33bf5d4-eba9-4315-a0e6-615769619a61 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:10.188726 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33bf5d4-eba9-4315-a0e6-615769619a61 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:10.189006 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33bf5d4-eba9-4315-a0e6-615769619a61 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:10.190508 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 507/1031] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:22:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:22:10.195180 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6befb5d7-2aac-4df5-84a3-86f001acd415 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:10.195473 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6befb5d7-2aac-4df5-84a3-86f001acd415 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:10.195749 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6befb5d7-2aac-4df5-84a3-86f001acd415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:10.211384 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37a4883-4e18-4159-8c9e-859238204b63 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:10.213690 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-6befb5d7-2aac-4df5-84a3-86f001acd415 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:22:10.214859 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-6befb5d7-2aac-4df5-84a3-86f001acd415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:10.252236 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb2364a-a9f6-461f-9a91-9c27d66797fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:10.252906 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb2364a-a9f6-461f-9a91-9c27d66797fb None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:10.253190 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb2364a-a9f6-461f-9a91-9c27d66797fb None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:10.253466 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb2364a-a9f6-461f-9a91-9c27d66797fb None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:10.254185 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb2364a-a9f6-461f-9a91-9c27d66797fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:22:10.254497 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb2364a-a9f6-461f-9a91-9c27d66797fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:10.255883 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb2364a-a9f6-461f-9a91-9c27d66797fb None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:10.264731 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:10.272428 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 525/1032] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jun 7 14:22:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:22:10.274340 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb2364a-a9f6-461f-9a91-9c27d66797fb None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:10.295595 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 508/1033] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:22:10 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 07 14:22:10.311504 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dded76e-23e8-4173-9cb9-1d16769a5c49 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:10.312107 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dded76e-23e8-4173-9cb9-1d16769a5c49 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:10.312553 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dded76e-23e8-4173-9cb9-1d16769a5c49 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:10.314033 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 509/1034] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:22:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:22:10.319062 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a398188-4c82-46af-908b-3c42eea72951 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:10.319289 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a398188-4c82-46af-908b-3c42eea72951 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:10.319585 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a398188-4c82-46af-908b-3c42eea72951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:10.335676 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-1a398188-4c82-46af-908b-3c42eea72951 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:22:10.337022 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-1a398188-4c82-46af-908b-3c42eea72951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:10.371220 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:10.377276 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb2364a-a9f6-461f-9a91-9c27d66797fb None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:10.401370 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 510/1035] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:22:10 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 07 14:22:10.402184 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a398188-4c82-46af-908b-3c42eea72951 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:10.412993 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d254d488-4f32-4a95-b9a5-9251b58a431b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:10.413798 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d254d488-4f32-4a95-b9a5-9251b58a431b None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:10.414076 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d254d488-4f32-4a95-b9a5-9251b58a431b None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:10.414358 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d254d488-4f32-4a95-b9a5-9251b58a431b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:10.421715 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d254d488-4f32-4a95-b9a5-9251b58a431b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:10.423253 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d254d488-4f32-4a95-b9a5-9251b58a431b None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:10.439668 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-d254d488-4f32-4a95-b9a5-9251b58a431b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:22:10.439668 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:22:10.439668 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:22:10.439668 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:22:10.439668 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:22:10.439668 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:22:10.439668 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:22:10.439668 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:22:10.439668 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:22:10.439668 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:22:10.439668 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:22:10.439668 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:22:10.439668 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 14:22:10.439668 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 14:22:10.439668 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 14:22:10.440785 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 14:22:10.440785 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:22:10.440785 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:22:10.440785 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:22:10.440785 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:22:10.440785 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:22:10.440785 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:22:10.440785 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:22:10.440785 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jun 07 14:22:10.440785 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:22:10.440785 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:22:10.440785 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:22:10.440785 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:22:10.440785 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:22:10.440785 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:22:10.440785 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:22:10.440785 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:22:10.441731 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 14:22:10.441731 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 14:22:10.441731 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 14:22:10.441731 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 14:22:10.441731 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 14:22:10.441731 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 14:22:10.441731 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:22:10.441731 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:22:10.441731 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 526/1036] 10.222.0.86 () {56 vars in 1111 bytes} [Tue Jun 7 14:22:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 14:22:10.442248 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d254d488-4f32-4a95-b9a5-9251b58a431b None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:10.499456 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:10.503098 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a398188-4c82-46af-908b-3c42eea72951 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:10.536730 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76654d54-9f41-450d-be0b-1c23515e88c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:10.537759 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76654d54-9f41-450d-be0b-1c23515e88c9 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:10.538042 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76654d54-9f41-450d-be0b-1c23515e88c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:10.538314 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76654d54-9f41-450d-be0b-1c23515e88c9 None admin] PATH_INFO: `/v3/services/image` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:10.538985 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76654d54-9f41-450d-be0b-1c23515e88c9 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:10.539711 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d254d488-4f32-4a95-b9a5-9251b58a431b None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:10.540368 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76654d54-9f41-450d-be0b-1c23515e88c9 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:10.552335 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-76654d54-9f41-450d-be0b-1c23515e88c9 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 07 14:22:10.552335 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:22:10.552335 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 07 14:22:10.552335 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 07 14:22:10.552335 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 07 14:22:10.552335 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 07 14:22:10.552335 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 07 14:22:10.552335 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 14:22:10.552335 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 07 14:22:10.552335 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:22:10.552335 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 07 14:22:10.552335 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:22:10.552335 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:22:10.552335 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:22:10.552335 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:22:10.552335 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:22:10.552335 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:22:10.553924 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:22:10.553924 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:22:10.553924 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:22:10.553924 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:22:10.553924 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:22:10.553924 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:22:10.553924 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 07 14:22:10.553924 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 07 14:22:10.553924 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 07 14:22:10.553924 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 07 14:22:10.553924 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:22:10.553924 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:22:10.553924 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:22:10.553924 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:22:10.553924 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:22:10.553924 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:22:10.554866 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:22:10.554866 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jun 07 14:22:10.554866 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:22:10.554866 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:22:10.554866 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:22:10.554866 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:22:10.554866 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:22:10.554866 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:22:10.554866 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:22:10.554866 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:22:10.554866 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 07 14:22:10.554866 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 14:22:10.554866 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 07 14:22:10.554866 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:22:10.556373 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 511/1037] 10.222.0.86 () {56 vars in 1105 bytes} [Tue Jun 7 14:22:10 2022] GET /identity/v3/services/image => generated 86 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:22:10.557253 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76654d54-9f41-450d-be0b-1c23515e88c9 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:10.574007 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfe2963-310a-4fe2-bd94-89baebf69f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:10.574730 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfe2963-310a-4fe2-bd94-89baebf69f96 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:10.575010 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfe2963-310a-4fe2-bd94-89baebf69f96 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:10.575283 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfe2963-310a-4fe2-bd94-89baebf69f96 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:10.576449 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfe2963-310a-4fe2-bd94-89baebf69f96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:10.577861 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfe2963-310a-4fe2-bd94-89baebf69f96 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:10.579446 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 527/1038] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jun 7 14:22:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:22:10.584899 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfe2963-310a-4fe2-bd94-89baebf69f96 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:10.592171 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:10.656215 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76654d54-9f41-450d-be0b-1c23515e88c9 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:10.683272 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfe2963-310a-4fe2-bd94-89baebf69f96 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:10.689371 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a418532e-5db5-46a3-ab51-08028ac5832c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:10.690023 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a418532e-5db5-46a3-ab51-08028ac5832c None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:10.690315 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a418532e-5db5-46a3-ab51-08028ac5832c None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:10.690592 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a418532e-5db5-46a3-ab51-08028ac5832c None admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:10.691372 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a418532e-5db5-46a3-ab51-08028ac5832c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:22:10.691684 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a418532e-5db5-46a3-ab51-08028ac5832c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:10.693132 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a418532e-5db5-46a3-ab51-08028ac5832c None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:10.705203 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 512/1039] 10.222.0.86 () {56 vars in 1148 bytes} [Tue Jun 7 14:22:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:22:10.705966 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a418532e-5db5-46a3-ab51-08028ac5832c None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:10.714166 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:10.721990 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8ec517-c606-4fa5-9978-5e92d84fe7a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:10.722650 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8ec517-c606-4fa5-9978-5e92d84fe7a6 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:10.726872 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8ec517-c606-4fa5-9978-5e92d84fe7a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:10.726872 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8ec517-c606-4fa5-9978-5e92d84fe7a6 None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:10.726872 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8ec517-c606-4fa5-9978-5e92d84fe7a6 None admin] RBAC: Adding query filter params (name=image) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:22:10.726872 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8ec517-c606-4fa5-9978-5e92d84fe7a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:10.726872 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8ec517-c606-4fa5-9978-5e92d84fe7a6 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:10.730866 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 528/1040] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jun 7 14:22:10 2022] GET /identity/v3/services?name=image => generated 122 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:22:10.731648 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8ec517-c606-4fa5-9978-5e92d84fe7a6 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:10.798907 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:10.804781 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a418532e-5db5-46a3-ab51-08028ac5832c None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:10.834649 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8ec517-c606-4fa5-9978-5e92d84fe7a6 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:10.838527 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b46a8d-4ce5-4484-be6c-6d8b7e9ee448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:10.839198 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b46a8d-4ce5-4484-be6c-6d8b7e9ee448 None admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:10.839534 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b46a8d-4ce5-4484-be6c-6d8b7e9ee448 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:10.839855 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b46a8d-4ce5-4484-be6c-6d8b7e9ee448 None admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:10.840613 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b46a8d-4ce5-4484-be6c-6d8b7e9ee448 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:10.842042 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b46a8d-4ce5-4484-be6c-6d8b7e9ee448 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:10.866752 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa2daae-ced7-4d39-81fd-0f674e6c60d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:10.867394 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa2daae-ced7-4d39-81fd-0f674e6c60d3 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:10.867675 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa2daae-ced7-4d39-81fd-0f674e6c60d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:10.867995 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa2daae-ced7-4d39-81fd-0f674e6c60d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:10.868845 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa2daae-ced7-4d39-81fd-0f674e6c60d3 None admin] RBAC: Adding query filter params (role.id=8639adefbbcc4029bf422565e1a299b7, scope.project.id=e429537b190c4c5ea7e1332ab044ca7a, user.id=b99cfb70f54c45c8870369359da20378) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:22:10.869251 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa2daae-ced7-4d39-81fd-0f674e6c60d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:10.870759 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa2daae-ced7-4d39-81fd-0f674e6c60d3 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:10.876167 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 529/1041] 10.222.0.86 () {56 vars in 1374 bytes} [Tue Jun 7 14:22:10 2022] GET /identity/v3/role_assignments?user.id=b99cfb70f54c45c8870369359da20378&scope.project.id=e429537b190c4c5ea7e1332ab044ca7a&role.id=8639adefbbcc4029bf422565e1a299b7 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:22:10.878005 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa2daae-ced7-4d39-81fd-0f674e6c60d3 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:10.943802 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 513/1042] 10.222.0.86 () {60 vars in 1132 bytes} [Tue Jun 7 14:22:10 2022] POST /identity/v3/users => generated 285 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:22:10.945860 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:10.995363 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa2daae-ced7-4d39-81fd-0f674e6c60d3 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:11.035738 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3d75b5-f5ac-457a-b61f-98beed27c4b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:11.036464 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3d75b5-f5ac-457a-b61f-98beed27c4b1 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:11.036751 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3d75b5-f5ac-457a-b61f-98beed27c4b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:11.037030 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3d75b5-f5ac-457a-b61f-98beed27c4b1 None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:11.038057 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3d75b5-f5ac-457a-b61f-98beed27c4b1 None admin] RBAC: Adding query filter params (type=image) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:22:11.038369 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3d75b5-f5ac-457a-b61f-98beed27c4b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:11.039811 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3d75b5-f5ac-457a-b61f-98beed27c4b1 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:11.046047 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 530/1043] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jun 7 14:22:10 2022] GET /identity/v3/services?type=image => generated 350 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:22:11.052405 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b46a8d-4ce5-4484-be6c-6d8b7e9ee448 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:11.163533 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b46a8d-4ce5-4484-be6c-6d8b7e9ee448 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:11.204679 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458db32d-8465-444d-95b5-973c8c51e4de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:11.205354 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458db32d-8465-444d-95b5-973c8c51e4de None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:11.205634 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458db32d-8465-444d-95b5-973c8c51e4de None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:11.205907 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458db32d-8465-444d-95b5-973c8c51e4de None admin] PATH_INFO: `/v3/endpoints` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:11.206702 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458db32d-8465-444d-95b5-973c8c51e4de None admin] RBAC: Adding query filter params (interface=public, service_id=73eb301084a94be0bcd643d5e89af17c, region_id=RegionOne) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:22:11.207019 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458db32d-8465-444d-95b5-973c8c51e4de None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:11.208435 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458db32d-8465-444d-95b5-973c8c51e4de None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:11.215008 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 514/1044] 10.222.0.86 () {56 vars in 1251 bytes} [Tue Jun 7 14:22:11 2022] GET /identity/v3/endpoints?service_id=73eb301084a94be0bcd643d5e89af17c&interface=public®ion_id=RegionOne => generated 194 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:22:11.220639 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3d75b5-f5ac-457a-b61f-98beed27c4b1 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:11.326747 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3d75b5-f5ac-457a-b61f-98beed27c4b1 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:11.347808 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:11.362261 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a8b839-accb-4c1c-b289-a9620e7a7aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:11.362930 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a8b839-accb-4c1c-b289-a9620e7a7aaa None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:11.363220 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a8b839-accb-4c1c-b289-a9620e7a7aaa None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:11.363501 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a8b839-accb-4c1c-b289-a9620e7a7aaa None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:11.364212 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a8b839-accb-4c1c-b289-a9620e7a7aaa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:11.365581 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a8b839-accb-4c1c-b289-a9620e7a7aaa None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:11.377301 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 531/1045] 10.222.0.86 () {56 vars in 1087 bytes} [Tue Jun 7 14:22:11 2022] GET /identity/v3/services => generated 1957 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:22:13.156452 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc34a08-9b73-46cf-b80b-84def3c08495 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:13.156980 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc34a08-9b73-46cf-b80b-84def3c08495 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:13.157060 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc34a08-9b73-46cf-b80b-84def3c08495 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:13.158542 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 515/1046] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:22:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:22:13.163900 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d438cd-c40e-4473-8629-a3be164b933a None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:13.164307 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d438cd-c40e-4473-8629-a3be164b933a None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:13.164485 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d438cd-c40e-4473-8629-a3be164b933a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:13.182475 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-34d438cd-c40e-4473-8629-a3be164b933a None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:22:13.183667 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-34d438cd-c40e-4473-8629-a3be164b933a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:13.256671 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 532/1047] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:22:13 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 14:22:13.265979 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836a7a74-a3d4-4b17-bd0e-42a3743bcba0 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:13.266372 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836a7a74-a3d4-4b17-bd0e-42a3743bcba0 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:13.266725 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836a7a74-a3d4-4b17-bd0e-42a3743bcba0 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:13.271797 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 516/1048] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:22:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:22:13.273629 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497274fd-5ae4-4bf5-82d8-41a311c250d0 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:13.273925 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497274fd-5ae4-4bf5-82d8-41a311c250d0 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:13.274201 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497274fd-5ae4-4bf5-82d8-41a311c250d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:13.279681 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836a7a74-a3d4-4b17-bd0e-42a3743bcba0 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:13.292098 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-497274fd-5ae4-4bf5-82d8-41a311c250d0 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:22:13.293329 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-497274fd-5ae4-4bf5-82d8-41a311c250d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:13.301005 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:13.373659 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 533/1049] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:22:13 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 07 14:22:13.392801 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836a7a74-a3d4-4b17-bd0e-42a3743bcba0 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:13.397206 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497274fd-5ae4-4bf5-82d8-41a311c250d0 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:13.429966 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e522ee1-2a7f-403d-a976-16c6eb861d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:13.430695 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e522ee1-2a7f-403d-a976-16c6eb861d60 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:13.430980 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e522ee1-2a7f-403d-a976-16c6eb861d60 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:13.431262 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e522ee1-2a7f-403d-a976-16c6eb861d60 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:13.442099 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e522ee1-2a7f-403d-a976-16c6eb861d60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:22:13.446765 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:13.450585 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-0e522ee1-2a7f-403d-a976-16c6eb861d60 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 07 14:22:13.450585 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:22:13.450585 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:22:13.450585 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:22:13.450585 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:22:13.450585 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:22:13.450585 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:22:13.450585 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:22:13.450585 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:22:13.450585 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:22:13.450585 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:22:13.450585 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:22:13.450585 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:22:13.450585 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:22:13.450585 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:22:13.450585 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:22:13.451529 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:22:13.451529 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:22:13.451529 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:22:13.451529 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:22:13.451529 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:22:13.451529 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:22:13.451529 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:22:13.451529 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:22:13.451529 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:22:13.451529 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:22:13.451529 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:22:13.451529 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jun 07 14:22:13.451529 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:22:13.451529 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:22:13.451529 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:22:13.451529 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:22:13.464811 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:22:13.464811 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:22:13.464811 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:22:13.464811 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:22:13.464811 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:22:13.464811 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:22:13.464811 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:22:13.464811 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:22:13.464811 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:22:13.464811 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:22:13.464811 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 07 14:22:13.464811 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:22:13.464811 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 517/1050] 10.222.0.86 () {56 vars in 1120 bytes} [Tue Jun 7 14:22:13 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:22:13.464811 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e522ee1-2a7f-403d-a976-16c6eb861d60 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:13.513685 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497274fd-5ae4-4bf5-82d8-41a311c250d0 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:13.545040 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:13.551106 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f0f7a3-ca2f-4b55-9745-50d6003f7bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:13.551937 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f0f7a3-ca2f-4b55-9745-50d6003f7bef None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:13.552223 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f0f7a3-ca2f-4b55-9745-50d6003f7bef None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:13.552654 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f0f7a3-ca2f-4b55-9745-50d6003f7bef None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:13.563436 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f0f7a3-ca2f-4b55-9745-50d6003f7bef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:22:13.568427 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e522ee1-2a7f-403d-a976-16c6eb861d60 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:13.571256 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-f8f0f7a3-ca2f-4b55-9745-50d6003f7bef None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 14:22:13.571256 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:22:13.571256 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:22:13.571256 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:22:13.571256 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:22:13.571256 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:22:13.571256 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:22:13.571256 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:22:13.571256 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:22:13.571256 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:22:13.571256 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:22:13.571256 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:22:13.571256 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:22:13.571256 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:22:13.571256 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:22:13.571256 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:22:13.572316 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:22:13.572316 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:22:13.572316 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:22:13.572316 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:22:13.572316 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:22:13.572316 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:22:13.572316 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:22:13.572316 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:22:13.572316 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:22:13.572316 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:22:13.572316 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:22:13.572316 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jun 07 14:22:13.572316 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:22:13.572316 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:22:13.572316 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:22:13.572316 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:22:13.573254 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:22:13.573254 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:22:13.573254 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:22:13.573254 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:22:13.573254 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:22:13.573254 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:22:13.573254 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:22:13.573254 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:22:13.573254 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:22:13.573254 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:22:13.573254 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 14:22:13.573254 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:22:13.577707 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 534/1051] 10.222.0.86 () {56 vars in 1096 bytes} [Tue Jun 7 14:22:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 14:22:13.578276 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f0f7a3-ca2f-4b55-9745-50d6003f7bef None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:13.605984 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee6ec18-44df-4315-9996-21912635cfba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:13.606652 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee6ec18-44df-4315-9996-21912635cfba None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:13.606940 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee6ec18-44df-4315-9996-21912635cfba None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:13.607218 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee6ec18-44df-4315-9996-21912635cfba None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:13.607994 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee6ec18-44df-4315-9996-21912635cfba None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:22:13.608296 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee6ec18-44df-4315-9996-21912635cfba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:13.609653 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee6ec18-44df-4315-9996-21912635cfba None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:13.622521 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 518/1052] 10.222.0.86 () {56 vars in 1115 bytes} [Tue Jun 7 14:22:13 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:22:13.623605 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee6ec18-44df-4315-9996-21912635cfba None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:13.683731 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f0f7a3-ca2f-4b55-9745-50d6003f7bef None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:13.685983 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:13.717051 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d51b75-c9e8-459c-af42-a8815b4e2563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:13.717719 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d51b75-c9e8-459c-af42-a8815b4e2563 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:13.718002 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d51b75-c9e8-459c-af42-a8815b4e2563 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:13.718353 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d51b75-c9e8-459c-af42-a8815b4e2563 None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:13.719054 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d51b75-c9e8-459c-af42-a8815b4e2563 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:22:13.719357 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d51b75-c9e8-459c-af42-a8815b4e2563 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:13.720839 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d51b75-c9e8-459c-af42-a8815b4e2563 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:13.721868 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee6ec18-44df-4315-9996-21912635cfba None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:13.730041 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 535/1053] 10.222.0.86 () {56 vars in 1099 bytes} [Tue Jun 7 14:22:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:22:13.731416 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89faa692-1077-46bf-9aac-b7aa6bd8372a None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:13.731713 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89faa692-1077-46bf-9aac-b7aa6bd8372a None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:13.732015 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89faa692-1077-46bf-9aac-b7aa6bd8372a None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:13.733375 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 536/1054] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:22:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:22:13.735988 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89faa692-1077-46bf-9aac-b7aa6bd8372a None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:13.757511 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e95cd4f-a1cd-4681-b9c1-d83939e32d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:13.758294 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e95cd4f-a1cd-4681-b9c1-d83939e32d70 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:13.758574 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e95cd4f-a1cd-4681-b9c1-d83939e32d70 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:13.758846 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e95cd4f-a1cd-4681-b9c1-d83939e32d70 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:13.765820 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:13.770323 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e95cd4f-a1cd-4681-b9c1-d83939e32d70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:13.771948 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e95cd4f-a1cd-4681-b9c1-d83939e32d70 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:13.789442 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-3e95cd4f-a1cd-4681-b9c1-d83939e32d70 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:22:13.789442 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:22:13.789442 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:22:13.789442 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:22:13.789442 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:22:13.789442 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:22:13.789442 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:22:13.789442 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:22:13.789442 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:22:13.789442 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:22:13.789442 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:22:13.789442 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:22:13.789442 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:22:13.789442 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:22:13.789442 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:22:13.790365 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:22:13.790365 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:22:13.790365 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:22:13.790365 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:22:13.790365 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:22:13.790365 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:22:13.790365 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:22:13.790365 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:22:13.790365 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jun 07 14:22:13.790365 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:22:13.790365 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:22:13.790365 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:22:13.790365 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:22:13.790365 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:22:13.790365 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:22:13.790365 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:22:13.790365 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:22:13.791870 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:22:13.791870 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:22:13.791870 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:22:13.791870 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:22:13.791870 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 519/1055] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jun 7 14:22:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:22:13.793089 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0850c5-ff3f-448f-9cd1-b5ace3ecc420 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:13.793089 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0850c5-ff3f-448f-9cd1-b5ace3ecc420 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:13.793089 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0850c5-ff3f-448f-9cd1-b5ace3ecc420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:13.809439 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-4b0850c5-ff3f-448f-9cd1-b5ace3ecc420 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:22:13.810624 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-4b0850c5-ff3f-448f-9cd1-b5ace3ecc420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:13.840859 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89faa692-1077-46bf-9aac-b7aa6bd8372a None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:13.874789 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb42f53b-7560-4769-b4ea-bdb55a2e9094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:13.875681 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb42f53b-7560-4769-b4ea-bdb55a2e9094 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:13.876155 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb42f53b-7560-4769-b4ea-bdb55a2e9094 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:13.876436 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb42f53b-7560-4769-b4ea-bdb55a2e9094 None admin] PATH_INFO: `/v3/users/d7b11841d10e421884798c04ccedab4b` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:13.876915 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 520/1056] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:22:13 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 14:22:13.877783 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0850c5-ff3f-448f-9cd1-b5ace3ecc420 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:13.906384 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb42f53b-7560-4769-b4ea-bdb55a2e9094 None admin] RBAC: Authorizing `identity:get_user(user_id=d7b11841d10e421884798c04ccedab4b)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:13.907853 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb42f53b-7560-4769-b4ea-bdb55a2e9094 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:13.909559 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 537/1057] 10.222.0.86 () {56 vars in 1177 bytes} [Tue Jun 7 14:22:13 2022] GET /identity/v3/users/d7b11841d10e421884798c04ccedab4b => generated 285 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:22:13.910318 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb42f53b-7560-4769-b4ea-bdb55a2e9094 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:13.936473 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:13.975942 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0850c5-ff3f-448f-9cd1-b5ace3ecc420 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:13.995730 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:14.010371 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb42f53b-7560-4769-b4ea-bdb55a2e9094 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:14.012137 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a09d89-da46-40dd-8683-18a94218e2d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:14.012798 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a09d89-da46-40dd-8683-18a94218e2d8 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:14.013080 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a09d89-da46-40dd-8683-18a94218e2d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:14.013354 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a09d89-da46-40dd-8683-18a94218e2d8 None admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:14.014069 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a09d89-da46-40dd-8683-18a94218e2d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:22:14.014382 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a09d89-da46-40dd-8683-18a94218e2d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:14.015968 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a09d89-da46-40dd-8683-18a94218e2d8 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:14.027325 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 521/1058] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jun 7 14:22:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:22:14.028203 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a09d89-da46-40dd-8683-18a94218e2d8 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:14.046954 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c29416-bf32-4f1f-8562-f566e49a1ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:14.047769 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c29416-bf32-4f1f-8562-f566e49a1ca1 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:14.048059 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c29416-bf32-4f1f-8562-f566e49a1ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:14.048333 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c29416-bf32-4f1f-8562-f566e49a1ca1 None admin] PATH_INFO: `/v3/services/image` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:14.048981 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c29416-bf32-4f1f-8562-f566e49a1ca1 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:14.050338 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c29416-bf32-4f1f-8562-f566e49a1ca1 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:14.062887 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-53c29416-bf32-4f1f-8562-f566e49a1ca1 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 07 14:22:14.062887 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:22:14.062887 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 07 14:22:14.062887 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 07 14:22:14.062887 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 07 14:22:14.062887 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 07 14:22:14.062887 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 07 14:22:14.062887 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 14:22:14.062887 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 07 14:22:14.062887 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:22:14.062887 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 07 14:22:14.062887 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:22:14.062887 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:22:14.062887 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:22:14.062887 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:22:14.062887 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:22:14.062887 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:22:14.063939 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:22:14.063939 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:22:14.063939 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:22:14.063939 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:22:14.063939 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:22:14.063939 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:22:14.063939 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 07 14:22:14.063939 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 07 14:22:14.063939 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 07 14:22:14.063939 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 07 14:22:14.063939 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:22:14.063939 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:22:14.063939 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:22:14.063939 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:22:14.063939 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:22:14.063939 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:22:14.064778 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:22:14.064778 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jun 07 14:22:14.064778 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:22:14.064778 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:22:14.064778 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:22:14.064778 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:22:14.064778 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:22:14.064778 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:22:14.064778 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:22:14.064778 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:22:14.064778 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 07 14:22:14.064778 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 14:22:14.064778 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 07 14:22:14.064778 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:22:14.064778 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 538/1059] 10.222.0.86 () {56 vars in 1105 bytes} [Tue Jun 7 14:22:13 2022] GET /identity/v3/services/image => generated 86 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:22:14.065554 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c29416-bf32-4f1f-8562-f566e49a1ca1 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:14.131890 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a09d89-da46-40dd-8683-18a94218e2d8 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:14.155597 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:14.164307 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61705478-02ae-49d3-a41e-5edb0c46e1d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:14.164956 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61705478-02ae-49d3-a41e-5edb0c46e1d5 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:14.165229 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61705478-02ae-49d3-a41e-5edb0c46e1d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:14.165499 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61705478-02ae-49d3-a41e-5edb0c46e1d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:14.168429 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c29416-bf32-4f1f-8562-f566e49a1ca1 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:14.202822 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705dca59-0615-4b0e-911d-0321d1edeb4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:14.203543 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705dca59-0615-4b0e-911d-0321d1edeb4f None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:14.203868 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705dca59-0615-4b0e-911d-0321d1edeb4f None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:14.204146 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705dca59-0615-4b0e-911d-0321d1edeb4f None admin] PATH_INFO: `/v3/users/nova` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:14.211317 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705dca59-0615-4b0e-911d-0321d1edeb4f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:14.212896 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705dca59-0615-4b0e-911d-0321d1edeb4f None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:14.214978 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:14.227504 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-705dca59-0615-4b0e-911d-0321d1edeb4f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 07 14:22:14.227504 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:22:14.227504 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:22:14.227504 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:22:14.227504 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:22:14.227504 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:22:14.227504 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:22:14.227504 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:22:14.227504 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:22:14.227504 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:22:14.227504 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:22:14.227504 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:22:14.227504 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 14:22:14.227504 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 14:22:14.227504 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 14:22:14.227504 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 14:22:14.229221 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:22:14.229221 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:22:14.229221 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 14:22:14.229221 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:22:14.229221 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 14:22:14.229221 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:22:14.229221 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:22:14.229221 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:22:14.229221 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:22:14.229221 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:22:14.229221 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:22:14.229221 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jun 07 14:22:14.229221 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:22:14.229221 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:22:14.229221 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:22:14.229221 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:22:14.229221 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:22:14.229221 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:22:14.230310 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:22:14.230310 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:22:14.230310 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 14:22:14.230310 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 14:22:14.230310 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 14:22:14.230310 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 14:22:14.230310 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 14:22:14.230310 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 14:22:14.230310 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 07 14:22:14.230310 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:22:14.232410 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 539/1060] 10.222.0.86 () {56 vars in 1093 bytes} [Tue Jun 7 14:22:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:22:14.233346 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705dca59-0615-4b0e-911d-0321d1edeb4f None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:14.235566 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61705478-02ae-49d3-a41e-5edb0c46e1d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:14.237280 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61705478-02ae-49d3-a41e-5edb0c46e1d5 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:14.331255 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705dca59-0615-4b0e-911d-0321d1edeb4f None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:14.334189 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 522/1061] 10.222.0.86 () {58 vars in 1282 bytes} [Tue Jun 7 14:22:14 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 07 14:22:14.335010 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61705478-02ae-49d3-a41e-5edb0c46e1d5 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:14.368063 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6546cffa-ea6f-482b-ae31-27b4b6213ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:14.368726 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6546cffa-ea6f-482b-ae31-27b4b6213ee8 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:14.369062 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6546cffa-ea6f-482b-ae31-27b4b6213ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:14.369342 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6546cffa-ea6f-482b-ae31-27b4b6213ee8 None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:14.370045 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6546cffa-ea6f-482b-ae31-27b4b6213ee8 None admin] RBAC: Adding query filter params (name=image) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:22:14.370353 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6546cffa-ea6f-482b-ae31-27b4b6213ee8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:14.371720 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6546cffa-ea6f-482b-ae31-27b4b6213ee8 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:14.381230 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 540/1062] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jun 7 14:22:14 2022] GET /identity/v3/services?name=image => generated 122 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:22:14.381230 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6546cffa-ea6f-482b-ae31-27b4b6213ee8 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:14.393269 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:14.413750 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:14.432060 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61705478-02ae-49d3-a41e-5edb0c46e1d5 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:14.464842 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a396e27-0033-42aa-b378-d041a00f4261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:14.465740 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a396e27-0033-42aa-b378-d041a00f4261 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:14.466246 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a396e27-0033-42aa-b378-d041a00f4261 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:14.466625 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a396e27-0033-42aa-b378-d041a00f4261 None admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:14.467473 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a396e27-0033-42aa-b378-d041a00f4261 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:22:14.467813 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a396e27-0033-42aa-b378-d041a00f4261 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:14.469330 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a396e27-0033-42aa-b378-d041a00f4261 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:14.477950 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6546cffa-ea6f-482b-ae31-27b4b6213ee8 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:14.486571 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 523/1063] 10.222.0.86 () {56 vars in 1133 bytes} [Tue Jun 7 14:22:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:22:14.487368 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a396e27-0033-42aa-b378-d041a00f4261 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:14.517053 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f81146-77ee-45ba-9bb1-6635fcbf4c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:14.517905 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f81146-77ee-45ba-9bb1-6635fcbf4c9a None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:14.518187 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f81146-77ee-45ba-9bb1-6635fcbf4c9a None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:14.518464 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f81146-77ee-45ba-9bb1-6635fcbf4c9a None admin] PATH_INFO: `/v3/projects/540f066021ed41169990f20d377dce77` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:14.519642 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f81146-77ee-45ba-9bb1-6635fcbf4c9a None admin] RBAC: Authorizing `identity:get_project(project_id=540f066021ed41169990f20d377dce77)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:14.521110 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f81146-77ee-45ba-9bb1-6635fcbf4c9a None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:14.522791 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 541/1064] 10.222.0.86 () {56 vars in 1186 bytes} [Tue Jun 7 14:22:14 2022] GET /identity/v3/projects/540f066021ed41169990f20d377dce77 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:22:14.523546 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f81146-77ee-45ba-9bb1-6635fcbf4c9a None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:14.584144 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a396e27-0033-42aa-b378-d041a00f4261 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:14.605009 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:14.618903 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da4be1f-afe4-4a3f-a9fc-cdde1cac0dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:14.619567 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da4be1f-afe4-4a3f-a9fc-cdde1cac0dd1 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:14.619882 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da4be1f-afe4-4a3f-a9fc-cdde1cac0dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:14.620164 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da4be1f-afe4-4a3f-a9fc-cdde1cac0dd1 None admin] PATH_INFO: `/v3/services` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:14.620875 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da4be1f-afe4-4a3f-a9fc-cdde1cac0dd1 None admin] RBAC: Adding query filter params (type=image) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:22:14.621185 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da4be1f-afe4-4a3f-a9fc-cdde1cac0dd1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:14.622549 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da4be1f-afe4-4a3f-a9fc-cdde1cac0dd1 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:14.624109 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f81146-77ee-45ba-9bb1-6635fcbf4c9a None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:14.627347 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 524/1065] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jun 7 14:22:14 2022] GET /identity/v3/services?type=image => generated 350 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:22:14.628147 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da4be1f-afe4-4a3f-a9fc-cdde1cac0dd1 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:14.630731 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:14.660156 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e66648-15c2-4729-8416-44ed88f3e156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:14.663482 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e66648-15c2-4729-8416-44ed88f3e156 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:14.663482 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e66648-15c2-4729-8416-44ed88f3e156 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:14.663482 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e66648-15c2-4729-8416-44ed88f3e156 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:14.671775 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e66648-15c2-4729-8416-44ed88f3e156 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:14.673205 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e66648-15c2-4729-8416-44ed88f3e156 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:14.690442 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-59e66648-15c2-4729-8416-44ed88f3e156 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:22:14.690442 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:22:14.690442 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:22:14.690442 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:22:14.690442 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:22:14.690442 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:22:14.690442 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:22:14.690442 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:22:14.690442 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:22:14.690442 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:22:14.690442 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:22:14.690442 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:22:14.690442 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:22:14.690442 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:22:14.690442 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:22:14.691330 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:22:14.691330 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:22:14.691330 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:22:14.691330 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:22:14.691330 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:22:14.691330 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:22:14.691330 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:22:14.691330 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:22:14.691330 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jun 07 14:22:14.691330 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:22:14.691330 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:22:14.691330 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:22:14.691330 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:22:14.691330 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:22:14.691330 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:22:14.691330 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:22:14.691330 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:22:14.697824 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:22:14.697824 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:22:14.697824 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:22:14.697824 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:22:14.697824 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 542/1066] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jun 7 14:22:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:22:14.697824 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e66648-15c2-4729-8416-44ed88f3e156 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:14.724844 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da4be1f-afe4-4a3f-a9fc-cdde1cac0dd1 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:14.757344 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc766421-25b9-4f53-b1b1-7df8a522910c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:14.757996 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc766421-25b9-4f53-b1b1-7df8a522910c None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:14.758286 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc766421-25b9-4f53-b1b1-7df8a522910c None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:14.758564 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc766421-25b9-4f53-b1b1-7df8a522910c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:14.759953 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc766421-25b9-4f53-b1b1-7df8a522910c None admin] RBAC: Adding query filter params (role.id=e3bf6239f5bf477b965704b086786f11, scope.project.id=540f066021ed41169990f20d377dce77, user.id=d7b11841d10e421884798c04ccedab4b) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:22:14.760306 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc766421-25b9-4f53-b1b1-7df8a522910c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:14.761732 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc766421-25b9-4f53-b1b1-7df8a522910c None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:14.767125 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 525/1067] 10.222.0.86 () {56 vars in 1374 bytes} [Tue Jun 7 14:22:14 2022] GET /identity/v3/role_assignments?user.id=d7b11841d10e421884798c04ccedab4b&scope.project.id=540f066021ed41169990f20d377dce77&role.id=e3bf6239f5bf477b965704b086786f11 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:22:14.767939 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc766421-25b9-4f53-b1b1-7df8a522910c None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:14.806342 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e66648-15c2-4729-8416-44ed88f3e156 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:14.843706 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:14.849763 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:14.850227 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c183bd9c-084b-47ae-8134-e5fa107f9dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:14.851465 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c183bd9c-084b-47ae-8134-e5fa107f9dc7 None admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:14.851971 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c183bd9c-084b-47ae-8134-e5fa107f9dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:14.852475 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c183bd9c-084b-47ae-8134-e5fa107f9dc7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:14.853852 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c183bd9c-084b-47ae-8134-e5fa107f9dc7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:14.855407 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c183bd9c-084b-47ae-8134-e5fa107f9dc7 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:14.889140 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc766421-25b9-4f53-b1b1-7df8a522910c None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:14.924338 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5d1c03-6202-4ee8-b51d-727041bc1a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:14.925013 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5d1c03-6202-4ee8-b51d-727041bc1a4c None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:14.925296 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5d1c03-6202-4ee8-b51d-727041bc1a4c None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:14.925571 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5d1c03-6202-4ee8-b51d-727041bc1a4c None admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:14.926313 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5d1c03-6202-4ee8-b51d-727041bc1a4c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:22:14.926622 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5d1c03-6202-4ee8-b51d-727041bc1a4c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:14.928052 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5d1c03-6202-4ee8-b51d-727041bc1a4c None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:14.937866 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 543/1068] 10.222.0.86 () {60 vars in 1144 bytes} [Tue Jun 7 14:22:14 2022] POST /identity/v3/endpoints => generated 327 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:22:14.942537 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 526/1069] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jun 7 14:22:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:22:14.948237 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c183bd9c-084b-47ae-8134-e5fa107f9dc7 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:15.068695 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c183bd9c-084b-47ae-8134-e5fa107f9dc7 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:15.105665 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ec043d-bfd0-416f-b624-281e47ce34df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:15.106486 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec043d-bfd0-416f-b624-281e47ce34df None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:15.106770 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec043d-bfd0-416f-b624-281e47ce34df None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:15.107045 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec043d-bfd0-416f-b624-281e47ce34df None admin] PATH_INFO: `/v3/projects/service` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:15.114643 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ec043d-bfd0-416f-b624-281e47ce34df None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:15.116147 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ec043d-bfd0-416f-b624-281e47ce34df None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:15.131923 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-a1ec043d-bfd0-416f-b624-281e47ce34df None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:22:15.131923 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:22:15.131923 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:22:15.131923 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:22:15.131923 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:22:15.131923 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:22:15.131923 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:22:15.131923 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:22:15.131923 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:22:15.131923 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:22:15.131923 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:22:15.131923 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:22:15.131923 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 14:22:15.131923 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 14:22:15.131923 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 14:22:15.132870 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 14:22:15.132870 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:22:15.132870 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:22:15.132870 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:22:15.132870 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:22:15.132870 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:22:15.132870 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:22:15.132870 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:22:15.132870 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jun 07 14:22:15.132870 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:22:15.132870 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:22:15.132870 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:22:15.132870 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:22:15.132870 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:22:15.132870 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:22:15.132870 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:22:15.132870 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:22:15.133761 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 14:22:15.133761 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 14:22:15.133761 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 14:22:15.133761 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 14:22:15.133761 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 14:22:15.133761 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 14:22:15.133761 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:22:15.133761 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:22:15.133761 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 544/1070] 10.222.0.86 () {56 vars in 1111 bytes} [Tue Jun 7 14:22:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 14:22:15.140857 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5d1c03-6202-4ee8-b51d-727041bc1a4c None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:15.247581 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5d1c03-6202-4ee8-b51d-727041bc1a4c None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:15.275427 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:15.284551 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23522914-0684-4f0d-bc86-1f56e4d4d58d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:15.285466 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23522914-0684-4f0d-bc86-1f56e4d4d58d None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:15.285954 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23522914-0684-4f0d-bc86-1f56e4d4d58d None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:15.286623 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23522914-0684-4f0d-bc86-1f56e4d4d58d None admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:15.288071 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23522914-0684-4f0d-bc86-1f56e4d4d58d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:22:15.288577 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23522914-0684-4f0d-bc86-1f56e4d4d58d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:15.290232 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23522914-0684-4f0d-bc86-1f56e4d4d58d None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:15.305956 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 527/1071] 10.222.0.86 () {56 vars in 1148 bytes} [Tue Jun 7 14:22:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:22:15.308925 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ec043d-bfd0-416f-b624-281e47ce34df None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:15.358289 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:15.412109 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ec043d-bfd0-416f-b624-281e47ce34df None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:15.447766 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc78eba-000a-4476-9a73-c32871444a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:15.448665 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc78eba-000a-4476-9a73-c32871444a86 None admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:15.448946 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc78eba-000a-4476-9a73-c32871444a86 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:15.449216 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc78eba-000a-4476-9a73-c32871444a86 None admin] PATH_INFO: `/v3/projects/e429537b190c4c5ea7e1332ab044ca7a/users/b99cfb70f54c45c8870369359da20378/roles/8639adefbbcc4029bf422565e1a299b7` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:15.451374 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc78eba-000a-4476-9a73-c32871444a86 None admin] RBAC: Authorizing `identity:create_grant(project_id=e429537b190c4c5ea7e1332ab044ca7a, user_id=b99cfb70f54c45c8870369359da20378, role_id=8639adefbbcc4029bf422565e1a299b7)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:15.452812 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc78eba-000a-4476-9a73-c32871444a86 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:15.565237 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 545/1072] 10.222.0.86 () {58 vars in 1439 bytes} [Tue Jun 7 14:22:15 2022] PUT /identity/v3/projects/e429537b190c4c5ea7e1332ab044ca7a/users/b99cfb70f54c45c8870369359da20378/roles/8639adefbbcc4029bf422565e1a299b7 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:22:16.994511 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1f5a78-a07b-4a01-a718-f3a8d84c1936 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:16.995099 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1f5a78-a07b-4a01-a718-f3a8d84c1936 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:16.995099 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1f5a78-a07b-4a01-a718-f3a8d84c1936 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:16.996491 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 528/1073] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:22:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:22:17.001695 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2d42d4-96ca-4924-acb6-91c96be032df None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:17.002109 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2d42d4-96ca-4924-acb6-91c96be032df None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:17.002281 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2d42d4-96ca-4924-acb6-91c96be032df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:17.019110 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-ab2d42d4-96ca-4924-acb6-91c96be032df None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:22:17.020311 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-ab2d42d4-96ca-4924-acb6-91c96be032df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:17.091793 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 546/1074] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:22:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 14:22:17.113201 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1f5a78-a07b-4a01-a718-f3a8d84c1936 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:17.220495 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1f5a78-a07b-4a01-a718-f3a8d84c1936 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:17.256578 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ab8510-3c12-4440-b215-4d4d0bab59c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:17.257519 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ab8510-3c12-4440-b215-4d4d0bab59c7 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:17.257628 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ab8510-3c12-4440-b215-4d4d0bab59c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:17.257813 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ab8510-3c12-4440-b215-4d4d0bab59c7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:17.259073 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ec0dca-6062-4216-877f-4fb150ba3721 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:17.259401 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ec0dca-6062-4216-877f-4fb150ba3721 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:17.259680 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ec0dca-6062-4216-877f-4fb150ba3721 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:17.261094 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 547/1075] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:22:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:22:17.266057 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4be23c5-8b66-4a76-8f06-432cd02c95be None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:17.266347 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4be23c5-8b66-4a76-8f06-432cd02c95be None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:17.266627 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4be23c5-8b66-4a76-8f06-432cd02c95be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:17.270758 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ab8510-3c12-4440-b215-4d4d0bab59c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:22:17.279051 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-50ab8510-3c12-4440-b215-4d4d0bab59c7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 14:22:17.279051 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:22:17.279051 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:22:17.279051 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:22:17.279051 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:22:17.279051 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:22:17.279051 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:22:17.279051 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:22:17.279051 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:22:17.279051 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:22:17.279051 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:22:17.279051 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:22:17.279051 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:22:17.279051 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:22:17.279051 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:22:17.279051 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:22:17.280171 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:22:17.280171 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:22:17.280171 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:22:17.280171 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:22:17.280171 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:22:17.280171 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:22:17.280171 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:22:17.280171 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:22:17.280171 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:22:17.280171 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:22:17.280171 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:22:17.280171 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jun 07 14:22:17.280171 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:22:17.280171 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:22:17.280171 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:22:17.280171 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:22:17.281024 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:22:17.281024 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:22:17.281024 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:22:17.281024 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:22:17.281024 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:22:17.281024 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:22:17.281024 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:22:17.281024 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:22:17.281024 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:22:17.281024 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:22:17.281024 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 14:22:17.281024 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:22:17.281024 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 529/1076] 10.222.0.86 () {56 vars in 1096 bytes} [Tue Jun 7 14:22:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:22:17.285997 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ab8510-3c12-4440-b215-4d4d0bab59c7 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:17.289132 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-b4be23c5-8b66-4a76-8f06-432cd02c95be None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:22:17.290317 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-b4be23c5-8b66-4a76-8f06-432cd02c95be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:17.321040 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:17.336333 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:17.364035 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 548/1077] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:22:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 07 14:22:17.387652 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4be23c5-8b66-4a76-8f06-432cd02c95be None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:17.393218 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ab8510-3c12-4440-b215-4d4d0bab59c7 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:17.428930 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d4f538-9340-4c4c-b978-a5c7ed68dc90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:17.429597 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d4f538-9340-4c4c-b978-a5c7ed68dc90 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:17.429883 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d4f538-9340-4c4c-b978-a5c7ed68dc90 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:17.430157 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d4f538-9340-4c4c-b978-a5c7ed68dc90 None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:17.430900 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d4f538-9340-4c4c-b978-a5c7ed68dc90 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:22:17.431745 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d4f538-9340-4c4c-b978-a5c7ed68dc90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:17.433133 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d4f538-9340-4c4c-b978-a5c7ed68dc90 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:17.441674 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 530/1078] 10.222.0.86 () {56 vars in 1099 bytes} [Tue Jun 7 14:22:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:22:17.447806 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d4f538-9340-4c4c-b978-a5c7ed68dc90 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:17.490361 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4be23c5-8b66-4a76-8f06-432cd02c95be None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:17.526823 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4197dd89-e702-4db0-b9ab-ffc4903b81f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:17.527473 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4197dd89-e702-4db0-b9ab-ffc4903b81f1 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:17.527771 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4197dd89-e702-4db0-b9ab-ffc4903b81f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:17.528052 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4197dd89-e702-4db0-b9ab-ffc4903b81f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:17.555688 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d4f538-9340-4c4c-b978-a5c7ed68dc90 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:17.558908 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:17.565811 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:17.590531 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fede1e37-d6c5-4f27-abe0-7ce0d52be53d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:17.591624 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fede1e37-d6c5-4f27-abe0-7ce0d52be53d None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:17.591945 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fede1e37-d6c5-4f27-abe0-7ce0d52be53d None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:17.592219 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fede1e37-d6c5-4f27-abe0-7ce0d52be53d None admin] PATH_INFO: `/v3/users/d7b11841d10e421884798c04ccedab4b` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:17.593405 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fede1e37-d6c5-4f27-abe0-7ce0d52be53d None admin] RBAC: Authorizing `identity:get_user(user_id=d7b11841d10e421884798c04ccedab4b)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:17.594835 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fede1e37-d6c5-4f27-abe0-7ce0d52be53d None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:17.596509 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 531/1079] 10.222.0.86 () {56 vars in 1177 bytes} [Tue Jun 7 14:22:17 2022] GET /identity/v3/users/d7b11841d10e421884798c04ccedab4b => generated 285 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:22:17.600452 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4197dd89-e702-4db0-b9ab-ffc4903b81f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:17.601889 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4197dd89-e702-4db0-b9ab-ffc4903b81f1 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:17.602016 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fede1e37-d6c5-4f27-abe0-7ce0d52be53d None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:17.706413 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fede1e37-d6c5-4f27-abe0-7ce0d52be53d None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:17.710203 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 549/1080] 10.222.0.86 () {58 vars in 1282 bytes} [Tue Jun 7 14:22:17 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 07 14:22:17.716206 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4197dd89-e702-4db0-b9ab-ffc4903b81f1 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:17.744418 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112cce04-93b9-4f27-92e4-ccec2b3c7619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:17.745542 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112cce04-93b9-4f27-92e4-ccec2b3c7619 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:17.746002 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112cce04-93b9-4f27-92e4-ccec2b3c7619 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:17.746278 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112cce04-93b9-4f27-92e4-ccec2b3c7619 None admin] PATH_INFO: `/v3/projects/540f066021ed41169990f20d377dce77` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:17.747457 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112cce04-93b9-4f27-92e4-ccec2b3c7619 None admin] RBAC: Authorizing `identity:get_project(project_id=540f066021ed41169990f20d377dce77)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:17.748917 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112cce04-93b9-4f27-92e4-ccec2b3c7619 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:17.755274 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 532/1081] 10.222.0.86 () {56 vars in 1186 bytes} [Tue Jun 7 14:22:17 2022] GET /identity/v3/projects/540f066021ed41169990f20d377dce77 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:22:17.756262 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112cce04-93b9-4f27-92e4-ccec2b3c7619 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:17.780573 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:17.803677 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:17.821323 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4197dd89-e702-4db0-b9ab-ffc4903b81f1 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:17.857184 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a71f6f5-6b59-449d-bccc-a1671815c927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:17.857831 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112cce04-93b9-4f27-92e4-ccec2b3c7619 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:17.857984 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a71f6f5-6b59-449d-bccc-a1671815c927 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:17.858270 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a71f6f5-6b59-449d-bccc-a1671815c927 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:17.858550 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a71f6f5-6b59-449d-bccc-a1671815c927 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:17.868504 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a71f6f5-6b59-449d-bccc-a1671815c927 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:17.869986 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a71f6f5-6b59-449d-bccc-a1671815c927 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:17.887402 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-2a71f6f5-6b59-449d-bccc-a1671815c927 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:22:17.887402 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:22:17.887402 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:22:17.887402 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:22:17.887402 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:22:17.887402 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:22:17.887402 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:22:17.887402 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:22:17.887402 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:22:17.887402 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:22:17.887402 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:22:17.887402 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:22:17.887402 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:22:17.887402 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:22:17.887402 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:22:17.888547 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:22:17.888547 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:22:17.888547 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:22:17.888547 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:22:17.888547 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:22:17.888547 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:22:17.888547 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:22:17.888547 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:22:17.888547 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jun 07 14:22:17.888547 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:22:17.888547 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:22:17.888547 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:22:17.888547 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:22:17.888547 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:22:17.888547 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:22:17.888547 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:22:17.888547 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:22:17.889466 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:22:17.889466 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:22:17.889466 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:22:17.889466 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:22:17.889466 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 550/1082] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jun 7 14:22:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 14:22:17.889800 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f716ce64-be48-4695-87d8-f591b1dd8c32 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:17.890086 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f716ce64-be48-4695-87d8-f591b1dd8c32 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:17.890361 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f716ce64-be48-4695-87d8-f591b1dd8c32 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:17.891781 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 551/1083] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:22:17 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:22:17.893968 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba92e08-0f06-4eee-b36e-4f494ab7fbd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:17.894700 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f716ce64-be48-4695-87d8-f591b1dd8c32 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:17.894891 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba92e08-0f06-4eee-b36e-4f494ab7fbd0 None admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:17.895163 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba92e08-0f06-4eee-b36e-4f494ab7fbd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:17.895437 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba92e08-0f06-4eee-b36e-4f494ab7fbd0 None admin] PATH_INFO: `/v3/projects/540f066021ed41169990f20d377dce77/users/d7b11841d10e421884798c04ccedab4b/roles/e3bf6239f5bf477b965704b086786f11` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:17.897477 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba92e08-0f06-4eee-b36e-4f494ab7fbd0 None admin] RBAC: Authorizing `identity:create_grant(project_id=540f066021ed41169990f20d377dce77, user_id=d7b11841d10e421884798c04ccedab4b, role_id=e3bf6239f5bf477b965704b086786f11)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:17.898895 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba92e08-0f06-4eee-b36e-4f494ab7fbd0 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:17.975535 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 533/1084] 10.222.0.86 () {58 vars in 1439 bytes} [Tue Jun 7 14:22:17 2022] PUT /identity/v3/projects/540f066021ed41169990f20d377dce77/users/d7b11841d10e421884798c04ccedab4b/roles/e3bf6239f5bf477b965704b086786f11 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 14:22:17.976927 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c06dfb4-4251-497a-9bc7-a1626de5bdb3 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:17.977218 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c06dfb4-4251-497a-9bc7-a1626de5bdb3 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:17.977511 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c06dfb4-4251-497a-9bc7-a1626de5bdb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:17.996643 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f716ce64-be48-4695-87d8-f591b1dd8c32 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:18.010403 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-1c06dfb4-4251-497a-9bc7-a1626de5bdb3 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:22:18.011883 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-1c06dfb4-4251-497a-9bc7-a1626de5bdb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:18.022398 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:18.040422 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20648bf-97a0-452f-8662-3dcc393dee86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:18.041068 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20648bf-97a0-452f-8662-3dcc393dee86 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:18.041353 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20648bf-97a0-452f-8662-3dcc393dee86 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:18.041619 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20648bf-97a0-452f-8662-3dcc393dee86 None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:18.042368 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20648bf-97a0-452f-8662-3dcc393dee86 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:22:18.042720 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20648bf-97a0-452f-8662-3dcc393dee86 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:18.044151 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20648bf-97a0-452f-8662-3dcc393dee86 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:18.057878 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 552/1085] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jun 7 14:22:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:22:18.102377 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 534/1086] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:22:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 14:22:18.127242 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20648bf-97a0-452f-8662-3dcc393dee86 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:18.251186 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20648bf-97a0-452f-8662-3dcc393dee86 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:18.289638 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458c70a4-98ae-470c-a344-faea31811079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:18.290553 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458c70a4-98ae-470c-a344-faea31811079 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:18.291290 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458c70a4-98ae-470c-a344-faea31811079 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:18.291570 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458c70a4-98ae-470c-a344-faea31811079 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:18.304221 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458c70a4-98ae-470c-a344-faea31811079 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:22:18.312461 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-458c70a4-98ae-470c-a344-faea31811079 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 07 14:22:18.312461 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:22:18.312461 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:22:18.312461 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:22:18.312461 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:22:18.312461 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:22:18.312461 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:22:18.312461 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:22:18.312461 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:22:18.312461 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:22:18.312461 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:22:18.312461 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:22:18.312461 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:22:18.312461 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:22:18.312461 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:22:18.312461 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:22:18.313419 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:22:18.313419 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:22:18.313419 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:22:18.313419 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:22:18.313419 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:22:18.313419 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:22:18.313419 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:22:18.313419 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:22:18.313419 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:22:18.313419 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:22:18.313419 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:22:18.313419 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jun 07 14:22:18.313419 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:22:18.313419 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:22:18.313419 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:22:18.313419 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:22:18.314314 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:22:18.314314 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:22:18.314314 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:22:18.314314 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:22:18.314314 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:22:18.314314 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:22:18.314314 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:22:18.314314 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:22:18.314314 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:22:18.314314 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:22:18.314314 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 07 14:22:18.314314 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:22:18.314314 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 553/1087] 10.222.0.86 () {56 vars in 1120 bytes} [Tue Jun 7 14:22:18 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:22:18.321228 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c06dfb4-4251-497a-9bc7-a1626de5bdb3 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:18.358995 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:18.428621 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c06dfb4-4251-497a-9bc7-a1626de5bdb3 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:18.463212 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9812b1fa-9b73-4d11-a0c0-f52b4f780847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:18.463898 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9812b1fa-9b73-4d11-a0c0-f52b4f780847 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:18.464183 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9812b1fa-9b73-4d11-a0c0-f52b4f780847 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:18.464454 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9812b1fa-9b73-4d11-a0c0-f52b4f780847 None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:18.465202 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9812b1fa-9b73-4d11-a0c0-f52b4f780847 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:22:18.465513 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9812b1fa-9b73-4d11-a0c0-f52b4f780847 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:18.466874 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9812b1fa-9b73-4d11-a0c0-f52b4f780847 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:18.474723 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 535/1088] 10.222.0.86 () {56 vars in 1115 bytes} [Tue Jun 7 14:22:18 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:22:18.480953 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458c70a4-98ae-470c-a344-faea31811079 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:18.517688 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:18.581556 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458c70a4-98ae-470c-a344-faea31811079 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:18.615112 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e2d6a7-4f36-4473-bc93-5ead4a3c97d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:18.615938 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e2d6a7-4f36-4473-bc93-5ead4a3c97d1 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:18.616223 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e2d6a7-4f36-4473-bc93-5ead4a3c97d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:18.616503 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e2d6a7-4f36-4473-bc93-5ead4a3c97d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:18.626793 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e2d6a7-4f36-4473-bc93-5ead4a3c97d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:18.628300 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e2d6a7-4f36-4473-bc93-5ead4a3c97d1 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:18.647085 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-93e2d6a7-4f36-4473-bc93-5ead4a3c97d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:22:18.647085 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:22:18.647085 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:22:18.647085 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:22:18.647085 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:22:18.647085 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:22:18.647085 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:22:18.647085 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:22:18.647085 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:22:18.647085 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:22:18.647085 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:22:18.647085 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:22:18.647085 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:22:18.647085 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:22:18.647085 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:22:18.648164 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:22:18.648164 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:22:18.648164 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:22:18.648164 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:22:18.648164 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:22:18.648164 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:22:18.648164 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:22:18.648164 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:22:18.648164 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jun 07 14:22:18.648164 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:22:18.648164 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:22:18.648164 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:22:18.648164 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:22:18.648164 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:22:18.648164 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:22:18.648164 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:22:18.648164 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:22:18.649077 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:22:18.649077 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:22:18.649077 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:22:18.649077 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:22:18.649077 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 554/1089] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jun 7 14:22:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:22:18.653997 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9812b1fa-9b73-4d11-a0c0-f52b4f780847 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:18.748699 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:18.754915 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9812b1fa-9b73-4d11-a0c0-f52b4f780847 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:18.788404 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b966388c-0f38-4129-bcc3-3e05b40a8f57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:18.789059 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b966388c-0f38-4129-bcc3-3e05b40a8f57 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:18.789341 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b966388c-0f38-4129-bcc3-3e05b40a8f57 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:18.789617 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b966388c-0f38-4129-bcc3-3e05b40a8f57 None admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:18.790334 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b966388c-0f38-4129-bcc3-3e05b40a8f57 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:22:18.791269 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b966388c-0f38-4129-bcc3-3e05b40a8f57 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:18.792653 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b966388c-0f38-4129-bcc3-3e05b40a8f57 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:18.804076 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 536/1090] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jun 7 14:22:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:22:18.810158 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e2d6a7-4f36-4473-bc93-5ead4a3c97d1 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:18.894846 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:18.907265 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e2d6a7-4f36-4473-bc93-5ead4a3c97d1 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:18.940887 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865bbe82-ea27-4ea0-80d1-f6a70e6d0cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:18.941691 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865bbe82-ea27-4ea0-80d1-f6a70e6d0cef None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:18.941974 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865bbe82-ea27-4ea0-80d1-f6a70e6d0cef None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:18.942251 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865bbe82-ea27-4ea0-80d1-f6a70e6d0cef None admin] PATH_INFO: `/v3/users/nova` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:18.949068 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865bbe82-ea27-4ea0-80d1-f6a70e6d0cef None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:18.950489 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865bbe82-ea27-4ea0-80d1-f6a70e6d0cef None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:18.965033 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-865bbe82-ea27-4ea0-80d1-f6a70e6d0cef None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 07 14:22:18.965033 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:22:18.965033 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:22:18.965033 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:22:18.965033 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:22:18.965033 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:22:18.965033 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:22:18.965033 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:22:18.965033 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:22:18.965033 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:22:18.965033 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:22:18.965033 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:22:18.965033 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 14:22:18.965033 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 14:22:18.965033 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 14:22:18.965033 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 14:22:18.966109 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:22:18.966109 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:22:18.966109 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 14:22:18.966109 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:22:18.966109 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 14:22:18.966109 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:22:18.966109 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:22:18.966109 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:22:18.966109 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:22:18.966109 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:22:18.966109 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:22:18.966109 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jun 07 14:22:18.966109 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:22:18.966109 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:22:18.966109 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:22:18.966109 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:22:18.966109 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:22:18.966109 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:22:18.967254 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:22:18.967254 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:22:18.967254 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 14:22:18.967254 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 14:22:18.967254 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 14:22:18.967254 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 14:22:18.967254 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 14:22:18.967254 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 14:22:18.967254 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 07 14:22:18.967254 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:22:18.970852 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 555/1091] 10.222.0.86 () {56 vars in 1093 bytes} [Tue Jun 7 14:22:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:22:18.972028 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b966388c-0f38-4129-bcc3-3e05b40a8f57 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:19.067091 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b966388c-0f38-4129-bcc3-3e05b40a8f57 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:19.099550 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7139ae2d-775d-4c0c-9002-ace679004132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:19.100231 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7139ae2d-775d-4c0c-9002-ace679004132 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:19.100511 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7139ae2d-775d-4c0c-9002-ace679004132 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:19.100782 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7139ae2d-775d-4c0c-9002-ace679004132 None admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:19.101613 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7139ae2d-775d-4c0c-9002-ace679004132 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:22:19.101918 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7139ae2d-775d-4c0c-9002-ace679004132 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:19.104015 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7139ae2d-775d-4c0c-9002-ace679004132 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:19.122312 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 537/1092] 10.222.0.86 () {56 vars in 1133 bytes} [Tue Jun 7 14:22:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:22:19.128200 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865bbe82-ea27-4ea0-80d1-f6a70e6d0cef None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:19.232279 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865bbe82-ea27-4ea0-80d1-f6a70e6d0cef None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:19.265595 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d667591-2ac2-4b9e-b747-98a49f750496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:19.266239 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d667591-2ac2-4b9e-b747-98a49f750496 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:19.266526 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d667591-2ac2-4b9e-b747-98a49f750496 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:19.266811 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d667591-2ac2-4b9e-b747-98a49f750496 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:19.284429 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:19.332956 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d667591-2ac2-4b9e-b747-98a49f750496 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:19.334392 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d667591-2ac2-4b9e-b747-98a49f750496 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:19.427504 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 556/1093] 10.222.0.86 () {58 vars in 1282 bytes} [Tue Jun 7 14:22:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 07 14:22:19.433179 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7139ae2d-775d-4c0c-9002-ace679004132 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:19.449303 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:19.530834 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7139ae2d-775d-4c0c-9002-ace679004132 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:19.564122 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ca6538-8415-4a91-a95a-688e03b27763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:19.564897 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ca6538-8415-4a91-a95a-688e03b27763 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:19.565178 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ca6538-8415-4a91-a95a-688e03b27763 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:19.565450 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ca6538-8415-4a91-a95a-688e03b27763 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:19.575264 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ca6538-8415-4a91-a95a-688e03b27763 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:19.576718 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ca6538-8415-4a91-a95a-688e03b27763 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:19.594077 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-97ca6538-8415-4a91-a95a-688e03b27763 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:22:19.594077 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:22:19.594077 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:22:19.594077 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:22:19.594077 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:22:19.594077 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:22:19.594077 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:22:19.594077 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:22:19.594077 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:22:19.594077 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:22:19.594077 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:22:19.594077 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:22:19.594077 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:22:19.594077 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:22:19.594077 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:22:19.595135 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:22:19.595135 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:22:19.595135 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:22:19.595135 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:22:19.595135 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:22:19.595135 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:22:19.595135 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:22:19.595135 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:22:19.595135 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jun 07 14:22:19.595135 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:22:19.595135 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:22:19.595135 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:22:19.595135 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:22:19.595135 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:22:19.595135 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:22:19.595135 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:22:19.595135 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:22:19.596090 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:22:19.596090 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:22:19.596090 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:22:19.596090 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:22:19.596090 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 538/1094] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jun 7 14:22:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:22:19.600968 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d667591-2ac2-4b9e-b747-98a49f750496 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:19.648233 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:19.698644 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d667591-2ac2-4b9e-b747-98a49f750496 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:19.731607 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4794abc-b8de-472c-8925-9eb876b73dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:19.732294 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4794abc-b8de-472c-8925-9eb876b73dcb None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:19.732578 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4794abc-b8de-472c-8925-9eb876b73dcb None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:19.732854 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4794abc-b8de-472c-8925-9eb876b73dcb None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:19.733570 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4794abc-b8de-472c-8925-9eb876b73dcb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:22:19.733878 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4794abc-b8de-472c-8925-9eb876b73dcb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:19.735252 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4794abc-b8de-472c-8925-9eb876b73dcb None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:19.747373 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 557/1095] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jun 7 14:22:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:22:19.752895 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ca6538-8415-4a91-a95a-688e03b27763 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:19.815391 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:19.848021 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ca6538-8415-4a91-a95a-688e03b27763 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:19.881632 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a146b37-0a25-4a01-9fd9-0e31c05603aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:19.882413 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a146b37-0a25-4a01-9fd9-0e31c05603aa None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:19.882705 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a146b37-0a25-4a01-9fd9-0e31c05603aa None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:19.882987 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a146b37-0a25-4a01-9fd9-0e31c05603aa None admin] PATH_INFO: `/v3/projects/service` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:19.889969 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a146b37-0a25-4a01-9fd9-0e31c05603aa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:19.891387 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a146b37-0a25-4a01-9fd9-0e31c05603aa None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:19.905280 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-9a146b37-0a25-4a01-9fd9-0e31c05603aa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:22:19.905280 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:22:19.905280 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:22:19.905280 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:22:19.905280 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:22:19.905280 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:22:19.905280 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:22:19.905280 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:22:19.905280 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:22:19.905280 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:22:19.905280 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:22:19.905280 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:22:19.905280 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 14:22:19.905280 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 14:22:19.905280 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 14:22:19.906398 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 14:22:19.906398 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:22:19.906398 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:22:19.906398 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:22:19.906398 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:22:19.906398 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:22:19.906398 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:22:19.906398 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:22:19.906398 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jun 07 14:22:19.906398 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:22:19.906398 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:22:19.906398 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:22:19.906398 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:22:19.906398 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:22:19.906398 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:22:19.906398 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:22:19.906398 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:22:19.907295 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 14:22:19.907295 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 14:22:19.907295 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 14:22:19.907295 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 14:22:19.907295 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 14:22:19.907295 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 14:22:19.907295 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:22:19.907295 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:22:19.907295 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 539/1096] 10.222.0.86 () {56 vars in 1111 bytes} [Tue Jun 7 14:22:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:22:19.912598 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4794abc-b8de-472c-8925-9eb876b73dcb None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:20.012170 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4794abc-b8de-472c-8925-9eb876b73dcb None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:20.021097 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:20.045400 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed49bdeb-9121-4ca8-9b2f-250cc7202ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:20.046060 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed49bdeb-9121-4ca8-9b2f-250cc7202ee1 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:20.046341 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed49bdeb-9121-4ca8-9b2f-250cc7202ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:20.046614 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed49bdeb-9121-4ca8-9b2f-250cc7202ee1 None admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:20.047388 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed49bdeb-9121-4ca8-9b2f-250cc7202ee1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:22:20.047695 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed49bdeb-9121-4ca8-9b2f-250cc7202ee1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:20.049192 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed49bdeb-9121-4ca8-9b2f-250cc7202ee1 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:20.061469 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 558/1097] 10.222.0.86 () {56 vars in 1148 bytes} [Tue Jun 7 14:22:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:22:20.067583 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a146b37-0a25-4a01-9fd9-0e31c05603aa None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:20.162865 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a146b37-0a25-4a01-9fd9-0e31c05603aa None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:20.187032 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:20.195298 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a52180-361b-4372-adba-9bbb3468638e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:20.200616 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a52180-361b-4372-adba-9bbb3468638e None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:20.200616 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a52180-361b-4372-adba-9bbb3468638e None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:20.200616 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a52180-361b-4372-adba-9bbb3468638e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:20.200616 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a52180-361b-4372-adba-9bbb3468638e None admin] RBAC: Adding query filter params (role.id=8639adefbbcc4029bf422565e1a299b7, scope.project.id=e429537b190c4c5ea7e1332ab044ca7a, user.id=b99cfb70f54c45c8870369359da20378) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:22:20.200616 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a52180-361b-4372-adba-9bbb3468638e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:20.200616 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a52180-361b-4372-adba-9bbb3468638e None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:20.205459 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 540/1098] 10.222.0.86 () {56 vars in 1374 bytes} [Tue Jun 7 14:22:20 2022] GET /identity/v3/role_assignments?user.id=b99cfb70f54c45c8870369359da20378&scope.project.id=e429537b190c4c5ea7e1332ab044ca7a&role.id=8639adefbbcc4029bf422565e1a299b7 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:22:20.265168 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe68d5f-f970-4440-9e10-72267634a981 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:20.265719 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe68d5f-f970-4440-9e10-72267634a981 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:20.265719 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe68d5f-f970-4440-9e10-72267634a981 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:20.267230 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 559/1099] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:22:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:22:20.273279 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1205f1a1-d2de-4388-aef6-96206eaad04e None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:20.273574 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1205f1a1-d2de-4388-aef6-96206eaad04e None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:20.273860 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1205f1a1-d2de-4388-aef6-96206eaad04e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:20.292810 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-1205f1a1-d2de-4388-aef6-96206eaad04e None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:22:20.294041 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-1205f1a1-d2de-4388-aef6-96206eaad04e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:20.366231 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 541/1100] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:22:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 14:22:20.390316 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe68d5f-f970-4440-9e10-72267634a981 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:20.494457 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe68d5f-f970-4440-9e10-72267634a981 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:20.529630 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4e4422-b550-4fab-96fb-1632a9e5ea72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:20.530423 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4e4422-b550-4fab-96fb-1632a9e5ea72 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:20.530704 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4e4422-b550-4fab-96fb-1632a9e5ea72 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:20.531027 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4e4422-b550-4fab-96fb-1632a9e5ea72 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:20.542060 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4e4422-b550-4fab-96fb-1632a9e5ea72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:22:20.549639 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-fa4e4422-b550-4fab-96fb-1632a9e5ea72 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 14:22:20.549639 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:22:20.549639 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:22:20.549639 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:22:20.549639 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:22:20.549639 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:22:20.549639 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:22:20.549639 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:22:20.549639 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:22:20.549639 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:22:20.549639 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:22:20.549639 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:22:20.549639 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:22:20.549639 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:22:20.549639 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:22:20.549639 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:22:20.550751 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:22:20.550751 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:22:20.550751 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:22:20.550751 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:22:20.550751 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:22:20.550751 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:22:20.550751 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:22:20.550751 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:22:20.550751 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:22:20.550751 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:22:20.550751 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:22:20.550751 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jun 07 14:22:20.550751 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:22:20.550751 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:22:20.550751 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:22:20.550751 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:22:20.551835 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:22:20.551835 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:22:20.551835 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:22:20.551835 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:22:20.551835 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:22:20.551835 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:22:20.551835 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:22:20.551835 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:22:20.551835 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:22:20.551835 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:22:20.551835 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 14:22:20.551835 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:22:20.551835 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 560/1101] 10.222.0.86 () {56 vars in 1096 bytes} [Tue Jun 7 14:22:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:22:20.556933 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1205f1a1-d2de-4388-aef6-96206eaad04e None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:20.656569 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1205f1a1-d2de-4388-aef6-96206eaad04e None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:20.676984 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:20.690720 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36585eac-6735-4211-8fa3-e59bf4fc7887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:20.691390 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36585eac-6735-4211-8fa3-e59bf4fc7887 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:20.691671 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36585eac-6735-4211-8fa3-e59bf4fc7887 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:20.692038 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36585eac-6735-4211-8fa3-e59bf4fc7887 None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:20.692785 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36585eac-6735-4211-8fa3-e59bf4fc7887 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:22:20.693089 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36585eac-6735-4211-8fa3-e59bf4fc7887 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:20.694453 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36585eac-6735-4211-8fa3-e59bf4fc7887 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:20.703223 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 542/1102] 10.222.0.86 () {56 vars in 1099 bytes} [Tue Jun 7 14:22:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:22:20.709018 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4e4422-b550-4fab-96fb-1632a9e5ea72 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:20.741033 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:20.814027 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4e4422-b550-4fab-96fb-1632a9e5ea72 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:20.849950 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12968c1e-d827-481a-aaaf-65e887e660f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:20.850888 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12968c1e-d827-481a-aaaf-65e887e660f9 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:20.851176 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12968c1e-d827-481a-aaaf-65e887e660f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:20.851477 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12968c1e-d827-481a-aaaf-65e887e660f9 None admin] PATH_INFO: `/v3/users/d7b11841d10e421884798c04ccedab4b` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:20.852826 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12968c1e-d827-481a-aaaf-65e887e660f9 None admin] RBAC: Authorizing `identity:get_user(user_id=d7b11841d10e421884798c04ccedab4b)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:20.854282 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12968c1e-d827-481a-aaaf-65e887e660f9 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:20.855976 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 561/1103] 10.222.0.86 () {56 vars in 1177 bytes} [Tue Jun 7 14:22:20 2022] GET /identity/v3/users/d7b11841d10e421884798c04ccedab4b => generated 285 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:22:20.861869 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36585eac-6735-4211-8fa3-e59bf4fc7887 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:20.967183 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36585eac-6735-4211-8fa3-e59bf4fc7887 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:21.003332 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6399b9d-31c6-48f7-a173-374dc12e86b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:21.004028 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6399b9d-31c6-48f7-a173-374dc12e86b7 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:21.004319 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6399b9d-31c6-48f7-a173-374dc12e86b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:21.004605 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6399b9d-31c6-48f7-a173-374dc12e86b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:21.054421 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:21.074087 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6399b9d-31c6-48f7-a173-374dc12e86b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:21.075534 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6399b9d-31c6-48f7-a173-374dc12e86b7 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:21.171452 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 543/1104] 10.222.0.86 () {58 vars in 1282 bytes} [Tue Jun 7 14:22:20 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 07 14:22:21.177275 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12968c1e-d827-481a-aaaf-65e887e660f9 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:21.266237 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:21.271739 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12968c1e-d827-481a-aaaf-65e887e660f9 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:21.305010 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9210b07-540f-487b-ba6e-eadb6934858a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:21.305853 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9210b07-540f-487b-ba6e-eadb6934858a None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:21.306655 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9210b07-540f-487b-ba6e-eadb6934858a None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:21.306929 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9210b07-540f-487b-ba6e-eadb6934858a None admin] PATH_INFO: `/v3/projects/540f066021ed41169990f20d377dce77` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:21.308117 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9210b07-540f-487b-ba6e-eadb6934858a None admin] RBAC: Authorizing `identity:get_project(project_id=540f066021ed41169990f20d377dce77)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:21.309525 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9210b07-540f-487b-ba6e-eadb6934858a None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:21.311186 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 562/1105] 10.222.0.86 () {56 vars in 1186 bytes} [Tue Jun 7 14:22:21 2022] GET /identity/v3/projects/540f066021ed41169990f20d377dce77 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:22:21.317207 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6399b9d-31c6-48f7-a173-374dc12e86b7 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:21.394498 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:21.411450 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6399b9d-31c6-48f7-a173-374dc12e86b7 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:21.444330 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010a3031-56bb-47e7-a633-d36e3039961a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:21.444966 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010a3031-56bb-47e7-a633-d36e3039961a None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:21.445249 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010a3031-56bb-47e7-a633-d36e3039961a None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:21.445523 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010a3031-56bb-47e7-a633-d36e3039961a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:21.446350 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010a3031-56bb-47e7-a633-d36e3039961a None admin] RBAC: Adding query filter params (role.id=e3bf6239f5bf477b965704b086786f11, scope.project.id=540f066021ed41169990f20d377dce77, user.id=d7b11841d10e421884798c04ccedab4b) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:22:21.447185 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010a3031-56bb-47e7-a633-d36e3039961a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:21.448622 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010a3031-56bb-47e7-a633-d36e3039961a None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:21.454240 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 544/1106] 10.222.0.86 () {56 vars in 1374 bytes} [Tue Jun 7 14:22:21 2022] GET /identity/v3/role_assignments?user.id=d7b11841d10e421884798c04ccedab4b&scope.project.id=540f066021ed41169990f20d377dce77&role.id=e3bf6239f5bf477b965704b086786f11 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:22:23.685731 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fe10cd-6251-42f8-9f3e-8f9b117cc147 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:23.686264 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fe10cd-6251-42f8-9f3e-8f9b117cc147 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:23.686264 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fe10cd-6251-42f8-9f3e-8f9b117cc147 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:23.687681 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 563/1107] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:22:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:22:23.692832 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94454236-40aa-4911-8a36-cd3d1da6e46d None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:23.693278 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94454236-40aa-4911-8a36-cd3d1da6e46d None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:23.693382 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94454236-40aa-4911-8a36-cd3d1da6e46d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:23.709519 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-94454236-40aa-4911-8a36-cd3d1da6e46d None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:22:23.710692 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-94454236-40aa-4911-8a36-cd3d1da6e46d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:23.774400 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 545/1108] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:22:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 14:22:23.799432 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fe10cd-6251-42f8-9f3e-8f9b117cc147 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:23.897593 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fe10cd-6251-42f8-9f3e-8f9b117cc147 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:23.931625 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52e07a9-d9ba-4e56-90fc-8a591e170543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:23.932421 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52e07a9-d9ba-4e56-90fc-8a591e170543 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:23.932704 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52e07a9-d9ba-4e56-90fc-8a591e170543 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:23.932976 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52e07a9-d9ba-4e56-90fc-8a591e170543 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:23.934139 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52e07a9-d9ba-4e56-90fc-8a591e170543 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:23.935555 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52e07a9-d9ba-4e56-90fc-8a591e170543 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:23.937266 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 564/1109] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jun 7 14:22:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:22:23.942785 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94454236-40aa-4911-8a36-cd3d1da6e46d None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:24.015160 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:24.037313 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94454236-40aa-4911-8a36-cd3d1da6e46d None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:24.070026 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008a4dd6-9b4c-4f0e-8cb5-481b9b3517f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:24.070673 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008a4dd6-9b4c-4f0e-8cb5-481b9b3517f1 None admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:24.070958 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008a4dd6-9b4c-4f0e-8cb5-481b9b3517f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:24.071232 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008a4dd6-9b4c-4f0e-8cb5-481b9b3517f1 None admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:24.071985 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008a4dd6-9b4c-4f0e-8cb5-481b9b3517f1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:24.073403 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008a4dd6-9b4c-4f0e-8cb5-481b9b3517f1 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:24.160179 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 546/1110] 10.222.0.86 () {60 vars in 1132 bytes} [Tue Jun 7 14:22:23 2022] POST /identity/v3/users => generated 286 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:22:26.427924 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69201848-cbee-4f50-a868-6dcbf5d09eb2 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:26.428449 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69201848-cbee-4f50-a868-6dcbf5d09eb2 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:26.428535 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69201848-cbee-4f50-a868-6dcbf5d09eb2 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:26.429855 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 565/1111] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:22:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:22:26.435261 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a061980a-1c58-45e4-822b-89e344c54e3b None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:26.435676 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a061980a-1c58-45e4-822b-89e344c54e3b None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:26.435839 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a061980a-1c58-45e4-822b-89e344c54e3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:26.452103 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-a061980a-1c58-45e4-822b-89e344c54e3b None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:22:26.453283 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-a061980a-1c58-45e4-822b-89e344c54e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:26.518399 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 547/1112] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:22:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 14:22:26.543167 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69201848-cbee-4f50-a868-6dcbf5d09eb2 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:26.573895 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:26.643020 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69201848-cbee-4f50-a868-6dcbf5d09eb2 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:26.676410 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f825a2f-aba4-4404-9add-d0de3f273fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:26.677243 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f825a2f-aba4-4404-9add-d0de3f273fa2 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:26.677528 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f825a2f-aba4-4404-9add-d0de3f273fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:26.677805 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f825a2f-aba4-4404-9add-d0de3f273fa2 None admin] PATH_INFO: `/v3/roles/a2755a2b621b4e969fd366f0035d672b` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:26.679283 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f825a2f-aba4-4404-9add-d0de3f273fa2 None admin] RBAC: Authorizing `identity:get_role(role_id=a2755a2b621b4e969fd366f0035d672b)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:26.680717 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f825a2f-aba4-4404-9add-d0de3f273fa2 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:26.682072 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 566/1113] 10.222.0.86 () {56 vars in 1177 bytes} [Tue Jun 7 14:22:26 2022] GET /identity/v3/roles/a2755a2b621b4e969fd366f0035d672b => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:22:26.687863 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a061980a-1c58-45e4-822b-89e344c54e3b None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:26.747402 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:26.784339 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a061980a-1c58-45e4-822b-89e344c54e3b None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:26.816416 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7d5875-ceae-40f9-a728-fb02c0a39d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:26.817265 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7d5875-ceae-40f9-a728-fb02c0a39d6a None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:26.817546 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7d5875-ceae-40f9-a728-fb02c0a39d6a None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:26.817820 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7d5875-ceae-40f9-a728-fb02c0a39d6a None admin] PATH_INFO: `/v3/users/8872b8a63f8d4bf789e3e7090d528e83` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:26.830422 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7d5875-ceae-40f9-a728-fb02c0a39d6a None admin] RBAC: Authorizing `identity:get_user(user_id=8872b8a63f8d4bf789e3e7090d528e83)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:26.831889 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7d5875-ceae-40f9-a728-fb02c0a39d6a None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:26.839071 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 548/1114] 10.222.0.86 () {56 vars in 1177 bytes} [Tue Jun 7 14:22:26 2022] GET /identity/v3/users/8872b8a63f8d4bf789e3e7090d528e83 => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:22:26.839930 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f825a2f-aba4-4404-9add-d0de3f273fa2 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:26.933991 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:26.936895 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f825a2f-aba4-4404-9add-d0de3f273fa2 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:26.970272 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71adac3-db02-4917-accb-1e1bfb6ac131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:26.970911 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71adac3-db02-4917-accb-1e1bfb6ac131 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:26.971196 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71adac3-db02-4917-accb-1e1bfb6ac131 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:26.971470 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71adac3-db02-4917-accb-1e1bfb6ac131 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:27.036084 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71adac3-db02-4917-accb-1e1bfb6ac131 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:27.037725 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71adac3-db02-4917-accb-1e1bfb6ac131 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:27.131247 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:27.135171 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 567/1115] 10.222.0.86 () {58 vars in 1282 bytes} [Tue Jun 7 14:22:26 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 07 14:22:27.141213 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7d5875-ceae-40f9-a728-fb02c0a39d6a None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:27.237242 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7d5875-ceae-40f9-a728-fb02c0a39d6a None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:27.256498 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:27.269880 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f7bc8c-6bf7-4877-92c0-04f5e6a5d57f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:27.270738 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f7bc8c-6bf7-4877-92c0-04f5e6a5d57f None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:27.271024 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f7bc8c-6bf7-4877-92c0-04f5e6a5d57f None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:27.271302 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f7bc8c-6bf7-4877-92c0-04f5e6a5d57f None admin] PATH_INFO: `/v3/projects/540f066021ed41169990f20d377dce77` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:27.272493 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f7bc8c-6bf7-4877-92c0-04f5e6a5d57f None admin] RBAC: Authorizing `identity:get_project(project_id=540f066021ed41169990f20d377dce77)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:27.273919 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f7bc8c-6bf7-4877-92c0-04f5e6a5d57f None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:27.276176 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 549/1116] 10.222.0.86 () {56 vars in 1186 bytes} [Tue Jun 7 14:22:27 2022] GET /identity/v3/projects/540f066021ed41169990f20d377dce77 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:22:27.282315 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71adac3-db02-4917-accb-1e1bfb6ac131 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:27.379019 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71adac3-db02-4917-accb-1e1bfb6ac131 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:27.412363 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337d75a3-9766-4b00-ad62-bac504aab845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:27.413006 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337d75a3-9766-4b00-ad62-bac504aab845 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:27.413292 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337d75a3-9766-4b00-ad62-bac504aab845 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:27.413571 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337d75a3-9766-4b00-ad62-bac504aab845 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:27.414393 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337d75a3-9766-4b00-ad62-bac504aab845 None admin] RBAC: Adding query filter params (role.id=a2755a2b621b4e969fd366f0035d672b, scope.project.id=540f066021ed41169990f20d377dce77, user.id=8872b8a63f8d4bf789e3e7090d528e83) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:22:27.414709 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337d75a3-9766-4b00-ad62-bac504aab845 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:27.416194 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337d75a3-9766-4b00-ad62-bac504aab845 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:27.421476 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 568/1117] 10.222.0.86 () {56 vars in 1374 bytes} [Tue Jun 7 14:22:27 2022] GET /identity/v3/role_assignments?user.id=8872b8a63f8d4bf789e3e7090d528e83&scope.project.id=540f066021ed41169990f20d377dce77&role.id=a2755a2b621b4e969fd366f0035d672b => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:22:29.630013 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53371322-1bc2-45f1-9253-04e6be0c6d8b None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:29.630577 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53371322-1bc2-45f1-9253-04e6be0c6d8b None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:29.630577 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53371322-1bc2-45f1-9253-04e6be0c6d8b None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:29.631963 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 550/1118] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:22:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:22:29.637702 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d51f75c-6edf-4f99-9494-1af5661d165a None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:29.638070 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d51f75c-6edf-4f99-9494-1af5661d165a None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:29.638262 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d51f75c-6edf-4f99-9494-1af5661d165a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:29.655310 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-1d51f75c-6edf-4f99-9494-1af5661d165a None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:22:29.656537 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-1d51f75c-6edf-4f99-9494-1af5661d165a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:29.713725 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:29.721707 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 569/1119] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:22:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 14:22:29.744370 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53371322-1bc2-45f1-9253-04e6be0c6d8b None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:29.841799 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53371322-1bc2-45f1-9253-04e6be0c6d8b None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:29.872766 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad7eed4-c402-45f9-97b5-0fb2fdebe3f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:29.873676 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad7eed4-c402-45f9-97b5-0fb2fdebe3f2 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:29.873959 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad7eed4-c402-45f9-97b5-0fb2fdebe3f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:29.874227 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad7eed4-c402-45f9-97b5-0fb2fdebe3f2 None admin] PATH_INFO: `/v3/roles/a2755a2b621b4e969fd366f0035d672b` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:29.875665 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad7eed4-c402-45f9-97b5-0fb2fdebe3f2 None admin] RBAC: Authorizing `identity:get_role(role_id=a2755a2b621b4e969fd366f0035d672b)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:29.877033 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad7eed4-c402-45f9-97b5-0fb2fdebe3f2 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:29.878357 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 551/1120] 10.222.0.86 () {56 vars in 1177 bytes} [Tue Jun 7 14:22:29 2022] GET /identity/v3/roles/a2755a2b621b4e969fd366f0035d672b => generated 223 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:22:29.884589 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d51f75c-6edf-4f99-9494-1af5661d165a None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:29.980664 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d51f75c-6edf-4f99-9494-1af5661d165a None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:30.014195 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70f970d-b87c-460f-a063-586115096274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:30.015052 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70f970d-b87c-460f-a063-586115096274 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:30.015337 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70f970d-b87c-460f-a063-586115096274 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:30.015614 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70f970d-b87c-460f-a063-586115096274 None admin] PATH_INFO: `/v3/users/8872b8a63f8d4bf789e3e7090d528e83` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:30.016849 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70f970d-b87c-460f-a063-586115096274 None admin] RBAC: Authorizing `identity:get_user(user_id=8872b8a63f8d4bf789e3e7090d528e83)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:30.018313 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70f970d-b87c-460f-a063-586115096274 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:30.019927 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 570/1121] 10.222.0.86 () {56 vars in 1177 bytes} [Tue Jun 7 14:22:29 2022] GET /identity/v3/users/8872b8a63f8d4bf789e3e7090d528e83 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:22:30.025404 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad7eed4-c402-45f9-97b5-0fb2fdebe3f2 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:30.079463 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:30.120837 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad7eed4-c402-45f9-97b5-0fb2fdebe3f2 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:30.152642 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb9476d-6c61-4239-8029-f0704ec8254a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:30.153428 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb9476d-6c61-4239-8029-f0704ec8254a None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:30.153712 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb9476d-6c61-4239-8029-f0704ec8254a None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:30.153987 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb9476d-6c61-4239-8029-f0704ec8254a None admin] PATH_INFO: `/v3/projects/540f066021ed41169990f20d377dce77` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:30.155145 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb9476d-6c61-4239-8029-f0704ec8254a None admin] RBAC: Authorizing `identity:get_project(project_id=540f066021ed41169990f20d377dce77)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:30.156575 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb9476d-6c61-4239-8029-f0704ec8254a None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:30.158217 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 552/1122] 10.222.0.86 () {56 vars in 1186 bytes} [Tue Jun 7 14:22:30 2022] GET /identity/v3/projects/540f066021ed41169990f20d377dce77 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:22:30.164293 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70f970d-b87c-460f-a063-586115096274 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:30.223994 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:30.261722 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70f970d-b87c-460f-a063-586115096274 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:30.295192 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dc53d4-c106-4ba4-96d2-ae7cb1c52c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:30.296093 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dc53d4-c106-4ba4-96d2-ae7cb1c52c40 None admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:30.296371 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dc53d4-c106-4ba4-96d2-ae7cb1c52c40 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:30.296639 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dc53d4-c106-4ba4-96d2-ae7cb1c52c40 None admin] PATH_INFO: `/v3/projects/540f066021ed41169990f20d377dce77/users/8872b8a63f8d4bf789e3e7090d528e83/roles/a2755a2b621b4e969fd366f0035d672b` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:30.298781 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dc53d4-c106-4ba4-96d2-ae7cb1c52c40 None admin] RBAC: Authorizing `identity:create_grant(project_id=540f066021ed41169990f20d377dce77, user_id=8872b8a63f8d4bf789e3e7090d528e83, role_id=a2755a2b621b4e969fd366f0035d672b)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:30.300359 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dc53d4-c106-4ba4-96d2-ae7cb1c52c40 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:30.380814 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 571/1123] 10.222.0.86 () {58 vars in 1439 bytes} [Tue Jun 7 14:22:30 2022] PUT /identity/v3/projects/540f066021ed41169990f20d377dce77/users/8872b8a63f8d4bf789e3e7090d528e83/roles/a2755a2b621b4e969fd366f0035d672b => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:22:32.561839 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313025bf-64c4-4737-bd86-df9a99cd58fd None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:32.562379 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313025bf-64c4-4737-bd86-df9a99cd58fd None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:32.562379 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313025bf-64c4-4737-bd86-df9a99cd58fd None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:32.563727 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 553/1124] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:22:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:22:32.568857 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981937e0-7aff-47b2-906d-7000c8ac598f None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:32.569227 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981937e0-7aff-47b2-906d-7000c8ac598f None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:32.569426 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981937e0-7aff-47b2-906d-7000c8ac598f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:32.586240 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-981937e0-7aff-47b2-906d-7000c8ac598f None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:22:32.587431 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-981937e0-7aff-47b2-906d-7000c8ac598f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:32.652206 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 572/1125] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:22:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 14:22:32.675720 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313025bf-64c4-4737-bd86-df9a99cd58fd None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:32.772866 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313025bf-64c4-4737-bd86-df9a99cd58fd None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:32.795375 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:32.806071 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451fb770-acca-4cd6-b976-4919c59ecd7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:32.806959 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451fb770-acca-4cd6-b976-4919c59ecd7f None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:32.807245 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451fb770-acca-4cd6-b976-4919c59ecd7f None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:32.807520 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451fb770-acca-4cd6-b976-4919c59ecd7f None admin] PATH_INFO: `/v3/roles/a2755a2b621b4e969fd366f0035d672b` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:32.809017 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451fb770-acca-4cd6-b976-4919c59ecd7f None admin] RBAC: Authorizing `identity:get_role(role_id=a2755a2b621b4e969fd366f0035d672b)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:32.810372 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451fb770-acca-4cd6-b976-4919c59ecd7f None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:32.811722 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 554/1126] 10.222.0.86 () {56 vars in 1177 bytes} [Tue Jun 7 14:22:32 2022] GET /identity/v3/roles/a2755a2b621b4e969fd366f0035d672b => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:22:32.817491 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981937e0-7aff-47b2-906d-7000c8ac598f None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:32.868767 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:32.913256 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981937e0-7aff-47b2-906d-7000c8ac598f None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:32.946781 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e7b17c-9217-46b6-a8b3-d871d1d3f19f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:32.947645 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e7b17c-9217-46b6-a8b3-d871d1d3f19f None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:32.948083 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e7b17c-9217-46b6-a8b3-d871d1d3f19f None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:32.948366 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e7b17c-9217-46b6-a8b3-d871d1d3f19f None admin] PATH_INFO: `/v3/users/8872b8a63f8d4bf789e3e7090d528e83` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:32.949545 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e7b17c-9217-46b6-a8b3-d871d1d3f19f None admin] RBAC: Authorizing `identity:get_user(user_id=8872b8a63f8d4bf789e3e7090d528e83)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:32.950976 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e7b17c-9217-46b6-a8b3-d871d1d3f19f None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:32.952630 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 573/1127] 10.222.0.86 () {56 vars in 1177 bytes} [Tue Jun 7 14:22:32 2022] GET /identity/v3/users/8872b8a63f8d4bf789e3e7090d528e83 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:22:32.958282 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451fb770-acca-4cd6-b976-4919c59ecd7f None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:33.055045 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451fb770-acca-4cd6-b976-4919c59ecd7f None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:33.087202 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320621f8-5764-4ea3-80f3-b968d1ae2bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:33.087790 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320621f8-5764-4ea3-80f3-b968d1ae2bb8 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:33.088076 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320621f8-5764-4ea3-80f3-b968d1ae2bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:33.088347 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320621f8-5764-4ea3-80f3-b968d1ae2bb8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:33.142426 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:33.151779 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320621f8-5764-4ea3-80f3-b968d1ae2bb8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:33.155659 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320621f8-5764-4ea3-80f3-b968d1ae2bb8 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:33.249259 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 555/1128] 10.222.0.86 () {58 vars in 1282 bytes} [Tue Jun 7 14:22:32 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 07 14:22:33.255044 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e7b17c-9217-46b6-a8b3-d871d1d3f19f None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:33.351933 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e7b17c-9217-46b6-a8b3-d871d1d3f19f None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:33.371855 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:33.385654 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0a855e-870c-4aec-8fe9-6c36102af2f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:33.386554 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0a855e-870c-4aec-8fe9-6c36102af2f6 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:33.390089 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0a855e-870c-4aec-8fe9-6c36102af2f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:33.390089 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0a855e-870c-4aec-8fe9-6c36102af2f6 None admin] PATH_INFO: `/v3/projects/540f066021ed41169990f20d377dce77` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:33.390089 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0a855e-870c-4aec-8fe9-6c36102af2f6 None admin] RBAC: Authorizing `identity:get_project(project_id=540f066021ed41169990f20d377dce77)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:33.390089 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0a855e-870c-4aec-8fe9-6c36102af2f6 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:33.391479 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 574/1129] 10.222.0.86 () {56 vars in 1186 bytes} [Tue Jun 7 14:22:33 2022] GET /identity/v3/projects/540f066021ed41169990f20d377dce77 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:22:33.397446 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320621f8-5764-4ea3-80f3-b968d1ae2bb8 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:33.483816 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:33.491888 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320621f8-5764-4ea3-80f3-b968d1ae2bb8 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:33.525092 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd43604c-a691-4a1f-b005-6fcd21261219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:33.525733 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd43604c-a691-4a1f-b005-6fcd21261219 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:33.526017 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd43604c-a691-4a1f-b005-6fcd21261219 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:33.526289 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd43604c-a691-4a1f-b005-6fcd21261219 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:33.527114 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd43604c-a691-4a1f-b005-6fcd21261219 None admin] RBAC: Adding query filter params (role.id=a2755a2b621b4e969fd366f0035d672b, scope.project.id=540f066021ed41169990f20d377dce77, user.id=8872b8a63f8d4bf789e3e7090d528e83) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:22:33.527431 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd43604c-a691-4a1f-b005-6fcd21261219 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:33.528881 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd43604c-a691-4a1f-b005-6fcd21261219 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:33.534475 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 556/1130] 10.222.0.86 () {56 vars in 1374 bytes} [Tue Jun 7 14:22:33 2022] GET /identity/v3/role_assignments?user.id=8872b8a63f8d4bf789e3e7090d528e83&scope.project.id=540f066021ed41169990f20d377dce77&role.id=a2755a2b621b4e969fd366f0035d672b => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:22:35.744368 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc8063-b746-4197-b066-a29e23db482e None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:35.744887 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc8063-b746-4197-b066-a29e23db482e None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:35.744982 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc8063-b746-4197-b066-a29e23db482e None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:35.746301 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 575/1131] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:22:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:22:35.751393 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600101ff-3d07-40f3-bfa9-827715fd1cd1 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:35.751830 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600101ff-3d07-40f3-bfa9-827715fd1cd1 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:35.751979 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600101ff-3d07-40f3-bfa9-827715fd1cd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:35.768689 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-600101ff-3d07-40f3-bfa9-827715fd1cd1 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:22:35.769878 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-600101ff-3d07-40f3-bfa9-827715fd1cd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:35.833391 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 557/1132] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:22:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 14:22:35.856712 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bc8063-b746-4197-b066-a29e23db482e None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:35.955081 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bc8063-b746-4197-b066-a29e23db482e None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:35.987770 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceff4c9-e1e0-4836-8e92-3f67d336278e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:35.988563 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceff4c9-e1e0-4836-8e92-3f67d336278e None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:35.988849 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceff4c9-e1e0-4836-8e92-3f67d336278e None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:35.989125 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceff4c9-e1e0-4836-8e92-3f67d336278e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:35.990291 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ceff4c9-e1e0-4836-8e92-3f67d336278e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:35.991709 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ceff4c9-e1e0-4836-8e92-3f67d336278e None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:35.993429 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 576/1133] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jun 7 14:22:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:22:35.999076 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600101ff-3d07-40f3-bfa9-827715fd1cd1 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:36.079491 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:36.094141 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600101ff-3d07-40f3-bfa9-827715fd1cd1 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:36.127165 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb60457-e936-4ff8-a0a0-3fbb3fb27799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:36.127831 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb60457-e936-4ff8-a0a0-3fbb3fb27799 None admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:36.128117 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb60457-e936-4ff8-a0a0-3fbb3fb27799 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:36.128396 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb60457-e936-4ff8-a0a0-3fbb3fb27799 None admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:36.129094 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb60457-e936-4ff8-a0a0-3fbb3fb27799 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:36.130507 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb60457-e936-4ff8-a0a0-3fbb3fb27799 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:36.216222 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 558/1134] 10.222.0.86 () {60 vars in 1141 bytes} [Tue Jun 7 14:22:35 2022] POST /identity/v3/projects => generated 311 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:22:38.437384 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85186d1c-754d-4c9b-9188-1881deb945d6 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:38.437910 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85186d1c-754d-4c9b-9188-1881deb945d6 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:38.437910 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85186d1c-754d-4c9b-9188-1881deb945d6 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:38.439294 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 577/1135] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:22:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:22:38.444443 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a7f4a6-212f-4776-b17a-4b3ab8f5070f None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:38.444816 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a7f4a6-212f-4776-b17a-4b3ab8f5070f None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:38.445008 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a7f4a6-212f-4776-b17a-4b3ab8f5070f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:38.461862 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-07a7f4a6-212f-4776-b17a-4b3ab8f5070f None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:22:38.463038 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-07a7f4a6-212f-4776-b17a-4b3ab8f5070f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:38.526394 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 559/1136] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:22:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 14:22:38.550478 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85186d1c-754d-4c9b-9188-1881deb945d6 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:38.606557 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:38.649276 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85186d1c-754d-4c9b-9188-1881deb945d6 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:38.681377 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbdad75-caf7-4976-8664-99d826948e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:38.682147 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbdad75-caf7-4976-8664-99d826948e37 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:38.682426 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbdad75-caf7-4976-8664-99d826948e37 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:38.682697 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbdad75-caf7-4976-8664-99d826948e37 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:38.683863 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbdad75-caf7-4976-8664-99d826948e37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:38.685273 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbdad75-caf7-4976-8664-99d826948e37 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:38.686847 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 578/1137] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jun 7 14:22:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:22:38.692600 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a7f4a6-212f-4776-b17a-4b3ab8f5070f None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:38.756509 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:38.788806 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a7f4a6-212f-4776-b17a-4b3ab8f5070f None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:38.821639 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd94631e-2418-4ada-9b53-f60d43601e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:38.822290 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd94631e-2418-4ada-9b53-f60d43601e78 None admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:38.822573 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd94631e-2418-4ada-9b53-f60d43601e78 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:38.822847 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd94631e-2418-4ada-9b53-f60d43601e78 None admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:38.823558 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd94631e-2418-4ada-9b53-f60d43601e78 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:38.825017 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd94631e-2418-4ada-9b53-f60d43601e78 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:38.925866 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 560/1138] 10.222.0.86 () {60 vars in 1132 bytes} [Tue Jun 7 14:22:38 2022] POST /identity/v3/users => generated 286 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:22:41.178955 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b3bc8e-7197-48d8-8eda-216f1aec6027 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:41.179557 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b3bc8e-7197-48d8-8eda-216f1aec6027 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:41.179557 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b3bc8e-7197-48d8-8eda-216f1aec6027 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:41.180924 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 579/1139] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:22:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:22:41.186077 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc5d77d-7ffb-4286-b3b8-5087129fbbfd None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:41.186516 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc5d77d-7ffb-4286-b3b8-5087129fbbfd None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:41.186623 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc5d77d-7ffb-4286-b3b8-5087129fbbfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:41.203740 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-1bc5d77d-7ffb-4286-b3b8-5087129fbbfd None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:22:41.204942 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-1bc5d77d-7ffb-4286-b3b8-5087129fbbfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:41.269454 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 561/1140] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:22:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 14:22:41.292979 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b3bc8e-7197-48d8-8eda-216f1aec6027 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:41.391251 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b3bc8e-7197-48d8-8eda-216f1aec6027 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:41.413593 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:41.423903 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd8f224-9d55-43f8-99e6-cb051238af3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:41.425935 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd8f224-9d55-43f8-99e6-cb051238af3a None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:41.425935 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd8f224-9d55-43f8-99e6-cb051238af3a None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:41.425935 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd8f224-9d55-43f8-99e6-cb051238af3a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:41.435351 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd8f224-9d55-43f8-99e6-cb051238af3a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:22:41.443327 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-5dd8f224-9d55-43f8-99e6-cb051238af3a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 14:22:41.443327 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:22:41.443327 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:22:41.443327 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:22:41.443327 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:22:41.443327 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:22:41.443327 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:22:41.443327 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:22:41.443327 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:22:41.443327 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:22:41.443327 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:22:41.443327 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:22:41.443327 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:22:41.443327 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:22:41.443327 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:22:41.443327 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:22:41.444511 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:22:41.444511 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:22:41.444511 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:22:41.444511 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:22:41.444511 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:22:41.444511 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:22:41.444511 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:22:41.444511 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:22:41.444511 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:22:41.444511 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:22:41.444511 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:22:41.444511 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jun 07 14:22:41.444511 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:22:41.444511 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:22:41.444511 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:22:41.444511 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:22:41.446031 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:22:41.446031 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:22:41.446031 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:22:41.446031 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:22:41.446031 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:22:41.446031 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:22:41.446031 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:22:41.446031 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:22:41.446031 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:22:41.446031 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:22:41.446031 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 14:22:41.446031 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:22:41.446031 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 580/1141] 10.222.0.86 () {56 vars in 1096 bytes} [Tue Jun 7 14:22:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:22:41.451072 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc5d77d-7ffb-4286-b3b8-5087129fbbfd None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:41.503607 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:41.546288 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc5d77d-7ffb-4286-b3b8-5087129fbbfd None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:41.578870 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f591897-fb64-479a-ae26-014024f382a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:41.579521 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f591897-fb64-479a-ae26-014024f382a1 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:41.579831 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f591897-fb64-479a-ae26-014024f382a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:41.580106 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f591897-fb64-479a-ae26-014024f382a1 None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:41.580847 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f591897-fb64-479a-ae26-014024f382a1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:22:41.581150 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f591897-fb64-479a-ae26-014024f382a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:41.582497 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f591897-fb64-479a-ae26-014024f382a1 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:41.590188 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 562/1142] 10.222.0.86 () {56 vars in 1099 bytes} [Tue Jun 7 14:22:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:22:41.595943 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd8f224-9d55-43f8-99e6-cb051238af3a None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:41.690995 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd8f224-9d55-43f8-99e6-cb051238af3a None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:41.721925 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c84457-1c75-4edb-a50b-2e9f0dbbef4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:41.722799 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c84457-1c75-4edb-a50b-2e9f0dbbef4a None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:41.723104 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c84457-1c75-4edb-a50b-2e9f0dbbef4a None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:41.723374 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c84457-1c75-4edb-a50b-2e9f0dbbef4a None admin] PATH_INFO: `/v3/users/f0688a8192bd4a879cb7bb8d643bc150` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:41.736313 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c84457-1c75-4edb-a50b-2e9f0dbbef4a None admin] RBAC: Authorizing `identity:get_user(user_id=f0688a8192bd4a879cb7bb8d643bc150)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:41.737728 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c84457-1c75-4edb-a50b-2e9f0dbbef4a None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:41.739315 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 581/1143] 10.222.0.86 () {56 vars in 1177 bytes} [Tue Jun 7 14:22:41 2022] GET /identity/v3/users/f0688a8192bd4a879cb7bb8d643bc150 => generated 286 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:22:41.745521 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f591897-fb64-479a-ae26-014024f382a1 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:41.840603 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f591897-fb64-479a-ae26-014024f382a1 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:41.856214 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:41.873544 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1bf02e-1e81-4544-90d5-f6667008c578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:41.874174 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1bf02e-1e81-4544-90d5-f6667008c578 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:41.874457 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1bf02e-1e81-4544-90d5-f6667008c578 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:41.874732 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1bf02e-1e81-4544-90d5-f6667008c578 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:41.988529 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1bf02e-1e81-4544-90d5-f6667008c578 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:41.989900 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1bf02e-1e81-4544-90d5-f6667008c578 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:42.083228 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 563/1144] 10.222.0.86 () {58 vars in 1282 bytes} [Tue Jun 7 14:22:41 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 07 14:22:42.089804 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c84457-1c75-4edb-a50b-2e9f0dbbef4a None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:42.131860 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:42.186531 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c84457-1c75-4edb-a50b-2e9f0dbbef4a None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:42.219417 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14023d90-94b9-4afa-a220-fb761f3f16bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:42.220311 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14023d90-94b9-4afa-a220-fb761f3f16bd None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:42.220599 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14023d90-94b9-4afa-a220-fb761f3f16bd None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:42.220876 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14023d90-94b9-4afa-a220-fb761f3f16bd None admin] PATH_INFO: `/v3/projects/0423dd4d4b774290b1a9173b88db8323` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:42.222047 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14023d90-94b9-4afa-a220-fb761f3f16bd None admin] RBAC: Authorizing `identity:get_project(project_id=0423dd4d4b774290b1a9173b88db8323)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:42.223468 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14023d90-94b9-4afa-a220-fb761f3f16bd None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:42.225214 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 582/1145] 10.222.0.86 () {56 vars in 1186 bytes} [Tue Jun 7 14:22:42 2022] GET /identity/v3/projects/0423dd4d4b774290b1a9173b88db8323 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:22:42.231782 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1bf02e-1e81-4544-90d5-f6667008c578 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:42.248653 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:42.326992 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1bf02e-1e81-4544-90d5-f6667008c578 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:42.360317 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d8bfa9-fcdf-4607-a8e3-af80a8c31d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:42.360948 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d8bfa9-fcdf-4607-a8e3-af80a8c31d4a None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:42.361226 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d8bfa9-fcdf-4607-a8e3-af80a8c31d4a None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:42.361495 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d8bfa9-fcdf-4607-a8e3-af80a8c31d4a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:42.362317 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d8bfa9-fcdf-4607-a8e3-af80a8c31d4a None admin] RBAC: Adding query filter params (role.id=e3bf6239f5bf477b965704b086786f11, scope.project.id=0423dd4d4b774290b1a9173b88db8323, user.id=f0688a8192bd4a879cb7bb8d643bc150) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:22:42.362624 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d8bfa9-fcdf-4607-a8e3-af80a8c31d4a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:42.364061 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d8bfa9-fcdf-4607-a8e3-af80a8c31d4a None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:42.369299 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 564/1146] 10.222.0.86 () {56 vars in 1374 bytes} [Tue Jun 7 14:22:42 2022] GET /identity/v3/role_assignments?user.id=f0688a8192bd4a879cb7bb8d643bc150&scope.project.id=0423dd4d4b774290b1a9173b88db8323&role.id=e3bf6239f5bf477b965704b086786f11 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:22:44.552146 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b423cb9-a58c-4a12-9be7-d4164da1975b None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:44.552673 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b423cb9-a58c-4a12-9be7-d4164da1975b None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:44.552673 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b423cb9-a58c-4a12-9be7-d4164da1975b None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:44.554061 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 583/1147] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:22:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:22:44.559916 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d844e5-d7c9-4c84-9c21-f6a2b0930676 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:44.560327 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d844e5-d7c9-4c84-9c21-f6a2b0930676 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:44.560471 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d844e5-d7c9-4c84-9c21-f6a2b0930676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:44.577269 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-61d844e5-d7c9-4c84-9c21-f6a2b0930676 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:22:44.578466 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-61d844e5-d7c9-4c84-9c21-f6a2b0930676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:44.641989 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 565/1148] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:22:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 14:22:44.664857 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b423cb9-a58c-4a12-9be7-d4164da1975b None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:44.762128 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b423cb9-a58c-4a12-9be7-d4164da1975b None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:44.772168 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:44.794506 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbadce14-e7a7-4861-9b61-f31b35685e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:44.795310 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbadce14-e7a7-4861-9b61-f31b35685e27 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:44.795590 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbadce14-e7a7-4861-9b61-f31b35685e27 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:44.795900 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbadce14-e7a7-4861-9b61-f31b35685e27 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:44.806053 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbadce14-e7a7-4861-9b61-f31b35685e27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:22:44.813596 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-fbadce14-e7a7-4861-9b61-f31b35685e27 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 14:22:44.813596 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:22:44.813596 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:22:44.813596 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:22:44.813596 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:22:44.813596 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:22:44.813596 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:22:44.813596 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:22:44.813596 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:22:44.813596 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:22:44.813596 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:22:44.813596 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:22:44.813596 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:22:44.813596 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:22:44.813596 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:22:44.813596 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:22:44.814688 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:22:44.814688 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:22:44.814688 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:22:44.814688 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:22:44.814688 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:22:44.814688 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:22:44.814688 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:22:44.814688 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:22:44.814688 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:22:44.814688 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:22:44.814688 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:22:44.814688 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jun 07 14:22:44.814688 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:22:44.814688 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:22:44.814688 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:22:44.814688 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:22:44.815985 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:22:44.815985 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:22:44.815985 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:22:44.815985 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:22:44.815985 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:22:44.815985 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:22:44.815985 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:22:44.815985 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:22:44.815985 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:22:44.815985 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:22:44.815985 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 14:22:44.815985 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:22:44.815985 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 584/1149] 10.222.0.86 () {56 vars in 1096 bytes} [Tue Jun 7 14:22:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:22:44.820749 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d844e5-d7c9-4c84-9c21-f6a2b0930676 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:44.832002 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:44.916236 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d844e5-d7c9-4c84-9c21-f6a2b0930676 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:44.948318 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea91d75d-fc6a-441e-ae96-867ec8acbed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:44.948969 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea91d75d-fc6a-441e-ae96-867ec8acbed7 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:44.949251 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea91d75d-fc6a-441e-ae96-867ec8acbed7 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:44.949523 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea91d75d-fc6a-441e-ae96-867ec8acbed7 None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:44.950257 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea91d75d-fc6a-441e-ae96-867ec8acbed7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:22:44.950561 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea91d75d-fc6a-441e-ae96-867ec8acbed7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:44.951941 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea91d75d-fc6a-441e-ae96-867ec8acbed7 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:44.959541 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 566/1150] 10.222.0.86 () {56 vars in 1099 bytes} [Tue Jun 7 14:22:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:22:44.965517 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbadce14-e7a7-4861-9b61-f31b35685e27 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:45.063193 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbadce14-e7a7-4861-9b61-f31b35685e27 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:45.095781 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e2cd74-0dca-44f7-a5bb-d4a733f4dfa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:45.096681 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e2cd74-0dca-44f7-a5bb-d4a733f4dfa8 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:45.096963 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e2cd74-0dca-44f7-a5bb-d4a733f4dfa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:45.097237 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e2cd74-0dca-44f7-a5bb-d4a733f4dfa8 None admin] PATH_INFO: `/v3/users/f0688a8192bd4a879cb7bb8d643bc150` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:45.098415 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e2cd74-0dca-44f7-a5bb-d4a733f4dfa8 None admin] RBAC: Authorizing `identity:get_user(user_id=f0688a8192bd4a879cb7bb8d643bc150)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:45.099881 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e2cd74-0dca-44f7-a5bb-d4a733f4dfa8 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:45.102091 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 585/1151] 10.222.0.86 () {56 vars in 1177 bytes} [Tue Jun 7 14:22:44 2022] GET /identity/v3/users/f0688a8192bd4a879cb7bb8d643bc150 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:22:45.107629 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea91d75d-fc6a-441e-ae96-867ec8acbed7 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:45.175142 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:45.203858 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea91d75d-fc6a-441e-ae96-867ec8acbed7 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:45.236003 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9efa0f-7b1a-4879-8680-598a124f6b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:45.236857 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9efa0f-7b1a-4879-8680-598a124f6b8c None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:45.237139 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9efa0f-7b1a-4879-8680-598a124f6b8c None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:45.237415 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9efa0f-7b1a-4879-8680-598a124f6b8c None admin] PATH_INFO: `/v3/projects/0423dd4d4b774290b1a9173b88db8323` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:45.238576 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9efa0f-7b1a-4879-8680-598a124f6b8c None admin] RBAC: Authorizing `identity:get_project(project_id=0423dd4d4b774290b1a9173b88db8323)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:45.240026 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9efa0f-7b1a-4879-8680-598a124f6b8c None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:45.241701 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 567/1152] 10.222.0.86 () {56 vars in 1186 bytes} [Tue Jun 7 14:22:45 2022] GET /identity/v3/projects/0423dd4d4b774290b1a9173b88db8323 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:22:45.248157 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e2cd74-0dca-44f7-a5bb-d4a733f4dfa8 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:45.287232 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:45.344619 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e2cd74-0dca-44f7-a5bb-d4a733f4dfa8 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:45.377620 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9305bb-5bdf-4eb7-98ea-133a082ac047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:45.378493 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9305bb-5bdf-4eb7-98ea-133a082ac047 None admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:45.378778 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9305bb-5bdf-4eb7-98ea-133a082ac047 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:45.379055 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9305bb-5bdf-4eb7-98ea-133a082ac047 None admin] PATH_INFO: `/v3/projects/0423dd4d4b774290b1a9173b88db8323/users/f0688a8192bd4a879cb7bb8d643bc150/roles/e3bf6239f5bf477b965704b086786f11` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:45.381004 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9305bb-5bdf-4eb7-98ea-133a082ac047 None admin] RBAC: Authorizing `identity:create_grant(project_id=0423dd4d4b774290b1a9173b88db8323, user_id=f0688a8192bd4a879cb7bb8d643bc150, role_id=e3bf6239f5bf477b965704b086786f11)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:45.382413 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9305bb-5bdf-4eb7-98ea-133a082ac047 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:45.456728 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 586/1153] 10.222.0.86 () {58 vars in 1439 bytes} [Tue Jun 7 14:22:45 2022] PUT /identity/v3/projects/0423dd4d4b774290b1a9173b88db8323/users/f0688a8192bd4a879cb7bb8d643bc150/roles/e3bf6239f5bf477b965704b086786f11 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:22:47.630831 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d41707-eb8a-489f-b876-e240037c8d02 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:47.631374 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d41707-eb8a-489f-b876-e240037c8d02 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:47.631374 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d41707-eb8a-489f-b876-e240037c8d02 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:47.632832 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 568/1154] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:22:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:22:47.638069 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42384eb8-ebb6-4466-bccd-90b5fd0756a8 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:47.638508 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42384eb8-ebb6-4466-bccd-90b5fd0756a8 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:47.638612 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42384eb8-ebb6-4466-bccd-90b5fd0756a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:47.654861 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-42384eb8-ebb6-4466-bccd-90b5fd0756a8 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:22:47.656068 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-42384eb8-ebb6-4466-bccd-90b5fd0756a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:47.720059 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 587/1155] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:22:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 14:22:47.744677 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d41707-eb8a-489f-b876-e240037c8d02 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:47.841452 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d41707-eb8a-489f-b876-e240037c8d02 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:47.874505 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575c49a0-7bd3-4209-9555-3924089ac84e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:47.875283 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575c49a0-7bd3-4209-9555-3924089ac84e None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:47.875570 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575c49a0-7bd3-4209-9555-3924089ac84e None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:47.875912 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575c49a0-7bd3-4209-9555-3924089ac84e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:47.883339 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:47.886587 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575c49a0-7bd3-4209-9555-3924089ac84e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:22:47.894209 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-575c49a0-7bd3-4209-9555-3924089ac84e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 14:22:47.894209 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:22:47.894209 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:22:47.894209 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:22:47.894209 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:22:47.894209 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:22:47.894209 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:22:47.894209 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:22:47.894209 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:22:47.894209 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:22:47.894209 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:22:47.894209 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:22:47.894209 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:22:47.894209 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:22:47.894209 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:22:47.894209 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:22:47.895342 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:22:47.895342 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:22:47.895342 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:22:47.895342 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:22:47.895342 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:22:47.895342 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:22:47.895342 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:22:47.895342 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:22:47.895342 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:22:47.895342 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:22:47.895342 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:22:47.895342 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jun 07 14:22:47.895342 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:22:47.895342 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:22:47.895342 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:22:47.895342 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:22:47.896465 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:22:47.896465 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:22:47.896465 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:22:47.896465 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:22:47.896465 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:22:47.896465 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:22:47.896465 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:22:47.896465 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:22:47.896465 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:22:47.896465 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:22:47.896465 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 14:22:47.896465 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:22:47.896465 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 569/1156] 10.222.0.86 () {56 vars in 1096 bytes} [Tue Jun 7 14:22:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:22:47.901321 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42384eb8-ebb6-4466-bccd-90b5fd0756a8 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:47.928338 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:47.997805 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42384eb8-ebb6-4466-bccd-90b5fd0756a8 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:48.030503 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251ac439-df4f-476a-8a0d-a04b1b6d7799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:48.031168 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251ac439-df4f-476a-8a0d-a04b1b6d7799 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:48.031454 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251ac439-df4f-476a-8a0d-a04b1b6d7799 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:48.031729 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251ac439-df4f-476a-8a0d-a04b1b6d7799 None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:48.032511 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251ac439-df4f-476a-8a0d-a04b1b6d7799 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:22:48.032822 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251ac439-df4f-476a-8a0d-a04b1b6d7799 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:48.034183 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251ac439-df4f-476a-8a0d-a04b1b6d7799 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:48.042969 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 588/1157] 10.222.0.86 () {56 vars in 1099 bytes} [Tue Jun 7 14:22:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:22:48.048690 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575c49a0-7bd3-4209-9555-3924089ac84e None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:48.142299 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575c49a0-7bd3-4209-9555-3924089ac84e None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:48.175123 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06847c00-3746-4e47-bda2-fdc5d334dc8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:48.175991 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06847c00-3746-4e47-bda2-fdc5d334dc8d None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:48.176272 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06847c00-3746-4e47-bda2-fdc5d334dc8d None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:48.176545 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06847c00-3746-4e47-bda2-fdc5d334dc8d None admin] PATH_INFO: `/v3/users/f0688a8192bd4a879cb7bb8d643bc150` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:48.177697 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06847c00-3746-4e47-bda2-fdc5d334dc8d None admin] RBAC: Authorizing `identity:get_user(user_id=f0688a8192bd4a879cb7bb8d643bc150)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:48.179107 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06847c00-3746-4e47-bda2-fdc5d334dc8d None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:48.180736 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 570/1158] 10.222.0.86 () {56 vars in 1177 bytes} [Tue Jun 7 14:22:48 2022] GET /identity/v3/users/f0688a8192bd4a879cb7bb8d643bc150 => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:22:48.186192 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251ac439-df4f-476a-8a0d-a04b1b6d7799 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:48.273811 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:48.282987 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251ac439-df4f-476a-8a0d-a04b1b6d7799 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:48.315990 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4c97e2-067b-4510-b534-213affdc671e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:48.316630 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4c97e2-067b-4510-b534-213affdc671e None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:48.316913 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4c97e2-067b-4510-b534-213affdc671e None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:48.317187 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4c97e2-067b-4510-b534-213affdc671e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:48.380638 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4c97e2-067b-4510-b534-213affdc671e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:48.382069 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4c97e2-067b-4510-b534-213affdc671e None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:48.466792 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:48.476410 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 589/1159] 10.222.0.86 () {58 vars in 1282 bytes} [Tue Jun 7 14:22:48 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 07 14:22:48.482313 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06847c00-3746-4e47-bda2-fdc5d334dc8d None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:48.547661 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:48.579036 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06847c00-3746-4e47-bda2-fdc5d334dc8d None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:48.612517 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4913806-3e90-462b-8c66-140396c52647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:48.613395 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4913806-3e90-462b-8c66-140396c52647 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:48.613678 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4913806-3e90-462b-8c66-140396c52647 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:48.613956 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4913806-3e90-462b-8c66-140396c52647 None admin] PATH_INFO: `/v3/projects/0423dd4d4b774290b1a9173b88db8323` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:48.615134 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4913806-3e90-462b-8c66-140396c52647 None admin] RBAC: Authorizing `identity:get_project(project_id=0423dd4d4b774290b1a9173b88db8323)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:48.616595 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4913806-3e90-462b-8c66-140396c52647 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:48.618303 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 571/1160] 10.222.0.86 () {56 vars in 1186 bytes} [Tue Jun 7 14:22:48 2022] GET /identity/v3/projects/0423dd4d4b774290b1a9173b88db8323 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:22:48.624318 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4c97e2-067b-4510-b534-213affdc671e None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:48.718723 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4c97e2-067b-4510-b534-213affdc671e None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:48.750821 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388cd9e6-dd8e-41ca-8133-e57437584757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:48.751454 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388cd9e6-dd8e-41ca-8133-e57437584757 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:48.751734 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388cd9e6-dd8e-41ca-8133-e57437584757 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:48.752032 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388cd9e6-dd8e-41ca-8133-e57437584757 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:48.752843 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388cd9e6-dd8e-41ca-8133-e57437584757 None admin] RBAC: Adding query filter params (role.id=e3bf6239f5bf477b965704b086786f11, scope.project.id=0423dd4d4b774290b1a9173b88db8323, user.id=f0688a8192bd4a879cb7bb8d643bc150) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:22:48.753148 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388cd9e6-dd8e-41ca-8133-e57437584757 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:48.754546 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388cd9e6-dd8e-41ca-8133-e57437584757 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:48.760845 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 590/1161] 10.222.0.86 () {56 vars in 1374 bytes} [Tue Jun 7 14:22:48 2022] GET /identity/v3/role_assignments?user.id=f0688a8192bd4a879cb7bb8d643bc150&scope.project.id=0423dd4d4b774290b1a9173b88db8323&role.id=e3bf6239f5bf477b965704b086786f11 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:22:51.017558 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0cc150-a0cb-45ad-ad70-312ccdd955ac None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:51.018129 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0cc150-a0cb-45ad-ad70-312ccdd955ac None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:51.018129 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0cc150-a0cb-45ad-ad70-312ccdd955ac None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:51.019446 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 572/1162] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:22:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:22:51.024788 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3855e5b9-2314-4a35-a462-3e95d13ee79b None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:51.025206 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3855e5b9-2314-4a35-a462-3e95d13ee79b None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:51.025344 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3855e5b9-2314-4a35-a462-3e95d13ee79b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:51.041930 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-3855e5b9-2314-4a35-a462-3e95d13ee79b None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:22:51.043118 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-3855e5b9-2314-4a35-a462-3e95d13ee79b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:51.090992 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:51.107695 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 591/1163] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:22:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 14:22:51.130897 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0cc150-a0cb-45ad-ad70-312ccdd955ac None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:51.231091 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0cc150-a0cb-45ad-ad70-312ccdd955ac None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:51.264238 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb24317-2142-4e81-9145-917a583edee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:51.264867 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb24317-2142-4e81-9145-917a583edee9 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:51.265152 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb24317-2142-4e81-9145-917a583edee9 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:51.265424 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb24317-2142-4e81-9145-917a583edee9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:51.268809 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:51.329923 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb24317-2142-4e81-9145-917a583edee9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:51.331357 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb24317-2142-4e81-9145-917a583edee9 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:51.426391 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 573/1164] 10.222.0.86 () {58 vars in 1282 bytes} [Tue Jun 7 14:22:51 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 07 14:22:51.432998 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3855e5b9-2314-4a35-a462-3e95d13ee79b None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:51.526671 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3855e5b9-2314-4a35-a462-3e95d13ee79b None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:51.559975 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc813660-1008-4922-9482-7686f7feca7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:51.560763 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc813660-1008-4922-9482-7686f7feca7a None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:51.561048 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc813660-1008-4922-9482-7686f7feca7a None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:51.561323 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc813660-1008-4922-9482-7686f7feca7a None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:51.567772 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc813660-1008-4922-9482-7686f7feca7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:51.569204 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc813660-1008-4922-9482-7686f7feca7a None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:51.582961 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-cc813660-1008-4922-9482-7686f7feca7a None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 07 14:22:51.582961 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:22:51.582961 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 07 14:22:51.582961 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 07 14:22:51.582961 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 14:22:51.582961 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 14:22:51.582961 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 14:22:51.582961 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 14:22:51.582961 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jun 07 14:22:51.582961 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:22:51.582961 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 07 14:22:51.582961 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:22:51.582961 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:22:51.582961 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:22:51.582961 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:22:51.582961 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:22:51.582961 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:22:51.584181 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:22:51.584181 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:22:51.584181 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:22:51.584181 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:22:51.584181 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:22:51.584181 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:22:51.584181 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:22:51.584181 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:22:51.584181 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:22:51.584181 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:22:51.584181 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:22:51.584181 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:22:51.584181 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:22:51.584181 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:22:51.584181 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:22:51.584181 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:22:51.585266 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:22:51.585266 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jun 07 14:22:51.585266 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:22:51.585266 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:22:51.585266 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:22:51.585266 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:22:51.585266 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:22:51.585266 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:22:51.585266 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:22:51.585266 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:22:51.585266 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 07 14:22:51.585266 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:22:51.585266 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 07 14:22:51.585266 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:22:51.585266 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 592/1165] 10.222.0.86 () {56 vars in 1117 bytes} [Tue Jun 7 14:22:51 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:22:51.589833 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb24317-2142-4e81-9145-917a583edee9 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:51.623564 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:51.685150 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb24317-2142-4e81-9145-917a583edee9 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:51.717475 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd6be8a-5c4b-43a3-b3c2-d91abf25beed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:51.718117 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd6be8a-5c4b-43a3-b3c2-d91abf25beed None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:51.718402 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd6be8a-5c4b-43a3-b3c2-d91abf25beed None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:51.718679 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd6be8a-5c4b-43a3-b3c2-d91abf25beed None admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:51.719405 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd6be8a-5c4b-43a3-b3c2-d91abf25beed None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:22:51.719714 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd6be8a-5c4b-43a3-b3c2-d91abf25beed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:51.721093 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd6be8a-5c4b-43a3-b3c2-d91abf25beed None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:51.728624 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 574/1166] 10.222.0.86 () {56 vars in 1115 bytes} [Tue Jun 7 14:22:51 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:22:53.965666 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4040f895-8a74-44df-9c20-45c264aad883 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:53.966192 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4040f895-8a74-44df-9c20-45c264aad883 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:53.966284 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4040f895-8a74-44df-9c20-45c264aad883 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:53.967602 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 593/1167] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:22:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:22:53.972970 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ad4c25-638b-4503-8468-96530cbbb16c None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:53.973365 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ad4c25-638b-4503-8468-96530cbbb16c None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:53.973531 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ad4c25-638b-4503-8468-96530cbbb16c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:53.990443 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-e4ad4c25-638b-4503-8468-96530cbbb16c None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:22:53.991623 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-e4ad4c25-638b-4503-8468-96530cbbb16c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:54.055968 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 575/1168] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:22:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 14:22:54.078587 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4040f895-8a74-44df-9c20-45c264aad883 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:54.124152 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:54.177074 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4040f895-8a74-44df-9c20-45c264aad883 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:54.210566 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d3dbe2-cc7e-4070-a68f-e787a9ac024e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:54.211731 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d3dbe2-cc7e-4070-a68f-e787a9ac024e None admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:54.212035 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d3dbe2-cc7e-4070-a68f-e787a9ac024e None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:54.212304 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d3dbe2-cc7e-4070-a68f-e787a9ac024e None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:54.213032 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d3dbe2-cc7e-4070-a68f-e787a9ac024e None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:54.214377 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d3dbe2-cc7e-4070-a68f-e787a9ac024e None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:54.283746 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 594/1169] 10.222.0.86 () {60 vars in 1138 bytes} [Tue Jun 7 14:22:54 2022] POST /identity/v3/domains => generated 267 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 14:22:56.497254 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b8612a-a1a0-48fd-82d4-d0617b13ed9d None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:56.497753 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b8612a-a1a0-48fd-82d4-d0617b13ed9d None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:56.497753 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b8612a-a1a0-48fd-82d4-d0617b13ed9d None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:56.499097 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 576/1170] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:22:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:22:56.504425 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5466cd-8e5b-4467-ba72-ddd50ed96698 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:56.504808 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5466cd-8e5b-4467-ba72-ddd50ed96698 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:56.504992 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5466cd-8e5b-4467-ba72-ddd50ed96698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:56.522113 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-0d5466cd-8e5b-4467-ba72-ddd50ed96698 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:22:56.523299 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-0d5466cd-8e5b-4467-ba72-ddd50ed96698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:56.588736 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 595/1171] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:22:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 14:22:56.612231 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b8612a-a1a0-48fd-82d4-d0617b13ed9d None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:56.642007 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:56.710138 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b8612a-a1a0-48fd-82d4-d0617b13ed9d None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:56.743833 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61137287-c965-42cd-ab21-6699f76c0f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:56.744675 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61137287-c965-42cd-ab21-6699f76c0f0d None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:56.744959 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61137287-c965-42cd-ab21-6699f76c0f0d None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:56.745236 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61137287-c965-42cd-ab21-6699f76c0f0d None admin] PATH_INFO: `/v3/domains/5bb7c0e9c382447bbe783cb635adc722` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:56.755305 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61137287-c965-42cd-ab21-6699f76c0f0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=5bb7c0e9c382447bbe783cb635adc722)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:56.756711 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61137287-c965-42cd-ab21-6699f76c0f0d None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:56.758342 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 577/1172] 10.222.0.86 () {56 vars in 1183 bytes} [Tue Jun 7 14:22:56 2022] GET /identity/v3/domains/5bb7c0e9c382447bbe783cb635adc722 => generated 267 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:22:56.764165 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5466cd-8e5b-4467-ba72-ddd50ed96698 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:56.796735 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:56.860456 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5466cd-8e5b-4467-ba72-ddd50ed96698 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:56.892890 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256bbb29-9eda-4efc-b4bc-e0ef90150604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:56.893536 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256bbb29-9eda-4efc-b4bc-e0ef90150604 None admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:56.893815 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256bbb29-9eda-4efc-b4bc-e0ef90150604 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:56.894089 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256bbb29-9eda-4efc-b4bc-e0ef90150604 None admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:56.894796 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256bbb29-9eda-4efc-b4bc-e0ef90150604 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:56.896250 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256bbb29-9eda-4efc-b4bc-e0ef90150604 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:57.000052 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 596/1173] 10.222.0.86 () {60 vars in 1141 bytes} [Tue Jun 7 14:22:56 2022] POST /identity/v3/projects => generated 361 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:22:59.278451 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af279e6d-b39f-48f6-bee5-559ffd7dfb63 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:59.278910 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af279e6d-b39f-48f6-bee5-559ffd7dfb63 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:59.279000 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af279e6d-b39f-48f6-bee5-559ffd7dfb63 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:59.280401 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 578/1174] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:22:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:22:59.285868 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c92d68f-72ae-4daa-81f9-36e0ca351f26 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:59.286278 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c92d68f-72ae-4daa-81f9-36e0ca351f26 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:59.286422 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c92d68f-72ae-4daa-81f9-36e0ca351f26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:59.303334 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-2c92d68f-72ae-4daa-81f9-36e0ca351f26 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:22:59.304573 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-2c92d68f-72ae-4daa-81f9-36e0ca351f26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:59.368534 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 597/1175] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:22:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 14:22:59.397991 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af279e6d-b39f-48f6-bee5-559ffd7dfb63 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:59.486648 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:59.496575 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af279e6d-b39f-48f6-bee5-559ffd7dfb63 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:59.529993 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da90cbf3-b428-4238-b061-f95089865525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:59.530839 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da90cbf3-b428-4238-b061-f95089865525 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:59.531122 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da90cbf3-b428-4238-b061-f95089865525 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:59.531396 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da90cbf3-b428-4238-b061-f95089865525 None admin] PATH_INFO: `/v3/domains/5bb7c0e9c382447bbe783cb635adc722` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:59.532587 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da90cbf3-b428-4238-b061-f95089865525 None admin] RBAC: Authorizing `identity:get_domain(domain_id=5bb7c0e9c382447bbe783cb635adc722)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:59.534012 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da90cbf3-b428-4238-b061-f95089865525 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:59.535897 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 579/1176] 10.222.0.86 () {56 vars in 1183 bytes} [Tue Jun 7 14:22:59 2022] GET /identity/v3/domains/5bb7c0e9c382447bbe783cb635adc722 => generated 267 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:22:59.542154 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c92d68f-72ae-4daa-81f9-36e0ca351f26 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:59.558896 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:59.636779 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c92d68f-72ae-4daa-81f9-36e0ca351f26 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:59.669189 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7c195e-32b5-41d4-8c35-62dca2d5fae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:59.669843 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7c195e-32b5-41d4-8c35-62dca2d5fae1 None admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:59.670122 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7c195e-32b5-41d4-8c35-62dca2d5fae1 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:59.670394 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7c195e-32b5-41d4-8c35-62dca2d5fae1 None admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:59.671088 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7c195e-32b5-41d4-8c35-62dca2d5fae1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:59.672522 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7c195e-32b5-41d4-8c35-62dca2d5fae1 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:59.780139 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 598/1177] 10.222.0.86 () {60 vars in 1132 bytes} [Tue Jun 7 14:22:59 2022] POST /identity/v3/users => generated 311 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:23:02.060295 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173f8014-5482-4350-9596-13d86551c1da None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:02.060861 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173f8014-5482-4350-9596-13d86551c1da None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:02.060861 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173f8014-5482-4350-9596-13d86551c1da None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:02.062196 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 580/1178] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:23:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:23:02.067382 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107da6db-d8d4-44c7-bc76-488e239f59d7 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:02.067774 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107da6db-d8d4-44c7-bc76-488e239f59d7 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:02.067984 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107da6db-d8d4-44c7-bc76-488e239f59d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:02.085267 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-107da6db-d8d4-44c7-bc76-488e239f59d7 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:23:02.087126 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-107da6db-d8d4-44c7-bc76-488e239f59d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:23:02.151941 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 599/1179] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:23:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 14:23:02.175331 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173f8014-5482-4350-9596-13d86551c1da None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:02.273199 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173f8014-5482-4350-9596-13d86551c1da None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:02.305638 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fb1631-da2f-4f01-b299-ff7274118a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:02.306410 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fb1631-da2f-4f01-b299-ff7274118a49 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:02.306689 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fb1631-da2f-4f01-b299-ff7274118a49 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:02.306961 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fb1631-da2f-4f01-b299-ff7274118a49 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:02.316645 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fb1631-da2f-4f01-b299-ff7274118a49 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:23:02.324790 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-98fb1631-da2f-4f01-b299-ff7274118a49 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 14:23:02.324790 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:23:02.324790 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:23:02.324790 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:23:02.324790 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:23:02.324790 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:23:02.324790 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:23:02.324790 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:23:02.324790 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:23:02.324790 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:23:02.324790 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:23:02.324790 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:23:02.324790 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:23:02.324790 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:23:02.324790 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:23:02.324790 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:23:02.325872 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:23:02.325872 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:23:02.325872 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:23:02.325872 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:23:02.325872 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:23:02.325872 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:23:02.325872 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:23:02.325872 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:23:02.325872 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:23:02.325872 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:23:02.325872 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:23:02.325872 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jun 07 14:23:02.325872 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:23:02.325872 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:23:02.325872 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:23:02.325872 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:23:02.326888 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:23:02.326888 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:23:02.326888 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:23:02.326888 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:23:02.326888 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:23:02.326888 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:23:02.326888 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:23:02.326888 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:23:02.326888 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:23:02.326888 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:23:02.326888 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 14:23:02.326888 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:23:02.326888 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 581/1180] 10.222.0.86 () {56 vars in 1096 bytes} [Tue Jun 7 14:23:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:23:02.332023 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107da6db-d8d4-44c7-bc76-488e239f59d7 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:02.334182 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:23:02.427575 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107da6db-d8d4-44c7-bc76-488e239f59d7 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:02.460485 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6957d3-8993-47db-a352-bd3901849b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:02.461657 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6957d3-8993-47db-a352-bd3901849b3e None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:02.461943 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6957d3-8993-47db-a352-bd3901849b3e None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:02.462223 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6957d3-8993-47db-a352-bd3901849b3e None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:02.462967 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6957d3-8993-47db-a352-bd3901849b3e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:23:02.463278 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6957d3-8993-47db-a352-bd3901849b3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:23:02.464665 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6957d3-8993-47db-a352-bd3901849b3e None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:23:02.472505 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 600/1181] 10.222.0.86 () {56 vars in 1099 bytes} [Tue Jun 7 14:23:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:23:02.478660 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fb1631-da2f-4f01-b299-ff7274118a49 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:02.497439 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:23:02.574341 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fb1631-da2f-4f01-b299-ff7274118a49 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:02.606705 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de7271b-c03a-4f06-bf68-d2abf720cfbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:02.607548 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de7271b-c03a-4f06-bf68-d2abf720cfbe None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:02.607859 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de7271b-c03a-4f06-bf68-d2abf720cfbe None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:02.608137 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de7271b-c03a-4f06-bf68-d2abf720cfbe None admin] PATH_INFO: `/v3/users/5aa5c5a95ea549f39b6790abb5e55f61` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:02.620627 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de7271b-c03a-4f06-bf68-d2abf720cfbe None admin] RBAC: Authorizing `identity:get_user(user_id=5aa5c5a95ea549f39b6790abb5e55f61)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:23:02.622054 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de7271b-c03a-4f06-bf68-d2abf720cfbe None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:23:02.623651 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 582/1182] 10.222.0.86 () {56 vars in 1177 bytes} [Tue Jun 7 14:23:02 2022] GET /identity/v3/users/5aa5c5a95ea549f39b6790abb5e55f61 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:23:02.629257 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6957d3-8993-47db-a352-bd3901849b3e None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:02.689043 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:23:02.725218 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6957d3-8993-47db-a352-bd3901849b3e None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:02.756906 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91adbca9-0120-435d-8dad-955e43dbf22d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:02.758057 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91adbca9-0120-435d-8dad-955e43dbf22d None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:02.758341 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91adbca9-0120-435d-8dad-955e43dbf22d None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:02.758618 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91adbca9-0120-435d-8dad-955e43dbf22d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:02.823233 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91adbca9-0120-435d-8dad-955e43dbf22d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:23:02.824762 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91adbca9-0120-435d-8dad-955e43dbf22d None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:23:02.883181 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:23:02.920491 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 601/1183] 10.222.0.86 () {58 vars in 1282 bytes} [Tue Jun 7 14:23:02 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 07 14:23:02.925666 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de7271b-c03a-4f06-bf68-d2abf720cfbe None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:02.999251 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:23:03.021505 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de7271b-c03a-4f06-bf68-d2abf720cfbe None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:03.053801 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cd2db5-2352-4c7e-838c-2d9e3046b3e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:03.055145 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cd2db5-2352-4c7e-838c-2d9e3046b3e7 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:03.055432 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cd2db5-2352-4c7e-838c-2d9e3046b3e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:03.055704 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cd2db5-2352-4c7e-838c-2d9e3046b3e7 None admin] PATH_INFO: `/v3/projects/0cb8ea355bab47c89d6eb353535ef8df` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:03.056895 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cd2db5-2352-4c7e-838c-2d9e3046b3e7 None admin] RBAC: Authorizing `identity:get_project(project_id=0cb8ea355bab47c89d6eb353535ef8df)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:23:03.058305 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cd2db5-2352-4c7e-838c-2d9e3046b3e7 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:23:03.059989 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 583/1184] 10.222.0.86 () {56 vars in 1186 bytes} [Tue Jun 7 14:23:02 2022] GET /identity/v3/projects/0cb8ea355bab47c89d6eb353535ef8df => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:23:03.066071 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91adbca9-0120-435d-8dad-955e43dbf22d None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:03.163524 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91adbca9-0120-435d-8dad-955e43dbf22d None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:03.197202 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0930168a-a75a-4bec-9981-f2507bd3f069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:03.197881 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0930168a-a75a-4bec-9981-f2507bd3f069 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:03.198167 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0930168a-a75a-4bec-9981-f2507bd3f069 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:03.198443 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0930168a-a75a-4bec-9981-f2507bd3f069 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:03.199271 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0930168a-a75a-4bec-9981-f2507bd3f069 None admin] RBAC: Adding query filter params (role.id=e3bf6239f5bf477b965704b086786f11, scope.project.id=0cb8ea355bab47c89d6eb353535ef8df, user.id=5aa5c5a95ea549f39b6790abb5e55f61) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:23:03.199606 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0930168a-a75a-4bec-9981-f2507bd3f069 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:23:03.201046 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0930168a-a75a-4bec-9981-f2507bd3f069 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:23:03.206862 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 602/1185] 10.222.0.86 () {56 vars in 1374 bytes} [Tue Jun 7 14:23:03 2022] GET /identity/v3/role_assignments?user.id=5aa5c5a95ea549f39b6790abb5e55f61&scope.project.id=0cb8ea355bab47c89d6eb353535ef8df&role.id=e3bf6239f5bf477b965704b086786f11 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:23:05.370434 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249a2d69-c6b3-4cba-8a0b-727dc18420d9 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:05.370978 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249a2d69-c6b3-4cba-8a0b-727dc18420d9 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:05.370978 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249a2d69-c6b3-4cba-8a0b-727dc18420d9 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:05.372382 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 584/1186] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:23:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:23:05.377454 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016b7b2a-36d9-471c-9a0e-f7c90771ccfa None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:05.377850 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016b7b2a-36d9-471c-9a0e-f7c90771ccfa None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:05.377995 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016b7b2a-36d9-471c-9a0e-f7c90771ccfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:05.394152 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-016b7b2a-36d9-471c-9a0e-f7c90771ccfa None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:23:05.395313 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-016b7b2a-36d9-471c-9a0e-f7c90771ccfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:23:05.418125 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:23:05.458485 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 603/1187] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:23:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 14:23:05.481480 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249a2d69-c6b3-4cba-8a0b-727dc18420d9 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:05.578321 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249a2d69-c6b3-4cba-8a0b-727dc18420d9 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:05.612095 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9596e2b-3f1c-4a30-acdb-789ea5b056ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:05.612868 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9596e2b-3f1c-4a30-acdb-789ea5b056ad None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:05.613154 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9596e2b-3f1c-4a30-acdb-789ea5b056ad None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:05.613434 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9596e2b-3f1c-4a30-acdb-789ea5b056ad None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:05.623196 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9596e2b-3f1c-4a30-acdb-789ea5b056ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:23:05.630790 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-b9596e2b-3f1c-4a30-acdb-789ea5b056ad None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 14:23:05.630790 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:23:05.630790 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:23:05.630790 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:23:05.630790 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:23:05.630790 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:23:05.630790 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:23:05.630790 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:23:05.630790 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:23:05.630790 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:23:05.630790 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:23:05.630790 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:23:05.630790 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:23:05.630790 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:23:05.630790 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:23:05.630790 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:23:05.631872 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:23:05.631872 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:23:05.631872 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:23:05.631872 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:23:05.631872 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:23:05.631872 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:23:05.631872 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:23:05.631872 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:23:05.631872 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:23:05.631872 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:23:05.631872 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:23:05.631872 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jun 07 14:23:05.631872 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:23:05.631872 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:23:05.631872 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:23:05.631872 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:23:05.633243 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:23:05.633243 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:23:05.633243 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:23:05.633243 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:23:05.633243 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:23:05.633243 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:23:05.633243 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:23:05.633243 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:23:05.633243 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:23:05.633243 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:23:05.633243 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 14:23:05.633243 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:23:05.633243 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 585/1188] 10.222.0.86 () {56 vars in 1096 bytes} [Tue Jun 7 14:23:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:23:05.638332 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016b7b2a-36d9-471c-9a0e-f7c90771ccfa None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:05.734401 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016b7b2a-36d9-471c-9a0e-f7c90771ccfa None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:05.767078 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256c93a2-9f7b-4ccc-a89f-8da101f42214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:05.767736 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256c93a2-9f7b-4ccc-a89f-8da101f42214 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:05.768052 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256c93a2-9f7b-4ccc-a89f-8da101f42214 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:05.768330 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256c93a2-9f7b-4ccc-a89f-8da101f42214 None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:05.769072 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256c93a2-9f7b-4ccc-a89f-8da101f42214 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:23:05.769378 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256c93a2-9f7b-4ccc-a89f-8da101f42214 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:23:05.770731 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256c93a2-9f7b-4ccc-a89f-8da101f42214 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:23:05.779068 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 604/1189] 10.222.0.86 () {56 vars in 1099 bytes} [Tue Jun 7 14:23:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:23:05.784772 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9596e2b-3f1c-4a30-acdb-789ea5b056ad None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:05.788743 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:23:05.880389 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9596e2b-3f1c-4a30-acdb-789ea5b056ad None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:05.913140 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e308fee4-611e-44e3-a93b-1fe190e22bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:05.914008 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e308fee4-611e-44e3-a93b-1fe190e22bfa None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:05.914293 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e308fee4-611e-44e3-a93b-1fe190e22bfa None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:05.914571 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e308fee4-611e-44e3-a93b-1fe190e22bfa None admin] PATH_INFO: `/v3/users/5aa5c5a95ea549f39b6790abb5e55f61` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:05.915746 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e308fee4-611e-44e3-a93b-1fe190e22bfa None admin] RBAC: Authorizing `identity:get_user(user_id=5aa5c5a95ea549f39b6790abb5e55f61)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:23:05.917202 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e308fee4-611e-44e3-a93b-1fe190e22bfa None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:23:05.918789 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 586/1190] 10.222.0.86 () {56 vars in 1177 bytes} [Tue Jun 7 14:23:05 2022] GET /identity/v3/users/5aa5c5a95ea549f39b6790abb5e55f61 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:23:05.924357 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256c93a2-9f7b-4ccc-a89f-8da101f42214 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:05.946190 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:23:06.020845 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256c93a2-9f7b-4ccc-a89f-8da101f42214 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:06.053277 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6904393e-fe55-41b9-98f7-273a67452edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:06.054624 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6904393e-fe55-41b9-98f7-273a67452edd None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:06.054925 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6904393e-fe55-41b9-98f7-273a67452edd None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:06.055204 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6904393e-fe55-41b9-98f7-273a67452edd None admin] PATH_INFO: `/v3/projects/0cb8ea355bab47c89d6eb353535ef8df` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:06.056390 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6904393e-fe55-41b9-98f7-273a67452edd None admin] RBAC: Authorizing `identity:get_project(project_id=0cb8ea355bab47c89d6eb353535ef8df)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:23:06.057807 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6904393e-fe55-41b9-98f7-273a67452edd None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:23:06.059473 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 605/1191] 10.222.0.86 () {56 vars in 1186 bytes} [Tue Jun 7 14:23:05 2022] GET /identity/v3/projects/0cb8ea355bab47c89d6eb353535ef8df => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:23:06.065212 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e308fee4-611e-44e3-a93b-1fe190e22bfa None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:06.133540 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:23:06.161478 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e308fee4-611e-44e3-a93b-1fe190e22bfa None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:06.194116 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea067224-c99e-4393-a45d-40cb87243788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:06.195610 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea067224-c99e-4393-a45d-40cb87243788 None admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:06.195925 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea067224-c99e-4393-a45d-40cb87243788 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:06.196201 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea067224-c99e-4393-a45d-40cb87243788 None admin] PATH_INFO: `/v3/projects/0cb8ea355bab47c89d6eb353535ef8df/users/5aa5c5a95ea549f39b6790abb5e55f61/roles/e3bf6239f5bf477b965704b086786f11` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:06.198207 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea067224-c99e-4393-a45d-40cb87243788 None admin] RBAC: Authorizing `identity:create_grant(project_id=0cb8ea355bab47c89d6eb353535ef8df, user_id=5aa5c5a95ea549f39b6790abb5e55f61, role_id=e3bf6239f5bf477b965704b086786f11)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:23:06.199636 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea067224-c99e-4393-a45d-40cb87243788 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:23:06.288475 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 587/1192] 10.222.0.86 () {58 vars in 1439 bytes} [Tue Jun 7 14:23:06 2022] PUT /identity/v3/projects/0cb8ea355bab47c89d6eb353535ef8df/users/5aa5c5a95ea549f39b6790abb5e55f61/roles/e3bf6239f5bf477b965704b086786f11 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:23:08.484792 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4af6cb-acf9-4017-a49a-93d67ca880b8 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:08.485316 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4af6cb-acf9-4017-a49a-93d67ca880b8 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:08.485316 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4af6cb-acf9-4017-a49a-93d67ca880b8 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:08.486619 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 606/1193] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:23:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:23:08.491726 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe2ce7d-de16-4fa7-87c7-2abd35e54cdc None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:08.492176 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe2ce7d-de16-4fa7-87c7-2abd35e54cdc None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:08.492318 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe2ce7d-de16-4fa7-87c7-2abd35e54cdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:08.508747 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-ebe2ce7d-de16-4fa7-87c7-2abd35e54cdc None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:23:08.509965 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-ebe2ce7d-de16-4fa7-87c7-2abd35e54cdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:23:08.574686 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 588/1194] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:23:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 14:23:08.598038 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4af6cb-acf9-4017-a49a-93d67ca880b8 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:08.686109 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:23:08.699241 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4af6cb-acf9-4017-a49a-93d67ca880b8 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:08.732881 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5468704-713d-4a89-bc72-d4031f04bd32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:08.733667 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5468704-713d-4a89-bc72-d4031f04bd32 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:08.733954 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5468704-713d-4a89-bc72-d4031f04bd32 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:08.734232 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5468704-713d-4a89-bc72-d4031f04bd32 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:08.744280 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5468704-713d-4a89-bc72-d4031f04bd32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:23:08.751739 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-a5468704-713d-4a89-bc72-d4031f04bd32 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 14:23:08.751739 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:23:08.751739 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:23:08.751739 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:23:08.751739 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:23:08.751739 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:23:08.751739 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:23:08.751739 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:23:08.751739 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:23:08.751739 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:23:08.751739 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:23:08.751739 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:23:08.751739 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:23:08.751739 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:23:08.751739 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:23:08.751739 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:23:08.752856 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:23:08.752856 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:23:08.752856 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:23:08.752856 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:23:08.752856 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:23:08.752856 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:23:08.752856 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:23:08.752856 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:23:08.752856 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:23:08.752856 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:23:08.752856 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:23:08.752856 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jun 07 14:23:08.752856 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:23:08.752856 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:23:08.752856 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:23:08.752856 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:23:08.753883 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:23:08.753883 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:23:08.753883 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:23:08.753883 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:23:08.753883 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:23:08.753883 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:23:08.753883 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:23:08.753883 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:23:08.753883 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:23:08.753883 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:23:08.753883 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 14:23:08.753883 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:23:08.753883 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 607/1195] 10.222.0.86 () {56 vars in 1096 bytes} [Tue Jun 7 14:23:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:23:08.759414 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe2ce7d-de16-4fa7-87c7-2abd35e54cdc None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:08.818677 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:23:08.856222 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe2ce7d-de16-4fa7-87c7-2abd35e54cdc None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:08.888981 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a052350-6fff-4b36-acfd-ab20ee138816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:08.889637 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a052350-6fff-4b36-acfd-ab20ee138816 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:08.889923 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a052350-6fff-4b36-acfd-ab20ee138816 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:08.890202 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a052350-6fff-4b36-acfd-ab20ee138816 None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:08.890950 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a052350-6fff-4b36-acfd-ab20ee138816 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:23:08.891261 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a052350-6fff-4b36-acfd-ab20ee138816 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:23:08.892682 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a052350-6fff-4b36-acfd-ab20ee138816 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:23:08.901682 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 589/1196] 10.222.0.86 () {56 vars in 1099 bytes} [Tue Jun 7 14:23:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:23:08.907136 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5468704-713d-4a89-bc72-d4031f04bd32 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:09.004367 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5468704-713d-4a89-bc72-d4031f04bd32 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:09.037055 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b8d5fc-2645-4a8b-8239-bdf41d8e29c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:09.037896 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b8d5fc-2645-4a8b-8239-bdf41d8e29c4 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:09.038181 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b8d5fc-2645-4a8b-8239-bdf41d8e29c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:09.038487 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b8d5fc-2645-4a8b-8239-bdf41d8e29c4 None admin] PATH_INFO: `/v3/users/5aa5c5a95ea549f39b6790abb5e55f61` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:09.039666 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b8d5fc-2645-4a8b-8239-bdf41d8e29c4 None admin] RBAC: Authorizing `identity:get_user(user_id=5aa5c5a95ea549f39b6790abb5e55f61)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:23:09.041129 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b8d5fc-2645-4a8b-8239-bdf41d8e29c4 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:23:09.042726 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 608/1197] 10.222.0.86 () {56 vars in 1177 bytes} [Tue Jun 7 14:23:08 2022] GET /identity/v3/users/5aa5c5a95ea549f39b6790abb5e55f61 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:23:09.049355 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a052350-6fff-4b36-acfd-ab20ee138816 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:09.147537 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a052350-6fff-4b36-acfd-ab20ee138816 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:09.170345 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:23:09.181035 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca753f4b-9ec4-4b3a-b65a-285997aeb3ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:09.183602 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca753f4b-9ec4-4b3a-b65a-285997aeb3ed None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:09.183602 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca753f4b-9ec4-4b3a-b65a-285997aeb3ed None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:09.183602 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca753f4b-9ec4-4b3a-b65a-285997aeb3ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:09.248288 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca753f4b-9ec4-4b3a-b65a-285997aeb3ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:23:09.249770 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca753f4b-9ec4-4b3a-b65a-285997aeb3ed None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:23:09.344897 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 590/1198] 10.222.0.86 () {58 vars in 1282 bytes} [Tue Jun 7 14:23:09 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 07 14:23:09.350635 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b8d5fc-2645-4a8b-8239-bdf41d8e29c4 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:09.369922 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:23:09.449562 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b8d5fc-2645-4a8b-8239-bdf41d8e29c4 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:09.482363 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dec8de-5886-4533-b0ff-d4f25c1026c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:09.483206 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dec8de-5886-4533-b0ff-d4f25c1026c1 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:09.483486 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dec8de-5886-4533-b0ff-d4f25c1026c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:09.483785 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dec8de-5886-4533-b0ff-d4f25c1026c1 None admin] PATH_INFO: `/v3/projects/0cb8ea355bab47c89d6eb353535ef8df` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:09.484952 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dec8de-5886-4533-b0ff-d4f25c1026c1 None admin] RBAC: Authorizing `identity:get_project(project_id=0cb8ea355bab47c89d6eb353535ef8df)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:23:09.486373 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dec8de-5886-4533-b0ff-d4f25c1026c1 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:23:09.488072 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 609/1199] 10.222.0.86 () {56 vars in 1186 bytes} [Tue Jun 7 14:23:09 2022] GET /identity/v3/projects/0cb8ea355bab47c89d6eb353535ef8df => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:23:09.494579 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca753f4b-9ec4-4b3a-b65a-285997aeb3ed None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:09.518890 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:23:09.589546 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca753f4b-9ec4-4b3a-b65a-285997aeb3ed None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:09.621034 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a666772d-de2a-4023-89ce-a99d91bb9662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:09.621611 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a666772d-de2a-4023-89ce-a99d91bb9662 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:09.621890 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a666772d-de2a-4023-89ce-a99d91bb9662 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:09.622164 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a666772d-de2a-4023-89ce-a99d91bb9662 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:09.622979 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a666772d-de2a-4023-89ce-a99d91bb9662 None admin] RBAC: Adding query filter params (role.id=e3bf6239f5bf477b965704b086786f11, scope.project.id=0cb8ea355bab47c89d6eb353535ef8df, user.id=5aa5c5a95ea549f39b6790abb5e55f61) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:23:09.623286 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a666772d-de2a-4023-89ce-a99d91bb9662 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:23:09.624714 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a666772d-de2a-4023-89ce-a99d91bb9662 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:23:09.630268 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 591/1200] 10.222.0.86 () {56 vars in 1374 bytes} [Tue Jun 7 14:23:09 2022] GET /identity/v3/role_assignments?user.id=5aa5c5a95ea549f39b6790abb5e55f61&scope.project.id=0cb8ea355bab47c89d6eb353535ef8df&role.id=e3bf6239f5bf477b965704b086786f11 => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:23:19.478289 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=58 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:23:19.627682 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=56 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:24:31.030940 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9912de54-9309-49b9-8ea9-6ed5e5bb5fad None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:24:31.031557 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9912de54-9309-49b9-8ea9-6ed5e5bb5fad None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:24:31.031557 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9912de54-9309-49b9-8ea9-6ed5e5bb5fad None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:24:31.032907 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 610/1201] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:24:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:24:31.038406 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e156234-0a73-4d23-a399-26a5541996ab None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:24:31.038855 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e156234-0a73-4d23-a399-26a5541996ab None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:24:31.038956 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e156234-0a73-4d23-a399-26a5541996ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:24:31.055140 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-5e156234-0a73-4d23-a399-26a5541996ab None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:24:31.056336 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-5e156234-0a73-4d23-a399-26a5541996ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:24:31.120869 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 592/1202] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:24:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 07 14:24:31.145754 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9912de54-9309-49b9-8ea9-6ed5e5bb5fad None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:24:31.246210 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9912de54-9309-49b9-8ea9-6ed5e5bb5fad None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:24:31.279863 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8fa1d5-b717-4d97-9212-8b20560569c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:24:31.282725 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8fa1d5-b717-4d97-9212-8b20560569c0 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:24:31.282725 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8fa1d5-b717-4d97-9212-8b20560569c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:24:31.282725 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8fa1d5-b717-4d97-9212-8b20560569c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:24:31.291541 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8fa1d5-b717-4d97-9212-8b20560569c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:24:31.293094 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8fa1d5-b717-4d97-9212-8b20560569c0 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:24:31.310652 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-af8fa1d5-b717-4d97-9212-8b20560569c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:24:31.310652 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:24:31.310652 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:24:31.310652 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:24:31.310652 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:24:31.310652 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:24:31.310652 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:24:31.310652 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:24:31.310652 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:24:31.310652 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:24:31.310652 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:24:31.310652 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:24:31.310652 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:24:31.310652 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:24:31.310652 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:24:31.319209 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:24:31.319209 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:24:31.319209 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:24:31.319209 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:24:31.319209 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:24:31.319209 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:24:31.319209 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:24:31.319209 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:24:31.319209 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jun 07 14:24:31.319209 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:24:31.319209 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:24:31.319209 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:24:31.319209 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:24:31.319209 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:24:31.319209 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:24:31.319209 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:24:31.319209 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:24:31.320431 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:24:31.320431 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:24:31.320431 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:24:31.320431 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:24:31.320431 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 611/1203] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jun 7 14:24:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:24:31.320804 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e156234-0a73-4d23-a399-26a5541996ab None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:24:31.413365 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e156234-0a73-4d23-a399-26a5541996ab None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:24:31.440510 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:24:31.446044 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1411ef5f-c6e2-43e9-bf21-bfefe4eb1bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:24:31.447286 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1411ef5f-c6e2-43e9-bf21-bfefe4eb1bc2 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:24:31.447565 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1411ef5f-c6e2-43e9-bf21-bfefe4eb1bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:24:31.447864 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1411ef5f-c6e2-43e9-bf21-bfefe4eb1bc2 None admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:24:31.448574 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1411ef5f-c6e2-43e9-bf21-bfefe4eb1bc2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:24:31.448878 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1411ef5f-c6e2-43e9-bf21-bfefe4eb1bc2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:24:31.450218 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1411ef5f-c6e2-43e9-bf21-bfefe4eb1bc2 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:24:31.460753 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 593/1204] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jun 7 14:24:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:24:31.466929 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8fa1d5-b717-4d97-9212-8b20560569c0 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:24:31.518894 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:24:31.565155 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8fa1d5-b717-4d97-9212-8b20560569c0 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:24:31.599595 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44214a29-5a36-45c5-b0e5-600fe2415040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:24:31.600287 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44214a29-5a36-45c5-b0e5-600fe2415040 None admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:24:31.600573 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44214a29-5a36-45c5-b0e5-600fe2415040 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:24:31.600852 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44214a29-5a36-45c5-b0e5-600fe2415040 None admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:24:31.601551 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44214a29-5a36-45c5-b0e5-600fe2415040 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:24:31.602992 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44214a29-5a36-45c5-b0e5-600fe2415040 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:24:31.706759 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 612/1205] 10.222.0.86 () {60 vars in 1132 bytes} [Tue Jun 7 14:24:31 2022] POST /identity/v3/users => generated 251 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:24:33.986098 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47488b0e-e3cf-4fbc-a814-6053b668207d None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:24:33.986658 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47488b0e-e3cf-4fbc-a814-6053b668207d None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:24:33.986658 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47488b0e-e3cf-4fbc-a814-6053b668207d None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:24:33.988080 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 594/1206] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:24:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:24:33.993314 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff228e43-a1fa-404a-ac7e-c95b8e919f20 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:24:33.994289 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff228e43-a1fa-404a-ac7e-c95b8e919f20 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:24:33.994460 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff228e43-a1fa-404a-ac7e-c95b8e919f20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:24:34.011852 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-ff228e43-a1fa-404a-ac7e-c95b8e919f20 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:24:34.015818 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-ff228e43-a1fa-404a-ac7e-c95b8e919f20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:24:34.077981 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 613/1207] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:24:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 14:24:34.101992 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47488b0e-e3cf-4fbc-a814-6053b668207d None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:24:34.202205 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47488b0e-e3cf-4fbc-a814-6053b668207d None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:24:34.236049 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac5fffa-50ed-4fac-932c-b328d73b4fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:24:34.236889 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac5fffa-50ed-4fac-932c-b328d73b4fde None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:24:34.237119 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac5fffa-50ed-4fac-932c-b328d73b4fde None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:24:34.237391 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac5fffa-50ed-4fac-932c-b328d73b4fde None admin] PATH_INFO: `/v3/roles/service` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:24:34.248583 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac5fffa-50ed-4fac-932c-b328d73b4fde None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:24:34.256260 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-4ac5fffa-50ed-4fac-932c-b328d73b4fde None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 07 14:24:34.256260 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:24:34.256260 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:24:34.256260 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:24:34.256260 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:24:34.256260 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:24:34.256260 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:24:34.256260 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:24:34.256260 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:24:34.256260 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:24:34.256260 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:24:34.256260 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:24:34.256260 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:24:34.256260 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:24:34.256260 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:24:34.256260 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:24:34.257374 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:24:34.257374 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:24:34.257374 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:24:34.257374 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:24:34.257374 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:24:34.257374 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:24:34.257374 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:24:34.257374 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:24:34.257374 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:24:34.257374 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:24:34.257374 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:24:34.257374 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jun 07 14:24:34.257374 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:24:34.257374 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:24:34.257374 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:24:34.257374 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:24:34.258485 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:24:34.258485 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:24:34.258485 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:24:34.258485 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:24:34.258485 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:24:34.258485 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:24:34.258485 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:24:34.258485 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:24:34.258485 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:24:34.258485 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:24:34.258485 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 07 14:24:34.258485 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:24:34.258485 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 595/1208] 10.222.0.86 () {56 vars in 1102 bytes} [Tue Jun 7 14:24:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:24:34.263585 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff228e43-a1fa-404a-ac7e-c95b8e919f20 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:24:34.302172 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:24:34.360292 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff228e43-a1fa-404a-ac7e-c95b8e919f20 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:24:34.392312 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4ba3e9-38d6-4f87-8906-5369f1060e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:24:34.393030 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4ba3e9-38d6-4f87-8906-5369f1060e90 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:24:34.393310 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4ba3e9-38d6-4f87-8906-5369f1060e90 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:24:34.393583 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4ba3e9-38d6-4f87-8906-5369f1060e90 None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:24:34.394348 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4ba3e9-38d6-4f87-8906-5369f1060e90 None admin] RBAC: Adding query filter params (name=service) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:24:34.394652 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4ba3e9-38d6-4f87-8906-5369f1060e90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:24:34.396063 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4ba3e9-38d6-4f87-8906-5369f1060e90 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:24:34.404199 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 614/1209] 10.222.0.86 () {56 vars in 1103 bytes} [Tue Jun 7 14:24:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:24:34.410002 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac5fffa-50ed-4fac-932c-b328d73b4fde None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:24:34.459425 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:24:34.507511 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac5fffa-50ed-4fac-932c-b328d73b4fde None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:24:34.542030 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14753b2-256c-4ea4-8765-838d05d1e6c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:24:34.542802 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14753b2-256c-4ea4-8765-838d05d1e6c2 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:24:34.543090 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14753b2-256c-4ea4-8765-838d05d1e6c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:24:34.543366 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14753b2-256c-4ea4-8765-838d05d1e6c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:24:34.553059 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14753b2-256c-4ea4-8765-838d05d1e6c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:24:34.554504 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14753b2-256c-4ea4-8765-838d05d1e6c2 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:24:34.571915 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-e14753b2-256c-4ea4-8765-838d05d1e6c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:24:34.571915 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:24:34.571915 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:24:34.571915 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:24:34.571915 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:24:34.571915 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:24:34.571915 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:24:34.571915 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:24:34.571915 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:24:34.571915 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:24:34.571915 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:24:34.571915 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:24:34.571915 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:24:34.571915 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:24:34.571915 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:24:34.573033 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:24:34.573033 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:24:34.573033 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:24:34.573033 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:24:34.573033 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:24:34.573033 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:24:34.573033 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:24:34.573033 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:24:34.573033 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jun 07 14:24:34.573033 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:24:34.573033 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:24:34.573033 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:24:34.573033 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:24:34.573033 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:24:34.573033 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:24:34.573033 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:24:34.573033 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:24:34.574154 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:24:34.574154 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:24:34.574154 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:24:34.574154 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:24:34.574855 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 596/1210] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jun 7 14:24:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:24:34.580386 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4ba3e9-38d6-4f87-8906-5369f1060e90 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:24:34.678346 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:24:34.681732 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4ba3e9-38d6-4f87-8906-5369f1060e90 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:24:34.714337 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aedd3c0-6026-4a09-88dc-844fafb316fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:24:34.714993 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aedd3c0-6026-4a09-88dc-844fafb316fb None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:24:34.715280 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aedd3c0-6026-4a09-88dc-844fafb316fb None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:24:34.715560 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aedd3c0-6026-4a09-88dc-844fafb316fb None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:24:34.716373 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aedd3c0-6026-4a09-88dc-844fafb316fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:24:34.716685 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aedd3c0-6026-4a09-88dc-844fafb316fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:24:34.718039 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aedd3c0-6026-4a09-88dc-844fafb316fb None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:24:34.729371 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 615/1211] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jun 7 14:24:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:24:34.735389 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14753b2-256c-4ea4-8765-838d05d1e6c2 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:24:34.832841 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14753b2-256c-4ea4-8765-838d05d1e6c2 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:24:34.834343 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:24:34.865790 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854298b2-0788-4450-a95c-e5d3b290ad03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:24:34.866577 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854298b2-0788-4450-a95c-e5d3b290ad03 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:24:34.866864 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854298b2-0788-4450-a95c-e5d3b290ad03 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:24:34.867142 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854298b2-0788-4450-a95c-e5d3b290ad03 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:24:34.874737 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854298b2-0788-4450-a95c-e5d3b290ad03 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:24:34.876726 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854298b2-0788-4450-a95c-e5d3b290ad03 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:24:34.890650 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-854298b2-0788-4450-a95c-e5d3b290ad03 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 07 14:24:34.890650 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:24:34.890650 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:24:34.890650 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:24:34.890650 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:24:34.890650 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:24:34.890650 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:24:34.890650 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:24:34.890650 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:24:34.890650 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:24:34.890650 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:24:34.890650 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:24:34.890650 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 14:24:34.890650 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 14:24:34.890650 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 14:24:34.890650 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 14:24:34.891647 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:24:34.891647 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:24:34.891647 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 14:24:34.891647 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:24:34.891647 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 14:24:34.891647 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:24:34.891647 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:24:34.891647 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:24:34.891647 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:24:34.891647 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:24:34.891647 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:24:34.891647 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jun 07 14:24:34.891647 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:24:34.891647 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:24:34.891647 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:24:34.891647 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:24:34.891647 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:24:34.891647 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:24:34.892673 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:24:34.892673 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:24:34.892673 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 14:24:34.892673 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 14:24:34.892673 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 14:24:34.892673 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 14:24:34.892673 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 14:24:34.892673 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 14:24:34.892673 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 07 14:24:34.892673 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:24:34.892673 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 597/1212] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jun 7 14:24:34 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:24:34.897922 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aedd3c0-6026-4a09-88dc-844fafb316fb None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:24:34.995620 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aedd3c0-6026-4a09-88dc-844fafb316fb None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:24:35.028010 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c9fdd7-651c-4570-b3fd-90d3f39165db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:24:35.028672 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c9fdd7-651c-4570-b3fd-90d3f39165db None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:24:35.028953 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c9fdd7-651c-4570-b3fd-90d3f39165db None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:24:35.029224 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c9fdd7-651c-4570-b3fd-90d3f39165db None admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:24:35.030050 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c9fdd7-651c-4570-b3fd-90d3f39165db None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:24:35.030354 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c9fdd7-651c-4570-b3fd-90d3f39165db None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:24:35.031777 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c9fdd7-651c-4570-b3fd-90d3f39165db None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:24:35.049266 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 616/1213] 10.222.0.86 () {56 vars in 1143 bytes} [Tue Jun 7 14:24:34 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:24:35.054982 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854298b2-0788-4450-a95c-e5d3b290ad03 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:24:35.152330 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854298b2-0788-4450-a95c-e5d3b290ad03 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:24:35.185650 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2624eaae-f101-44f9-9c7d-2079a041d574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:24:35.186293 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2624eaae-f101-44f9-9c7d-2079a041d574 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:24:35.186583 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2624eaae-f101-44f9-9c7d-2079a041d574 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:24:35.186860 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2624eaae-f101-44f9-9c7d-2079a041d574 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:24:35.216338 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:24:35.252811 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2624eaae-f101-44f9-9c7d-2079a041d574 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:24:35.254287 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2624eaae-f101-44f9-9c7d-2079a041d574 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:24:35.348090 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 598/1214] 10.222.0.86 () {58 vars in 1282 bytes} [Tue Jun 7 14:24:35 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 07 14:24:35.353821 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c9fdd7-651c-4570-b3fd-90d3f39165db None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:24:35.372793 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:24:35.450561 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c9fdd7-651c-4570-b3fd-90d3f39165db None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:24:35.483431 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91018ff-ecb7-4f05-b1b8-b570254d2ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:24:35.484273 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91018ff-ecb7-4f05-b1b8-b570254d2ecc None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:24:35.484560 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91018ff-ecb7-4f05-b1b8-b570254d2ecc None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:24:35.484860 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91018ff-ecb7-4f05-b1b8-b570254d2ecc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:24:35.494820 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91018ff-ecb7-4f05-b1b8-b570254d2ecc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:24:35.496343 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91018ff-ecb7-4f05-b1b8-b570254d2ecc None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:24:35.515365 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-e91018ff-ecb7-4f05-b1b8-b570254d2ecc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:24:35.515365 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:24:35.515365 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:24:35.515365 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:24:35.515365 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:24:35.515365 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:24:35.515365 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:24:35.515365 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:24:35.515365 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:24:35.515365 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:24:35.515365 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:24:35.515365 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:24:35.515365 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:24:35.515365 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:24:35.515365 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:24:35.516516 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:24:35.516516 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:24:35.516516 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:24:35.516516 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:24:35.516516 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:24:35.516516 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:24:35.516516 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:24:35.516516 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:24:35.516516 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jun 07 14:24:35.516516 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:24:35.516516 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:24:35.516516 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:24:35.516516 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:24:35.516516 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:24:35.516516 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:24:35.516516 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:24:35.516516 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:24:35.517775 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:24:35.517775 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:24:35.517775 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:24:35.517775 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:24:35.517775 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 617/1215] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jun 7 14:24:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:24:35.522241 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2624eaae-f101-44f9-9c7d-2079a041d574 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:24:35.581148 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:24:35.618201 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2624eaae-f101-44f9-9c7d-2079a041d574 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:24:35.651747 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b77386-bf87-415e-be54-c787e6541e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:24:35.652424 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b77386-bf87-415e-be54-c787e6541e52 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:24:35.652707 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b77386-bf87-415e-be54-c787e6541e52 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:24:35.652982 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b77386-bf87-415e-be54-c787e6541e52 None admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:24:35.653703 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b77386-bf87-415e-be54-c787e6541e52 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:24:35.654010 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b77386-bf87-415e-be54-c787e6541e52 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:24:35.655375 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b77386-bf87-415e-be54-c787e6541e52 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:24:35.666610 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 599/1216] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jun 7 14:24:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:24:35.672240 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91018ff-ecb7-4f05-b1b8-b570254d2ecc None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:24:35.740344 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:24:35.769300 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91018ff-ecb7-4f05-b1b8-b570254d2ecc None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:24:35.802318 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4364604d-5d04-45d5-bc08-8352b56d161b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:24:35.803101 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4364604d-5d04-45d5-bc08-8352b56d161b None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:24:35.803379 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4364604d-5d04-45d5-bc08-8352b56d161b None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:24:35.803652 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4364604d-5d04-45d5-bc08-8352b56d161b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:24:35.810010 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4364604d-5d04-45d5-bc08-8352b56d161b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:24:35.811438 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4364604d-5d04-45d5-bc08-8352b56d161b None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:24:35.825041 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-4364604d-5d04-45d5-bc08-8352b56d161b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:24:35.825041 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:24:35.825041 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:24:35.825041 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:24:35.825041 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:24:35.825041 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:24:35.825041 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:24:35.825041 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:24:35.825041 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:24:35.825041 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:24:35.825041 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:24:35.825041 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:24:35.825041 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 14:24:35.825041 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 14:24:35.825041 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 14:24:35.826172 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 14:24:35.826172 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:24:35.826172 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:24:35.826172 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:24:35.826172 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:24:35.826172 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:24:35.826172 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:24:35.826172 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:24:35.826172 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jun 07 14:24:35.826172 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:24:35.826172 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:24:35.826172 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:24:35.826172 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:24:35.826172 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:24:35.826172 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:24:35.826172 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:24:35.826172 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:24:35.827444 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 14:24:35.827444 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 14:24:35.827444 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 14:24:35.827444 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 14:24:35.827444 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 14:24:35.827444 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 14:24:35.827444 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:24:35.827444 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:24:35.827444 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 618/1217] 10.222.0.86 () {56 vars in 1111 bytes} [Tue Jun 7 14:24:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:24:35.832236 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b77386-bf87-415e-be54-c787e6541e52 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:24:35.930799 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b77386-bf87-415e-be54-c787e6541e52 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:24:35.952693 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:24:35.963514 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d605e8-6050-4bbe-ac10-b837316804eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:24:35.964188 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d605e8-6050-4bbe-ac10-b837316804eb None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:24:35.964467 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d605e8-6050-4bbe-ac10-b837316804eb None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:24:35.964737 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d605e8-6050-4bbe-ac10-b837316804eb None admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:24:35.965507 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d605e8-6050-4bbe-ac10-b837316804eb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:24:35.965809 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d605e8-6050-4bbe-ac10-b837316804eb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:24:35.967226 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d605e8-6050-4bbe-ac10-b837316804eb None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:24:35.978500 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 600/1218] 10.222.0.86 () {56 vars in 1148 bytes} [Tue Jun 7 14:24:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:24:35.984489 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4364604d-5d04-45d5-bc08-8352b56d161b None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:24:36.082355 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4364604d-5d04-45d5-bc08-8352b56d161b None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:24:36.109953 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:24:36.115728 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbbe079-a3b1-422a-9203-3cbd333fad9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:24:36.116447 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbbe079-a3b1-422a-9203-3cbd333fad9c None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:24:36.116731 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbbe079-a3b1-422a-9203-3cbd333fad9c None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:24:36.117012 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbbe079-a3b1-422a-9203-3cbd333fad9c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:24:36.117836 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbbe079-a3b1-422a-9203-3cbd333fad9c None admin] RBAC: Adding query filter params (role.id=28e9b75018ac44c0afe7ab728071f2d5, scope.project.id=e429537b190c4c5ea7e1332ab044ca7a, user.id=7e042f9d4a9345bb947e6a30f64a59ea) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:24:36.118150 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbbe079-a3b1-422a-9203-3cbd333fad9c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:24:36.120154 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbbe079-a3b1-422a-9203-3cbd333fad9c None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:24:36.125542 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 619/1219] 10.222.0.86 () {56 vars in 1374 bytes} [Tue Jun 7 14:24:35 2022] GET /identity/v3/role_assignments?user.id=7e042f9d4a9345bb947e6a30f64a59ea&scope.project.id=e429537b190c4c5ea7e1332ab044ca7a&role.id=28e9b75018ac44c0afe7ab728071f2d5 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:24:38.326910 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b37176-5d19-4051-bde6-f930d1a9a998 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:24:38.327548 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b37176-5d19-4051-bde6-f930d1a9a998 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:24:38.327548 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b37176-5d19-4051-bde6-f930d1a9a998 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:24:38.328841 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 601/1220] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:24:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:24:38.333925 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810fffed-45a4-40bd-bd9d-3381d7ab5cfc None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:24:38.334343 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810fffed-45a4-40bd-bd9d-3381d7ab5cfc None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:24:38.334489 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810fffed-45a4-40bd-bd9d-3381d7ab5cfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:24:38.351238 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-810fffed-45a4-40bd-bd9d-3381d7ab5cfc None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:24:38.352531 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-810fffed-45a4-40bd-bd9d-3381d7ab5cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:24:38.418549 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 620/1221] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:24:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 14:24:38.442851 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b37176-5d19-4051-bde6-f930d1a9a998 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:24:38.546673 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b37176-5d19-4051-bde6-f930d1a9a998 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:24:38.579217 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119c8912-f1ce-49fd-b419-30968b785572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:24:38.580101 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119c8912-f1ce-49fd-b419-30968b785572 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:24:38.580387 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119c8912-f1ce-49fd-b419-30968b785572 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:24:38.580660 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119c8912-f1ce-49fd-b419-30968b785572 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:24:38.590953 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119c8912-f1ce-49fd-b419-30968b785572 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:24:38.598701 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-119c8912-f1ce-49fd-b419-30968b785572 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 07 14:24:38.598701 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:24:38.598701 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:24:38.598701 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:24:38.598701 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:24:38.598701 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:24:38.598701 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:24:38.598701 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:24:38.598701 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:24:38.598701 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:24:38.598701 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:24:38.598701 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:24:38.598701 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:24:38.598701 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:24:38.598701 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:24:38.598701 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:24:38.599951 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:24:38.599951 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:24:38.599951 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:24:38.599951 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:24:38.599951 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:24:38.599951 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:24:38.599951 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:24:38.599951 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:24:38.599951 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:24:38.599951 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:24:38.599951 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:24:38.599951 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jun 07 14:24:38.599951 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:24:38.599951 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:24:38.599951 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:24:38.599951 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:24:38.600927 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:24:38.600927 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:24:38.600927 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:24:38.600927 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:24:38.600927 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:24:38.600927 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:24:38.600927 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:24:38.600927 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:24:38.600927 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:24:38.600927 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:24:38.600927 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 07 14:24:38.600927 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:24:38.600927 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 602/1222] 10.222.0.86 () {56 vars in 1102 bytes} [Tue Jun 7 14:24:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:24:38.605832 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810fffed-45a4-40bd-bd9d-3381d7ab5cfc None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:24:38.702867 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810fffed-45a4-40bd-bd9d-3381d7ab5cfc None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:24:38.726221 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:24:38.737053 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3e554f-5080-453a-983a-01cc89563891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:24:38.746668 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3e554f-5080-453a-983a-01cc89563891 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:24:38.746668 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3e554f-5080-453a-983a-01cc89563891 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:24:38.746668 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3e554f-5080-453a-983a-01cc89563891 None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:24:38.746668 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3e554f-5080-453a-983a-01cc89563891 None admin] RBAC: Adding query filter params (name=service) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:24:38.746668 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3e554f-5080-453a-983a-01cc89563891 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:24:38.746668 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3e554f-5080-453a-983a-01cc89563891 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:24:38.749091 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 621/1223] 10.222.0.86 () {56 vars in 1103 bytes} [Tue Jun 7 14:24:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:24:38.755010 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119c8912-f1ce-49fd-b419-30968b785572 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:24:38.797757 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:24:38.851557 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119c8912-f1ce-49fd-b419-30968b785572 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:24:38.883703 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fb7710-0298-47d6-83f6-b8dc49e81536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:24:38.884536 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fb7710-0298-47d6-83f6-b8dc49e81536 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:24:38.884821 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fb7710-0298-47d6-83f6-b8dc49e81536 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:24:38.885098 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fb7710-0298-47d6-83f6-b8dc49e81536 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:24:38.895842 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fb7710-0298-47d6-83f6-b8dc49e81536 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:24:38.897295 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fb7710-0298-47d6-83f6-b8dc49e81536 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:24:38.914711 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-20fb7710-0298-47d6-83f6-b8dc49e81536 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:24:38.914711 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:24:38.914711 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:24:38.914711 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:24:38.914711 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:24:38.914711 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:24:38.914711 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:24:38.914711 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:24:38.914711 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:24:38.914711 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:24:38.914711 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:24:38.914711 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:24:38.914711 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:24:38.914711 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:24:38.914711 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:24:38.916429 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:24:38.916429 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:24:38.916429 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:24:38.916429 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:24:38.916429 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:24:38.916429 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:24:38.916429 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:24:38.916429 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:24:38.916429 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jun 07 14:24:38.916429 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:24:38.916429 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:24:38.916429 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:24:38.916429 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:24:38.916429 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:24:38.916429 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:24:38.916429 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:24:38.916429 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:24:38.917364 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:24:38.917364 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:24:38.917364 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:24:38.917364 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:24:38.917364 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 603/1224] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jun 7 14:24:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:24:38.922394 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3e554f-5080-453a-983a-01cc89563891 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:24:39.018197 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3e554f-5080-453a-983a-01cc89563891 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:24:39.051527 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8522f7db-32d4-43ab-aee5-c460d9fc13ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:24:39.052147 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8522f7db-32d4-43ab-aee5-c460d9fc13ed None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:24:39.052435 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8522f7db-32d4-43ab-aee5-c460d9fc13ed None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:24:39.052712 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8522f7db-32d4-43ab-aee5-c460d9fc13ed None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:24:39.053433 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8522f7db-32d4-43ab-aee5-c460d9fc13ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:24:39.053772 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8522f7db-32d4-43ab-aee5-c460d9fc13ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:24:39.055142 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8522f7db-32d4-43ab-aee5-c460d9fc13ed None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:24:39.066705 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 622/1225] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jun 7 14:24:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:24:39.072535 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fb7710-0298-47d6-83f6-b8dc49e81536 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:24:39.165232 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:24:39.172455 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fb7710-0298-47d6-83f6-b8dc49e81536 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:24:39.205249 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb141c66-8bae-48f4-a95b-01484a8355dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:24:39.206087 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb141c66-8bae-48f4-a95b-01484a8355dd None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:24:39.206373 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb141c66-8bae-48f4-a95b-01484a8355dd None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:24:39.206655 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb141c66-8bae-48f4-a95b-01484a8355dd None admin] PATH_INFO: `/v3/users/placement` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:24:39.214736 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb141c66-8bae-48f4-a95b-01484a8355dd None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:24:39.216589 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb141c66-8bae-48f4-a95b-01484a8355dd None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:24:39.231361 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-eb141c66-8bae-48f4-a95b-01484a8355dd None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 07 14:24:39.231361 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:24:39.231361 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:24:39.231361 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:24:39.231361 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:24:39.231361 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:24:39.231361 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:24:39.231361 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:24:39.231361 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:24:39.231361 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:24:39.231361 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:24:39.231361 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:24:39.231361 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 14:24:39.231361 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 14:24:39.231361 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 14:24:39.231361 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 14:24:39.232564 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:24:39.232564 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:24:39.232564 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 14:24:39.232564 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:24:39.232564 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 14:24:39.232564 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:24:39.232564 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:24:39.232564 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:24:39.232564 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:24:39.232564 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:24:39.232564 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:24:39.232564 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jun 07 14:24:39.232564 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:24:39.232564 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:24:39.232564 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:24:39.232564 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:24:39.232564 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:24:39.232564 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:24:39.233736 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:24:39.233736 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:24:39.233736 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 14:24:39.233736 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 14:24:39.233736 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 14:24:39.233736 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 14:24:39.233736 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 14:24:39.233736 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 14:24:39.233736 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 07 14:24:39.233736 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:24:39.233736 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 604/1226] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jun 7 14:24:39 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:24:39.238486 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8522f7db-32d4-43ab-aee5-c460d9fc13ed None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:24:39.285880 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:24:39.336235 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8522f7db-32d4-43ab-aee5-c460d9fc13ed None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:24:39.368346 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70848b99-e80b-422d-a956-a0419a632bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:24:39.368999 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70848b99-e80b-422d-a956-a0419a632bd0 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:24:39.369275 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70848b99-e80b-422d-a956-a0419a632bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:24:39.369543 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70848b99-e80b-422d-a956-a0419a632bd0 None admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:24:39.370360 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70848b99-e80b-422d-a956-a0419a632bd0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:24:39.370661 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70848b99-e80b-422d-a956-a0419a632bd0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:24:39.372182 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70848b99-e80b-422d-a956-a0419a632bd0 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:24:39.389497 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 623/1227] 10.222.0.86 () {56 vars in 1143 bytes} [Tue Jun 7 14:24:39 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:24:39.395209 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb141c66-8bae-48f4-a95b-01484a8355dd None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:24:39.492411 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb141c66-8bae-48f4-a95b-01484a8355dd None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:24:39.525653 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f4836f-e38c-43ef-93f6-adca67ca6901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:24:39.526425 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f4836f-e38c-43ef-93f6-adca67ca6901 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:24:39.526701 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f4836f-e38c-43ef-93f6-adca67ca6901 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:24:39.526967 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f4836f-e38c-43ef-93f6-adca67ca6901 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:24:39.537246 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f4836f-e38c-43ef-93f6-adca67ca6901 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:24:39.538660 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f4836f-e38c-43ef-93f6-adca67ca6901 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:24:39.555011 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-f3f4836f-e38c-43ef-93f6-adca67ca6901 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:24:39.555011 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:24:39.555011 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:24:39.555011 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:24:39.555011 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:24:39.555011 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:24:39.555011 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:24:39.555011 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:24:39.555011 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:24:39.555011 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:24:39.555011 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:24:39.555011 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:24:39.555011 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:24:39.555011 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:24:39.555011 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:24:39.556062 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:24:39.556062 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:24:39.556062 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:24:39.556062 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:24:39.556062 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:24:39.556062 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:24:39.556062 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:24:39.556062 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:24:39.556062 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jun 07 14:24:39.556062 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:24:39.556062 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:24:39.556062 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:24:39.556062 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:24:39.556062 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:24:39.556062 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:24:39.556062 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:24:39.556062 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:24:39.561271 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:24:39.561271 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:24:39.561271 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:24:39.561271 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:24:39.561271 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 605/1228] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jun 7 14:24:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:24:39.562041 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70848b99-e80b-422d-a956-a0419a632bd0 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:24:39.656951 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70848b99-e80b-422d-a956-a0419a632bd0 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:24:39.659386 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:24:39.689367 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48439904-a678-496c-9d5e-f13d507f834a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:24:39.690021 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48439904-a678-496c-9d5e-f13d507f834a None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:24:39.690298 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48439904-a678-496c-9d5e-f13d507f834a None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:24:39.690566 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48439904-a678-496c-9d5e-f13d507f834a None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:24:39.691272 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48439904-a678-496c-9d5e-f13d507f834a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:24:39.691572 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48439904-a678-496c-9d5e-f13d507f834a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:24:39.693021 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48439904-a678-496c-9d5e-f13d507f834a None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:24:39.704272 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 624/1229] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jun 7 14:24:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:24:39.709814 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f4836f-e38c-43ef-93f6-adca67ca6901 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:24:39.719238 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:24:39.807102 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f4836f-e38c-43ef-93f6-adca67ca6901 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:24:39.840834 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0547bfdd-fa1a-49b0-8400-5e4ec96e1e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:24:39.841624 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0547bfdd-fa1a-49b0-8400-5e4ec96e1e13 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:24:39.841912 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0547bfdd-fa1a-49b0-8400-5e4ec96e1e13 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:24:39.842192 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0547bfdd-fa1a-49b0-8400-5e4ec96e1e13 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:24:39.848828 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0547bfdd-fa1a-49b0-8400-5e4ec96e1e13 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:24:39.850255 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0547bfdd-fa1a-49b0-8400-5e4ec96e1e13 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:24:39.864377 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-0547bfdd-fa1a-49b0-8400-5e4ec96e1e13 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:24:39.864377 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:24:39.864377 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:24:39.864377 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:24:39.864377 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:24:39.864377 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:24:39.864377 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:24:39.864377 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:24:39.864377 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:24:39.864377 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:24:39.864377 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:24:39.864377 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:24:39.864377 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 14:24:39.864377 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 14:24:39.864377 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 14:24:39.865499 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 14:24:39.865499 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:24:39.865499 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:24:39.865499 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:24:39.865499 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:24:39.865499 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:24:39.865499 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:24:39.865499 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:24:39.865499 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jun 07 14:24:39.865499 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:24:39.865499 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:24:39.865499 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:24:39.865499 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:24:39.865499 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:24:39.865499 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:24:39.865499 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:24:39.865499 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:24:39.866643 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 14:24:39.866643 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 14:24:39.866643 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 14:24:39.866643 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 14:24:39.866643 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 14:24:39.866643 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 14:24:39.866643 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:24:39.866643 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:24:39.866643 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 606/1230] 10.222.0.86 () {56 vars in 1111 bytes} [Tue Jun 7 14:24:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:24:39.872040 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48439904-a678-496c-9d5e-f13d507f834a None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:24:39.971177 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48439904-a678-496c-9d5e-f13d507f834a None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:24:40.004901 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ee0fb5-172e-4f6f-8927-3681f3196715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:24:40.005556 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ee0fb5-172e-4f6f-8927-3681f3196715 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:24:40.005841 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ee0fb5-172e-4f6f-8927-3681f3196715 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:24:40.006118 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ee0fb5-172e-4f6f-8927-3681f3196715 None admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:24:40.006901 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ee0fb5-172e-4f6f-8927-3681f3196715 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:24:40.007212 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ee0fb5-172e-4f6f-8927-3681f3196715 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:24:40.008704 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ee0fb5-172e-4f6f-8927-3681f3196715 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:24:40.020487 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 625/1231] 10.222.0.86 () {56 vars in 1148 bytes} [Tue Jun 7 14:24:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:24:40.026537 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0547bfdd-fa1a-49b0-8400-5e4ec96e1e13 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:24:40.090761 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:24:40.124002 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0547bfdd-fa1a-49b0-8400-5e4ec96e1e13 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:24:40.155665 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af36e29-f281-45ca-b357-09b69c05167e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:24:40.156605 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af36e29-f281-45ca-b357-09b69c05167e None admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:24:40.156891 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af36e29-f281-45ca-b357-09b69c05167e None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:24:40.157167 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af36e29-f281-45ca-b357-09b69c05167e None admin] PATH_INFO: `/v3/projects/e429537b190c4c5ea7e1332ab044ca7a/users/7e042f9d4a9345bb947e6a30f64a59ea/roles/28e9b75018ac44c0afe7ab728071f2d5` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:24:40.171997 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af36e29-f281-45ca-b357-09b69c05167e None admin] RBAC: Authorizing `identity:create_grant(project_id=e429537b190c4c5ea7e1332ab044ca7a, user_id=7e042f9d4a9345bb947e6a30f64a59ea, role_id=28e9b75018ac44c0afe7ab728071f2d5)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:24:40.173425 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af36e29-f281-45ca-b357-09b69c05167e None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:24:40.324998 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 607/1232] 10.222.0.86 () {58 vars in 1439 bytes} [Tue Jun 7 14:24:40 2022] PUT /identity/v3/projects/e429537b190c4c5ea7e1332ab044ca7a/users/7e042f9d4a9345bb947e6a30f64a59ea/roles/28e9b75018ac44c0afe7ab728071f2d5 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:24:42.547726 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce814b9-4059-489a-ad49-6c1cf306a283 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:24:42.548370 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce814b9-4059-489a-ad49-6c1cf306a283 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:24:42.548370 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce814b9-4059-489a-ad49-6c1cf306a283 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:24:42.549673 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 626/1233] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:24:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:24:42.554794 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb71fb82-ae1d-4252-9d72-21afddd48eb6 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:24:42.555199 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb71fb82-ae1d-4252-9d72-21afddd48eb6 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:24:42.555344 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb71fb82-ae1d-4252-9d72-21afddd48eb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:24:42.571122 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-cb71fb82-ae1d-4252-9d72-21afddd48eb6 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:24:42.572831 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-cb71fb82-ae1d-4252-9d72-21afddd48eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:24:42.638280 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 608/1234] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:24:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 14:24:42.661511 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce814b9-4059-489a-ad49-6c1cf306a283 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:24:42.686493 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:24:42.760023 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce814b9-4059-489a-ad49-6c1cf306a283 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:24:42.793684 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6f695e-0fac-45ad-a284-fa3663d1c1e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:24:42.794511 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6f695e-0fac-45ad-a284-fa3663d1c1e0 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:24:42.794781 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6f695e-0fac-45ad-a284-fa3663d1c1e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:24:42.795060 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6f695e-0fac-45ad-a284-fa3663d1c1e0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:24:42.809381 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6f695e-0fac-45ad-a284-fa3663d1c1e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:24:42.813238 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-9a6f695e-0fac-45ad-a284-fa3663d1c1e0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 07 14:24:42.813238 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:24:42.813238 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:24:42.813238 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:24:42.813238 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:24:42.813238 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:24:42.813238 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:24:42.813238 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:24:42.813238 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:24:42.813238 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:24:42.813238 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:24:42.813238 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:24:42.813238 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:24:42.813238 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:24:42.813238 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:24:42.813238 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:24:42.814559 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:24:42.814559 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:24:42.814559 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:24:42.814559 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:24:42.814559 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:24:42.814559 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:24:42.814559 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:24:42.814559 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:24:42.814559 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:24:42.814559 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:24:42.814559 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:24:42.814559 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jun 07 14:24:42.814559 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:24:42.814559 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:24:42.814559 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:24:42.814559 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:24:42.815743 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:24:42.815743 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:24:42.815743 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:24:42.815743 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:24:42.815743 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:24:42.815743 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:24:42.815743 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:24:42.815743 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:24:42.815743 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:24:42.815743 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:24:42.815743 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 07 14:24:42.815743 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:24:42.815743 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 627/1235] 10.222.0.86 () {56 vars in 1102 bytes} [Tue Jun 7 14:24:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:24:42.820569 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb71fb82-ae1d-4252-9d72-21afddd48eb6 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:24:42.866478 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:24:42.917621 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb71fb82-ae1d-4252-9d72-21afddd48eb6 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:24:42.950426 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b631fc37-147c-43ac-8c05-558fc1e53f82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:24:42.951137 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b631fc37-147c-43ac-8c05-558fc1e53f82 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:24:42.951634 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b631fc37-147c-43ac-8c05-558fc1e53f82 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:24:42.951945 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b631fc37-147c-43ac-8c05-558fc1e53f82 None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:24:42.953047 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b631fc37-147c-43ac-8c05-558fc1e53f82 None admin] RBAC: Adding query filter params (name=service) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:24:42.953410 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b631fc37-147c-43ac-8c05-558fc1e53f82 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:24:42.954770 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b631fc37-147c-43ac-8c05-558fc1e53f82 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:24:42.962962 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 609/1236] 10.222.0.86 () {56 vars in 1103 bytes} [Tue Jun 7 14:24:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:24:42.968872 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6f695e-0fac-45ad-a284-fa3663d1c1e0 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:24:43.051175 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:24:43.066837 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6f695e-0fac-45ad-a284-fa3663d1c1e0 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:24:43.100045 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a660c9dc-8c8f-462d-8934-cc53cb47202d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:24:43.100837 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a660c9dc-8c8f-462d-8934-cc53cb47202d None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:24:43.101114 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a660c9dc-8c8f-462d-8934-cc53cb47202d None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:24:43.101392 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a660c9dc-8c8f-462d-8934-cc53cb47202d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:24:43.111678 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a660c9dc-8c8f-462d-8934-cc53cb47202d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:24:43.113156 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a660c9dc-8c8f-462d-8934-cc53cb47202d None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:24:43.130828 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-a660c9dc-8c8f-462d-8934-cc53cb47202d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:24:43.130828 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:24:43.130828 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:24:43.130828 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:24:43.130828 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:24:43.130828 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:24:43.130828 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:24:43.130828 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:24:43.130828 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:24:43.130828 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:24:43.130828 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:24:43.130828 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:24:43.130828 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:24:43.130828 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:24:43.130828 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:24:43.131992 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:24:43.131992 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:24:43.131992 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:24:43.131992 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:24:43.131992 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:24:43.131992 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:24:43.131992 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:24:43.131992 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:24:43.131992 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jun 07 14:24:43.131992 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:24:43.131992 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:24:43.131992 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:24:43.131992 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:24:43.131992 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:24:43.131992 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:24:43.131992 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:24:43.131992 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:24:43.133155 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:24:43.133155 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:24:43.133155 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:24:43.133155 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:24:43.133155 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 628/1237] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jun 7 14:24:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:24:43.138113 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b631fc37-147c-43ac-8c05-558fc1e53f82 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:24:43.239866 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b631fc37-147c-43ac-8c05-558fc1e53f82 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:24:43.249550 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:24:43.273075 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61681e85-d353-4383-96eb-95c2745baa8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:24:43.273728 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61681e85-d353-4383-96eb-95c2745baa8e None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:24:43.274010 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61681e85-d353-4383-96eb-95c2745baa8e None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:24:43.274349 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61681e85-d353-4383-96eb-95c2745baa8e None admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:24:43.275073 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61681e85-d353-4383-96eb-95c2745baa8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:24:43.275382 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61681e85-d353-4383-96eb-95c2745baa8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:24:43.276767 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61681e85-d353-4383-96eb-95c2745baa8e None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:24:43.287839 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 610/1238] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jun 7 14:24:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:24:43.293993 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a660c9dc-8c8f-462d-8934-cc53cb47202d None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:24:43.393435 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a660c9dc-8c8f-462d-8934-cc53cb47202d None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:24:43.427545 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f677255-14ea-456f-ae19-b2aecf0f5d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:24:43.428365 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f677255-14ea-456f-ae19-b2aecf0f5d76 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:24:43.428646 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f677255-14ea-456f-ae19-b2aecf0f5d76 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:24:43.428957 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f677255-14ea-456f-ae19-b2aecf0f5d76 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:24:43.431610 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:24:43.436067 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f677255-14ea-456f-ae19-b2aecf0f5d76 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:24:43.437552 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f677255-14ea-456f-ae19-b2aecf0f5d76 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:24:43.451869 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-4f677255-14ea-456f-ae19-b2aecf0f5d76 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 07 14:24:43.451869 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:24:43.451869 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:24:43.451869 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:24:43.451869 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:24:43.451869 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:24:43.451869 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:24:43.451869 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:24:43.451869 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:24:43.451869 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:24:43.451869 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:24:43.451869 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:24:43.451869 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 14:24:43.451869 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 14:24:43.451869 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 14:24:43.451869 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 14:24:43.453004 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:24:43.453004 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:24:43.453004 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 14:24:43.453004 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:24:43.453004 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 14:24:43.453004 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:24:43.453004 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:24:43.453004 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:24:43.453004 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:24:43.453004 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:24:43.453004 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:24:43.453004 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jun 07 14:24:43.453004 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:24:43.453004 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:24:43.453004 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:24:43.453004 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:24:43.453004 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:24:43.453004 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:24:43.454230 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:24:43.454230 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:24:43.454230 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 14:24:43.454230 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 14:24:43.454230 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 14:24:43.454230 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 14:24:43.454230 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 14:24:43.454230 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 14:24:43.454230 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 07 14:24:43.454230 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:24:43.454230 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 629/1239] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jun 7 14:24:43 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:24:43.458991 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61681e85-d353-4383-96eb-95c2745baa8e None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:24:43.556360 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61681e85-d353-4383-96eb-95c2745baa8e None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:24:43.588905 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a64e1e-8ee1-4341-bbdd-da2ab96864e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:24:43.589582 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a64e1e-8ee1-4341-bbdd-da2ab96864e7 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:24:43.589844 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a64e1e-8ee1-4341-bbdd-da2ab96864e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:24:43.590117 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a64e1e-8ee1-4341-bbdd-da2ab96864e7 None admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:24:43.590948 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a64e1e-8ee1-4341-bbdd-da2ab96864e7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:24:43.591253 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a64e1e-8ee1-4341-bbdd-da2ab96864e7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:24:43.592716 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a64e1e-8ee1-4341-bbdd-da2ab96864e7 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:24:43.609751 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 611/1240] 10.222.0.86 () {56 vars in 1143 bytes} [Tue Jun 7 14:24:43 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:24:43.615511 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f677255-14ea-456f-ae19-b2aecf0f5d76 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:24:43.711706 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f677255-14ea-456f-ae19-b2aecf0f5d76 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:24:43.745323 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1094433e-255b-4f15-8eff-daff80bb3985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:24:43.745971 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1094433e-255b-4f15-8eff-daff80bb3985 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:24:43.746261 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1094433e-255b-4f15-8eff-daff80bb3985 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:24:43.746541 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1094433e-255b-4f15-8eff-daff80bb3985 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:24:43.808488 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:24:43.814772 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1094433e-255b-4f15-8eff-daff80bb3985 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:24:43.816249 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1094433e-255b-4f15-8eff-daff80bb3985 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:24:43.910099 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 630/1241] 10.222.0.86 () {58 vars in 1282 bytes} [Tue Jun 7 14:24:43 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 07 14:24:43.916030 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a64e1e-8ee1-4341-bbdd-da2ab96864e7 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:24:43.941939 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:24:44.008740 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a64e1e-8ee1-4341-bbdd-da2ab96864e7 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:24:44.041540 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619fb809-8a39-4f3d-92f1-1894cfb68ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:24:44.042518 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619fb809-8a39-4f3d-92f1-1894cfb68ae2 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:24:44.043430 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619fb809-8a39-4f3d-92f1-1894cfb68ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:24:44.043707 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619fb809-8a39-4f3d-92f1-1894cfb68ae2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:24:44.053738 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619fb809-8a39-4f3d-92f1-1894cfb68ae2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:24:44.055167 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619fb809-8a39-4f3d-92f1-1894cfb68ae2 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:24:44.072690 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-619fb809-8a39-4f3d-92f1-1894cfb68ae2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:24:44.072690 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:24:44.072690 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:24:44.072690 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:24:44.072690 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:24:44.072690 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:24:44.072690 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:24:44.072690 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:24:44.072690 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:24:44.072690 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:24:44.072690 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:24:44.072690 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:24:44.072690 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:24:44.072690 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:24:44.072690 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:24:44.073705 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:24:44.073705 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:24:44.073705 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:24:44.073705 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:24:44.073705 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:24:44.073705 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:24:44.073705 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:24:44.073705 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:24:44.073705 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jun 07 14:24:44.073705 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:24:44.073705 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:24:44.073705 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:24:44.073705 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:24:44.073705 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:24:44.073705 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:24:44.073705 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:24:44.073705 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:24:44.074827 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:24:44.074827 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:24:44.074827 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:24:44.074827 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:24:44.074827 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 612/1242] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jun 7 14:24:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:24:44.079621 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1094433e-255b-4f15-8eff-daff80bb3985 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:24:44.170922 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:24:44.176538 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1094433e-255b-4f15-8eff-daff80bb3985 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:24:44.210607 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d583c8e6-ead1-435e-b5b0-248d02a44f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:24:44.214391 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d583c8e6-ead1-435e-b5b0-248d02a44f9b None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:24:44.214391 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d583c8e6-ead1-435e-b5b0-248d02a44f9b None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:24:44.214391 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d583c8e6-ead1-435e-b5b0-248d02a44f9b None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:24:44.214391 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d583c8e6-ead1-435e-b5b0-248d02a44f9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:24:44.214391 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d583c8e6-ead1-435e-b5b0-248d02a44f9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:24:44.214391 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d583c8e6-ead1-435e-b5b0-248d02a44f9b None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:24:44.225316 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 631/1243] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jun 7 14:24:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:24:44.231153 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619fb809-8a39-4f3d-92f1-1894cfb68ae2 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:24:44.308657 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:24:44.330839 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619fb809-8a39-4f3d-92f1-1894cfb68ae2 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:24:44.363465 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80664ede-695b-4424-a414-532e18b0948d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:24:44.368263 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80664ede-695b-4424-a414-532e18b0948d None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:24:44.368263 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80664ede-695b-4424-a414-532e18b0948d None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:24:44.368263 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80664ede-695b-4424-a414-532e18b0948d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:24:44.371856 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80664ede-695b-4424-a414-532e18b0948d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:24:44.373329 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80664ede-695b-4424-a414-532e18b0948d None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:24:44.387585 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-80664ede-695b-4424-a414-532e18b0948d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:24:44.387585 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:24:44.387585 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:24:44.387585 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:24:44.387585 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:24:44.387585 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:24:44.387585 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:24:44.387585 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:24:44.387585 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:24:44.387585 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:24:44.387585 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:24:44.387585 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:24:44.387585 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 14:24:44.387585 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 14:24:44.387585 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 14:24:44.392431 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 14:24:44.392431 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:24:44.392431 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:24:44.392431 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:24:44.392431 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:24:44.392431 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:24:44.392431 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:24:44.392431 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:24:44.392431 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jun 07 14:24:44.392431 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:24:44.392431 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:24:44.392431 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:24:44.392431 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:24:44.392431 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:24:44.392431 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:24:44.392431 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:24:44.392431 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:24:44.393570 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 14:24:44.393570 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 14:24:44.393570 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 14:24:44.393570 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 14:24:44.393570 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 14:24:44.393570 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 14:24:44.393570 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:24:44.393570 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:24:44.393570 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 613/1244] 10.222.0.86 () {56 vars in 1111 bytes} [Tue Jun 7 14:24:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:24:44.395038 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d583c8e6-ead1-435e-b5b0-248d02a44f9b None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:24:44.493022 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d583c8e6-ead1-435e-b5b0-248d02a44f9b None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:24:44.525086 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c857cd-3be9-4ec0-af63-22505cce1a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:24:44.525735 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c857cd-3be9-4ec0-af63-22505cce1a18 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:24:44.526012 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c857cd-3be9-4ec0-af63-22505cce1a18 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:24:44.526281 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c857cd-3be9-4ec0-af63-22505cce1a18 None admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:24:44.527054 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c857cd-3be9-4ec0-af63-22505cce1a18 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:24:44.527357 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c857cd-3be9-4ec0-af63-22505cce1a18 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:24:44.528797 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c857cd-3be9-4ec0-af63-22505cce1a18 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:24:44.541363 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 632/1245] 10.222.0.86 () {56 vars in 1148 bytes} [Tue Jun 7 14:24:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:24:44.547240 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80664ede-695b-4424-a414-532e18b0948d None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:24:44.642659 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80664ede-695b-4424-a414-532e18b0948d None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:24:44.674895 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6611168c-a55e-427d-920f-e280376cd113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:24:44.675547 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6611168c-a55e-427d-920f-e280376cd113 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:24:44.675868 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6611168c-a55e-427d-920f-e280376cd113 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:24:44.676150 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6611168c-a55e-427d-920f-e280376cd113 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:24:44.676986 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6611168c-a55e-427d-920f-e280376cd113 None admin] RBAC: Adding query filter params (role.id=28e9b75018ac44c0afe7ab728071f2d5, scope.project.id=e429537b190c4c5ea7e1332ab044ca7a, user.id=7e042f9d4a9345bb947e6a30f64a59ea) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:24:44.677302 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6611168c-a55e-427d-920f-e280376cd113 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:24:44.678735 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6611168c-a55e-427d-920f-e280376cd113 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:24:44.684989 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 614/1246] 10.222.0.86 () {56 vars in 1374 bytes} [Tue Jun 7 14:24:44 2022] GET /identity/v3/role_assignments?user.id=7e042f9d4a9345bb947e6a30f64a59ea&scope.project.id=e429537b190c4c5ea7e1332ab044ca7a&role.id=28e9b75018ac44c0afe7ab728071f2d5 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:24:46.948022 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88f14dd-515f-427a-96c5-7ea2573f5d45 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:24:46.948555 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88f14dd-515f-427a-96c5-7ea2573f5d45 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:24:46.948555 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88f14dd-515f-427a-96c5-7ea2573f5d45 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:24:46.949940 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 633/1247] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:24:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:24:46.955490 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb96f00-f2bc-4ef6-ad22-95090beeff56 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:24:46.955951 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb96f00-f2bc-4ef6-ad22-95090beeff56 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:24:46.956081 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb96f00-f2bc-4ef6-ad22-95090beeff56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:24:46.961054 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:24:46.974261 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-ddb96f00-f2bc-4ef6-ad22-95090beeff56 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:24:46.978849 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-ddb96f00-f2bc-4ef6-ad22-95090beeff56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:24:47.040182 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 615/1248] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:24:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 14:24:47.063130 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88f14dd-515f-427a-96c5-7ea2573f5d45 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:24:47.081095 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:24:47.163391 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88f14dd-515f-427a-96c5-7ea2573f5d45 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:24:47.196798 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49f78d8-473d-49b3-bda7-51e50d87558c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:24:47.198254 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49f78d8-473d-49b3-bda7-51e50d87558c None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:24:47.198487 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49f78d8-473d-49b3-bda7-51e50d87558c None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:24:47.198760 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49f78d8-473d-49b3-bda7-51e50d87558c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:24:47.208993 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49f78d8-473d-49b3-bda7-51e50d87558c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:24:47.216685 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-d49f78d8-473d-49b3-bda7-51e50d87558c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 14:24:47.216685 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:24:47.216685 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:24:47.216685 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:24:47.216685 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:24:47.216685 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:24:47.216685 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:24:47.216685 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:24:47.216685 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:24:47.216685 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:24:47.216685 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:24:47.216685 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:24:47.216685 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:24:47.216685 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:24:47.216685 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:24:47.216685 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:24:47.217664 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:24:47.217664 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:24:47.217664 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:24:47.217664 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:24:47.217664 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:24:47.217664 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:24:47.217664 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:24:47.217664 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:24:47.217664 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:24:47.217664 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:24:47.217664 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:24:47.217664 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jun 07 14:24:47.217664 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:24:47.217664 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:24:47.217664 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:24:47.217664 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:24:47.218613 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:24:47.218613 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:24:47.218613 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:24:47.218613 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:24:47.218613 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:24:47.218613 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:24:47.218613 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:24:47.218613 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:24:47.218613 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:24:47.218613 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:24:47.218613 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 14:24:47.218613 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:24:47.218613 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 634/1249] 10.222.0.86 () {56 vars in 1096 bytes} [Tue Jun 7 14:24:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:24:47.223853 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb96f00-f2bc-4ef6-ad22-95090beeff56 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:24:47.320556 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb96f00-f2bc-4ef6-ad22-95090beeff56 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:24:47.349579 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:24:47.354395 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e79ab1c-e8d0-47c3-994b-28f5131cef47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:24:47.355055 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e79ab1c-e8d0-47c3-994b-28f5131cef47 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:24:47.355341 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e79ab1c-e8d0-47c3-994b-28f5131cef47 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:24:47.355619 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e79ab1c-e8d0-47c3-994b-28f5131cef47 None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:24:47.356394 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e79ab1c-e8d0-47c3-994b-28f5131cef47 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:24:47.356701 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e79ab1c-e8d0-47c3-994b-28f5131cef47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:24:47.358060 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e79ab1c-e8d0-47c3-994b-28f5131cef47 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:24:47.366169 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 616/1250] 10.222.0.86 () {56 vars in 1099 bytes} [Tue Jun 7 14:24:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:24:47.372317 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49f78d8-473d-49b3-bda7-51e50d87558c None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:24:47.446794 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:24:47.468878 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49f78d8-473d-49b3-bda7-51e50d87558c None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:24:47.500843 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc25a11-077f-46c3-b0ca-674e34dc515e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:24:47.501609 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc25a11-077f-46c3-b0ca-674e34dc515e None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:24:47.501890 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc25a11-077f-46c3-b0ca-674e34dc515e None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:24:47.502164 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc25a11-077f-46c3-b0ca-674e34dc515e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:24:47.512175 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc25a11-077f-46c3-b0ca-674e34dc515e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:24:47.513606 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc25a11-077f-46c3-b0ca-674e34dc515e None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:24:47.530128 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-3dc25a11-077f-46c3-b0ca-674e34dc515e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:24:47.530128 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:24:47.530128 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:24:47.530128 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:24:47.530128 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:24:47.530128 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:24:47.530128 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:24:47.530128 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:24:47.530128 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:24:47.530128 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:24:47.530128 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:24:47.530128 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:24:47.530128 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:24:47.530128 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:24:47.530128 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:24:47.533275 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:24:47.533275 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:24:47.533275 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:24:47.533275 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:24:47.533275 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:24:47.533275 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:24:47.533275 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:24:47.533275 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:24:47.533275 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jun 07 14:24:47.533275 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:24:47.533275 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:24:47.533275 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:24:47.533275 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:24:47.533275 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:24:47.533275 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:24:47.533275 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:24:47.533275 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:24:47.534444 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:24:47.534444 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:24:47.534444 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:24:47.534444 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:24:47.534444 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 635/1251] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jun 7 14:24:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:24:47.537312 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e79ab1c-e8d0-47c3-994b-28f5131cef47 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:24:47.635238 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e79ab1c-e8d0-47c3-994b-28f5131cef47 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:24:47.667266 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc570e41-219a-470a-9d40-68d95daf68be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:24:47.667939 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc570e41-219a-470a-9d40-68d95daf68be None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:24:47.668222 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc570e41-219a-470a-9d40-68d95daf68be None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:24:47.668496 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc570e41-219a-470a-9d40-68d95daf68be None admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:24:47.669242 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc570e41-219a-470a-9d40-68d95daf68be None admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:24:47.669549 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc570e41-219a-470a-9d40-68d95daf68be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:24:47.670902 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc570e41-219a-470a-9d40-68d95daf68be None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:24:47.682865 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 617/1252] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jun 7 14:24:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:24:47.688477 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc25a11-077f-46c3-b0ca-674e34dc515e None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:24:47.786459 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc25a11-077f-46c3-b0ca-674e34dc515e None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:24:47.812159 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:24:47.819871 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4286d5d2-f43c-49af-a7c1-a02e8bf34782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:24:47.820666 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4286d5d2-f43c-49af-a7c1-a02e8bf34782 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:24:47.820950 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4286d5d2-f43c-49af-a7c1-a02e8bf34782 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:24:47.821226 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4286d5d2-f43c-49af-a7c1-a02e8bf34782 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:24:47.828373 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4286d5d2-f43c-49af-a7c1-a02e8bf34782 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:24:47.829843 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4286d5d2-f43c-49af-a7c1-a02e8bf34782 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:24:47.844340 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-4286d5d2-f43c-49af-a7c1-a02e8bf34782 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 07 14:24:47.844340 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:24:47.844340 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:24:47.844340 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:24:47.844340 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:24:47.844340 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:24:47.844340 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:24:47.844340 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:24:47.844340 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:24:47.844340 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:24:47.844340 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:24:47.844340 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:24:47.844340 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 14:24:47.844340 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 14:24:47.844340 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 14:24:47.844340 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 14:24:47.845443 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:24:47.845443 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:24:47.845443 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 14:24:47.845443 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:24:47.845443 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 14:24:47.845443 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:24:47.845443 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:24:47.845443 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:24:47.845443 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:24:47.845443 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:24:47.845443 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:24:47.845443 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jun 07 14:24:47.845443 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:24:47.845443 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:24:47.845443 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:24:47.845443 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:24:47.845443 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:24:47.845443 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:24:47.846372 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:24:47.846372 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:24:47.846372 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 14:24:47.846372 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 14:24:47.846372 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 14:24:47.846372 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 14:24:47.846372 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 14:24:47.846372 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 14:24:47.846372 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 07 14:24:47.846372 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:24:47.846372 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 636/1253] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jun 7 14:24:47 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:24:47.851302 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc570e41-219a-470a-9d40-68d95daf68be None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:24:47.908212 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:24:47.952057 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc570e41-219a-470a-9d40-68d95daf68be None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:24:47.985763 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f04c8dc-2206-46ba-a8dd-eacccd6e6283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:24:47.986432 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f04c8dc-2206-46ba-a8dd-eacccd6e6283 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:24:47.986717 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f04c8dc-2206-46ba-a8dd-eacccd6e6283 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:24:47.986995 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f04c8dc-2206-46ba-a8dd-eacccd6e6283 None admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:24:47.987892 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f04c8dc-2206-46ba-a8dd-eacccd6e6283 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:24:47.988233 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f04c8dc-2206-46ba-a8dd-eacccd6e6283 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:24:47.989664 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f04c8dc-2206-46ba-a8dd-eacccd6e6283 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:24:48.006244 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 618/1254] 10.222.0.86 () {56 vars in 1143 bytes} [Tue Jun 7 14:24:47 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:24:48.012059 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4286d5d2-f43c-49af-a7c1-a02e8bf34782 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:24:48.111532 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4286d5d2-f43c-49af-a7c1-a02e8bf34782 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:24:48.144194 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15f1225-f69a-4a55-8baa-0719de06cdb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:24:48.144840 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15f1225-f69a-4a55-8baa-0719de06cdb4 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:24:48.145124 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15f1225-f69a-4a55-8baa-0719de06cdb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:24:48.145397 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15f1225-f69a-4a55-8baa-0719de06cdb4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:24:48.199314 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:24:48.211419 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15f1225-f69a-4a55-8baa-0719de06cdb4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:24:48.213415 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15f1225-f69a-4a55-8baa-0719de06cdb4 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:24:48.311064 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 637/1255] 10.222.0.86 () {58 vars in 1282 bytes} [Tue Jun 7 14:24:48 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 07 14:24:48.316933 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f04c8dc-2206-46ba-a8dd-eacccd6e6283 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:24:48.414118 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f04c8dc-2206-46ba-a8dd-eacccd6e6283 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:24:48.427366 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:24:48.448172 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5ddb58-5f8b-4bde-b203-551ea9b13943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:24:48.448956 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ddb58-5f8b-4bde-b203-551ea9b13943 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:24:48.449244 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ddb58-5f8b-4bde-b203-551ea9b13943 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:24:48.449523 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ddb58-5f8b-4bde-b203-551ea9b13943 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:24:48.459146 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5ddb58-5f8b-4bde-b203-551ea9b13943 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:24:48.460671 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5ddb58-5f8b-4bde-b203-551ea9b13943 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:24:48.478875 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-7e5ddb58-5f8b-4bde-b203-551ea9b13943 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:24:48.478875 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:24:48.478875 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:24:48.478875 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:24:48.478875 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:24:48.478875 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:24:48.478875 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:24:48.478875 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:24:48.478875 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:24:48.478875 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:24:48.478875 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:24:48.478875 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:24:48.478875 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:24:48.478875 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:24:48.478875 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:24:48.479991 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:24:48.479991 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:24:48.479991 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:24:48.479991 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:24:48.479991 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:24:48.479991 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:24:48.479991 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:24:48.479991 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:24:48.479991 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jun 07 14:24:48.479991 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:24:48.479991 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:24:48.479991 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:24:48.479991 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:24:48.479991 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:24:48.479991 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:24:48.479991 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:24:48.479991 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:24:48.481117 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:24:48.481117 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:24:48.481117 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:24:48.481117 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:24:48.481117 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 619/1256] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jun 7 14:24:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:24:48.485691 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15f1225-f69a-4a55-8baa-0719de06cdb4 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:24:48.572780 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:24:48.584316 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15f1225-f69a-4a55-8baa-0719de06cdb4 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:24:48.617212 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29f0d71-432b-4ea9-9544-28f5c63b9dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:24:48.617896 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29f0d71-432b-4ea9-9544-28f5c63b9dba None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:24:48.618182 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29f0d71-432b-4ea9-9544-28f5c63b9dba None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:24:48.618462 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29f0d71-432b-4ea9-9544-28f5c63b9dba None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:24:48.619692 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29f0d71-432b-4ea9-9544-28f5c63b9dba None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:24:48.620029 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29f0d71-432b-4ea9-9544-28f5c63b9dba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:24:48.621391 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29f0d71-432b-4ea9-9544-28f5c63b9dba None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:24:48.632342 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 638/1257] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jun 7 14:24:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:24:48.638488 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5ddb58-5f8b-4bde-b203-551ea9b13943 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:24:48.735156 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5ddb58-5f8b-4bde-b203-551ea9b13943 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:24:48.768925 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c162ed16-1d84-424a-8b23-0c53757024c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:24:48.769697 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c162ed16-1d84-424a-8b23-0c53757024c4 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:24:48.769981 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c162ed16-1d84-424a-8b23-0c53757024c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:24:48.770257 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c162ed16-1d84-424a-8b23-0c53757024c4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:24:48.776706 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c162ed16-1d84-424a-8b23-0c53757024c4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:24:48.778135 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c162ed16-1d84-424a-8b23-0c53757024c4 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:24:48.791846 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-c162ed16-1d84-424a-8b23-0c53757024c4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:24:48.791846 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:24:48.791846 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:24:48.791846 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:24:48.791846 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:24:48.791846 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:24:48.791846 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:24:48.791846 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:24:48.791846 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:24:48.791846 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:24:48.791846 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:24:48.791846 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:24:48.791846 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 14:24:48.791846 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 14:24:48.791846 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 14:24:48.792932 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 14:24:48.792932 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:24:48.792932 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:24:48.792932 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:24:48.792932 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:24:48.792932 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:24:48.792932 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:24:48.792932 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:24:48.792932 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jun 07 14:24:48.792932 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:24:48.792932 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:24:48.792932 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:24:48.792932 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:24:48.792932 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:24:48.792932 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:24:48.792932 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:24:48.792932 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:24:48.794022 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 14:24:48.794022 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 14:24:48.794022 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 14:24:48.794022 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 14:24:48.794022 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 14:24:48.794022 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 14:24:48.794022 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:24:48.794022 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:24:48.794022 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 620/1258] 10.222.0.86 () {56 vars in 1111 bytes} [Tue Jun 7 14:24:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 14:24:48.798748 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29f0d71-432b-4ea9-9544-28f5c63b9dba None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:24:48.896562 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29f0d71-432b-4ea9-9544-28f5c63b9dba None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:24:48.929651 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0904eb5a-d837-445e-873f-8fc4d3481f7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:24:48.930295 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0904eb5a-d837-445e-873f-8fc4d3481f7d None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:24:48.930574 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0904eb5a-d837-445e-873f-8fc4d3481f7d None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:24:48.930843 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0904eb5a-d837-445e-873f-8fc4d3481f7d None admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:24:48.931637 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0904eb5a-d837-445e-873f-8fc4d3481f7d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:24:48.931997 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0904eb5a-d837-445e-873f-8fc4d3481f7d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:24:48.933399 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0904eb5a-d837-445e-873f-8fc4d3481f7d None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:24:48.944935 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 639/1259] 10.222.0.86 () {56 vars in 1148 bytes} [Tue Jun 7 14:24:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:24:48.951042 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c162ed16-1d84-424a-8b23-0c53757024c4 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:24:48.976461 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:24:49.047499 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c162ed16-1d84-424a-8b23-0c53757024c4 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:24:49.080494 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b41fb6a-cc5f-45d4-be2d-014498a5fcc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:24:49.081158 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b41fb6a-cc5f-45d4-be2d-014498a5fcc1 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:24:49.081445 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b41fb6a-cc5f-45d4-be2d-014498a5fcc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:24:49.081720 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b41fb6a-cc5f-45d4-be2d-014498a5fcc1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:24:49.082542 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b41fb6a-cc5f-45d4-be2d-014498a5fcc1 None admin] RBAC: Adding query filter params (role.id=e3bf6239f5bf477b965704b086786f11, scope.project.id=e429537b190c4c5ea7e1332ab044ca7a, user.id=7e042f9d4a9345bb947e6a30f64a59ea) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:24:49.082853 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b41fb6a-cc5f-45d4-be2d-014498a5fcc1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:24:49.084297 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b41fb6a-cc5f-45d4-be2d-014498a5fcc1 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:24:49.090188 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 621/1260] 10.222.0.86 () {56 vars in 1374 bytes} [Tue Jun 7 14:24:48 2022] GET /identity/v3/role_assignments?user.id=7e042f9d4a9345bb947e6a30f64a59ea&scope.project.id=e429537b190c4c5ea7e1332ab044ca7a&role.id=e3bf6239f5bf477b965704b086786f11 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:24:51.326897 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9538e946-9611-4015-a51c-bb2ee70e2ae6 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:24:51.327417 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9538e946-9611-4015-a51c-bb2ee70e2ae6 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:24:51.327532 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9538e946-9611-4015-a51c-bb2ee70e2ae6 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:24:51.328940 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 640/1261] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:24:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:24:51.334162 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28a0642-d296-4bb5-b1a1-589005f5a739 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:24:51.334604 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28a0642-d296-4bb5-b1a1-589005f5a739 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:24:51.334723 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28a0642-d296-4bb5-b1a1-589005f5a739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:24:51.351374 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-f28a0642-d296-4bb5-b1a1-589005f5a739 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:24:51.352629 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-f28a0642-d296-4bb5-b1a1-589005f5a739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:24:51.420239 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 622/1262] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:24:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 14:24:51.443116 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9538e946-9611-4015-a51c-bb2ee70e2ae6 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:24:51.453790 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:24:51.541341 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9538e946-9611-4015-a51c-bb2ee70e2ae6 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:24:51.575209 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f87f00-0822-4a68-be81-2e4efd58bfa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:24:51.576024 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f87f00-0822-4a68-be81-2e4efd58bfa9 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:24:51.576312 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f87f00-0822-4a68-be81-2e4efd58bfa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:24:51.576587 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f87f00-0822-4a68-be81-2e4efd58bfa9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:24:51.586463 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f87f00-0822-4a68-be81-2e4efd58bfa9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:24:51.594695 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-66f87f00-0822-4a68-be81-2e4efd58bfa9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 14:24:51.594695 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:24:51.594695 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:24:51.594695 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:24:51.594695 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:24:51.594695 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:24:51.594695 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:24:51.594695 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:24:51.594695 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:24:51.594695 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:24:51.594695 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:24:51.594695 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:24:51.594695 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:24:51.594695 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:24:51.594695 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:24:51.594695 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:24:51.595859 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:24:51.595859 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:24:51.595859 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:24:51.595859 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:24:51.595859 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:24:51.595859 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:24:51.595859 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:24:51.595859 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:24:51.595859 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:24:51.595859 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:24:51.595859 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:24:51.595859 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jun 07 14:24:51.595859 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:24:51.595859 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:24:51.595859 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:24:51.595859 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:24:51.596887 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:24:51.596887 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:24:51.596887 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:24:51.596887 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:24:51.596887 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:24:51.596887 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:24:51.596887 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:24:51.596887 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:24:51.596887 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:24:51.596887 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:24:51.596887 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 14:24:51.596887 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:24:51.596887 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 641/1263] 10.222.0.86 () {56 vars in 1096 bytes} [Tue Jun 7 14:24:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:24:51.601873 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28a0642-d296-4bb5-b1a1-589005f5a739 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:24:51.620488 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:24:51.701704 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28a0642-d296-4bb5-b1a1-589005f5a739 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:24:51.735874 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e204fdfa-d674-4255-a051-bb0479e4dced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:24:51.736540 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e204fdfa-d674-4255-a051-bb0479e4dced None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:24:51.736828 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e204fdfa-d674-4255-a051-bb0479e4dced None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:24:51.737108 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e204fdfa-d674-4255-a051-bb0479e4dced None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:24:51.737858 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e204fdfa-d674-4255-a051-bb0479e4dced None admin] RBAC: Adding query filter params (name=admin) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:24:51.738169 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e204fdfa-d674-4255-a051-bb0479e4dced None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:24:51.739587 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e204fdfa-d674-4255-a051-bb0479e4dced None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:24:51.748044 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 623/1264] 10.222.0.86 () {56 vars in 1099 bytes} [Tue Jun 7 14:24:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:24:51.754051 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f87f00-0822-4a68-be81-2e4efd58bfa9 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:24:51.818664 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:24:51.852809 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f87f00-0822-4a68-be81-2e4efd58bfa9 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:24:51.885826 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6c3861-798a-4db8-933c-ae9398ed7b0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:24:51.886612 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6c3861-798a-4db8-933c-ae9398ed7b0d None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:24:51.886892 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6c3861-798a-4db8-933c-ae9398ed7b0d None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:24:51.887163 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6c3861-798a-4db8-933c-ae9398ed7b0d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:24:52.022982 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6c3861-798a-4db8-933c-ae9398ed7b0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:24:52.024488 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6c3861-798a-4db8-933c-ae9398ed7b0d None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:24:52.042342 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-4d6c3861-798a-4db8-933c-ae9398ed7b0d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:24:52.042342 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:24:52.042342 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:24:52.042342 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:24:52.042342 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:24:52.042342 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:24:52.042342 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:24:52.042342 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:24:52.042342 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:24:52.042342 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:24:52.042342 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:24:52.042342 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:24:52.042342 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:24:52.042342 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:24:52.042342 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:24:52.044197 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:24:52.044197 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:24:52.044197 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:24:52.044197 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:24:52.044197 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:24:52.044197 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:24:52.044197 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:24:52.044197 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:24:52.044197 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jun 07 14:24:52.044197 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:24:52.044197 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:24:52.044197 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:24:52.044197 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:24:52.044197 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:24:52.044197 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:24:52.044197 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:24:52.044197 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:24:52.045131 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:24:52.045131 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:24:52.045131 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:24:52.045131 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:24:52.045131 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 642/1265] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jun 7 14:24:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:24:52.049643 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e204fdfa-d674-4255-a051-bb0479e4dced None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:24:52.128869 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:24:52.147678 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e204fdfa-d674-4255-a051-bb0479e4dced None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:24:52.180324 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dead2e96-e949-4425-a473-8b7fe19573f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:24:52.180976 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dead2e96-e949-4425-a473-8b7fe19573f2 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:24:52.181264 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dead2e96-e949-4425-a473-8b7fe19573f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:24:52.181548 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dead2e96-e949-4425-a473-8b7fe19573f2 None admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:24:52.182265 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dead2e96-e949-4425-a473-8b7fe19573f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:24:52.182579 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dead2e96-e949-4425-a473-8b7fe19573f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:24:52.184664 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dead2e96-e949-4425-a473-8b7fe19573f2 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:24:52.195874 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 624/1266] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jun 7 14:24:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:24:52.202211 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6c3861-798a-4db8-933c-ae9398ed7b0d None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:24:52.299640 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6c3861-798a-4db8-933c-ae9398ed7b0d None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:24:52.319284 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:24:52.333140 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b38eb37-13b0-4e22-9999-0bb816235529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:24:52.333925 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b38eb37-13b0-4e22-9999-0bb816235529 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:24:52.334250 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b38eb37-13b0-4e22-9999-0bb816235529 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:24:52.334524 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b38eb37-13b0-4e22-9999-0bb816235529 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:24:52.341913 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b38eb37-13b0-4e22-9999-0bb816235529 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:24:52.343319 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b38eb37-13b0-4e22-9999-0bb816235529 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:24:52.357928 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-0b38eb37-13b0-4e22-9999-0bb816235529 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 07 14:24:52.357928 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:24:52.357928 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:24:52.357928 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:24:52.357928 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:24:52.357928 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:24:52.357928 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:24:52.357928 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:24:52.357928 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:24:52.357928 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:24:52.357928 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:24:52.357928 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:24:52.357928 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 14:24:52.357928 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 14:24:52.357928 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 14:24:52.357928 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 14:24:52.359039 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:24:52.359039 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:24:52.359039 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 14:24:52.359039 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:24:52.359039 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 14:24:52.359039 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:24:52.359039 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:24:52.359039 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:24:52.359039 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:24:52.359039 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:24:52.359039 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:24:52.359039 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jun 07 14:24:52.359039 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:24:52.359039 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:24:52.359039 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:24:52.359039 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:24:52.359039 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:24:52.359039 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:24:52.360050 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:24:52.360050 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:24:52.360050 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 14:24:52.360050 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 14:24:52.360050 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 14:24:52.360050 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 14:24:52.360050 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 14:24:52.360050 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 14:24:52.360050 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 07 14:24:52.360050 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:24:52.360050 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 643/1267] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jun 7 14:24:52 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 14:24:52.364840 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dead2e96-e949-4425-a473-8b7fe19573f2 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:24:52.461876 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dead2e96-e949-4425-a473-8b7fe19573f2 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:24:52.495259 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3e42b1-e098-4896-a670-e2fe45a296c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:24:52.495954 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3e42b1-e098-4896-a670-e2fe45a296c8 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:24:52.496242 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3e42b1-e098-4896-a670-e2fe45a296c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:24:52.496517 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3e42b1-e098-4896-a670-e2fe45a296c8 None admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:24:52.497350 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3e42b1-e098-4896-a670-e2fe45a296c8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:24:52.497660 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3e42b1-e098-4896-a670-e2fe45a296c8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:24:52.499119 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3e42b1-e098-4896-a670-e2fe45a296c8 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:24:52.507521 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:24:52.515684 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 625/1268] 10.222.0.86 () {56 vars in 1143 bytes} [Tue Jun 7 14:24:52 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:24:52.521438 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b38eb37-13b0-4e22-9999-0bb816235529 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:24:52.621311 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b38eb37-13b0-4e22-9999-0bb816235529 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:24:52.654126 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcf00b6-f2ce-4ef0-ab55-69e4c947a83b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:24:52.654905 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcf00b6-f2ce-4ef0-ab55-69e4c947a83b None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:24:52.655193 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcf00b6-f2ce-4ef0-ab55-69e4c947a83b None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:24:52.655469 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcf00b6-f2ce-4ef0-ab55-69e4c947a83b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:24:52.665932 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcf00b6-f2ce-4ef0-ab55-69e4c947a83b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:24:52.667353 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcf00b6-f2ce-4ef0-ab55-69e4c947a83b None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:24:52.685054 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-6dcf00b6-f2ce-4ef0-ab55-69e4c947a83b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:24:52.685054 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:24:52.685054 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:24:52.685054 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:24:52.685054 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:24:52.685054 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:24:52.685054 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:24:52.685054 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:24:52.685054 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:24:52.685054 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:24:52.685054 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:24:52.685054 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:24:52.685054 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:24:52.685054 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:24:52.685054 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:24:52.686100 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:24:52.686100 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:24:52.686100 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:24:52.686100 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:24:52.686100 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:24:52.686100 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:24:52.686100 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:24:52.686100 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:24:52.686100 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jun 07 14:24:52.686100 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:24:52.686100 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:24:52.686100 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:24:52.686100 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:24:52.686100 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:24:52.686100 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:24:52.686100 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:24:52.686100 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:24:52.687027 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:24:52.687027 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:24:52.687027 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:24:52.687027 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:24:52.687027 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 644/1269] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jun 7 14:24:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:24:52.692265 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3e42b1-e098-4896-a670-e2fe45a296c8 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:24:52.790396 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3e42b1-e098-4896-a670-e2fe45a296c8 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:24:52.823747 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4612ffff-aba8-48ec-89de-9ced7e264f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:24:52.824427 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4612ffff-aba8-48ec-89de-9ced7e264f89 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:24:52.824710 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4612ffff-aba8-48ec-89de-9ced7e264f89 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:24:52.824987 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4612ffff-aba8-48ec-89de-9ced7e264f89 None admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:24:52.825707 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4612ffff-aba8-48ec-89de-9ced7e264f89 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:24:52.826026 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4612ffff-aba8-48ec-89de-9ced7e264f89 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:24:52.827368 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4612ffff-aba8-48ec-89de-9ced7e264f89 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:24:52.838235 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 626/1270] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jun 7 14:24:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:24:52.843851 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcf00b6-f2ce-4ef0-ab55-69e4c947a83b None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:24:52.875708 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:24:52.941193 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcf00b6-f2ce-4ef0-ab55-69e4c947a83b None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:24:52.973828 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6857441-2490-4435-be53-81e58f2bef66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:24:52.974613 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6857441-2490-4435-be53-81e58f2bef66 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:24:52.974896 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6857441-2490-4435-be53-81e58f2bef66 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:24:52.975171 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6857441-2490-4435-be53-81e58f2bef66 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:24:52.982140 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6857441-2490-4435-be53-81e58f2bef66 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:24:52.983884 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6857441-2490-4435-be53-81e58f2bef66 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:24:52.998330 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-d6857441-2490-4435-be53-81e58f2bef66 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:24:52.998330 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:24:52.998330 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:24:52.998330 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:24:52.998330 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:24:52.998330 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:24:52.998330 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:24:52.998330 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:24:52.998330 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:24:52.998330 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:24:52.998330 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:24:52.998330 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:24:52.998330 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 14:24:52.998330 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 14:24:52.998330 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 14:24:52.999356 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 14:24:52.999356 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:24:52.999356 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:24:52.999356 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:24:52.999356 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:24:52.999356 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:24:52.999356 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:24:52.999356 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:24:52.999356 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jun 07 14:24:52.999356 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:24:52.999356 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:24:52.999356 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:24:52.999356 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:24:52.999356 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:24:52.999356 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:24:52.999356 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:24:52.999356 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:24:53.000430 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 14:24:53.000430 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 14:24:53.000430 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 14:24:53.000430 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 14:24:53.000430 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 14:24:53.000430 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 14:24:53.000430 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:24:53.000430 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:24:53.000430 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 645/1271] 10.222.0.86 () {56 vars in 1111 bytes} [Tue Jun 7 14:24:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:24:53.005255 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4612ffff-aba8-48ec-89de-9ced7e264f89 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:24:53.062102 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:24:53.101234 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4612ffff-aba8-48ec-89de-9ced7e264f89 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:24:53.134080 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dd9701-e85e-465a-a2fc-76a666bb4a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:24:53.134730 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dd9701-e85e-465a-a2fc-76a666bb4a59 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:24:53.137695 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dd9701-e85e-465a-a2fc-76a666bb4a59 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:24:53.137695 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dd9701-e85e-465a-a2fc-76a666bb4a59 None admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:24:53.137695 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dd9701-e85e-465a-a2fc-76a666bb4a59 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:24:53.137695 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dd9701-e85e-465a-a2fc-76a666bb4a59 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:24:53.138004 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dd9701-e85e-465a-a2fc-76a666bb4a59 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:24:53.149513 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 627/1272] 10.222.0.86 () {56 vars in 1148 bytes} [Tue Jun 7 14:24:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:24:53.156001 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6857441-2490-4435-be53-81e58f2bef66 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:24:53.246612 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:24:53.255148 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6857441-2490-4435-be53-81e58f2bef66 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:24:53.287630 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c8d948-4ad4-47ad-a475-42b4040128ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:24:53.288668 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c8d948-4ad4-47ad-a475-42b4040128ed None admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:24:53.288953 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c8d948-4ad4-47ad-a475-42b4040128ed None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:24:53.289228 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c8d948-4ad4-47ad-a475-42b4040128ed None admin] PATH_INFO: `/v3/projects/e429537b190c4c5ea7e1332ab044ca7a/users/7e042f9d4a9345bb947e6a30f64a59ea/roles/e3bf6239f5bf477b965704b086786f11` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:24:53.291133 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c8d948-4ad4-47ad-a475-42b4040128ed None admin] RBAC: Authorizing `identity:create_grant(project_id=e429537b190c4c5ea7e1332ab044ca7a, user_id=7e042f9d4a9345bb947e6a30f64a59ea, role_id=e3bf6239f5bf477b965704b086786f11)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:24:53.293189 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c8d948-4ad4-47ad-a475-42b4040128ed None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:24:53.403780 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 646/1273] 10.222.0.86 () {58 vars in 1439 bytes} [Tue Jun 7 14:24:53 2022] PUT /identity/v3/projects/e429537b190c4c5ea7e1332ab044ca7a/users/7e042f9d4a9345bb947e6a30f64a59ea/roles/e3bf6239f5bf477b965704b086786f11 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:24:55.603335 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57852f30-95a0-4838-a9a6-521b715287de None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:24:55.603888 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57852f30-95a0-4838-a9a6-521b715287de None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:24:55.603980 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57852f30-95a0-4838-a9a6-521b715287de None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:24:55.605878 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 628/1274] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:24:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:24:55.611358 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb168d8-779c-4a4f-ad10-ffe317221ff6 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:24:55.611735 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb168d8-779c-4a4f-ad10-ffe317221ff6 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:24:55.611952 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb168d8-779c-4a4f-ad10-ffe317221ff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:24:55.628587 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-afb168d8-779c-4a4f-ad10-ffe317221ff6 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:24:55.629759 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-afb168d8-779c-4a4f-ad10-ffe317221ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:24:55.695036 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 647/1275] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:24:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 14:24:55.719733 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57852f30-95a0-4838-a9a6-521b715287de None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:24:55.819783 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57852f30-95a0-4838-a9a6-521b715287de None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:24:55.836940 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:24:55.854186 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd77802-3b60-449b-9377-16ee5d42b957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:24:55.854915 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd77802-3b60-449b-9377-16ee5d42b957 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:24:55.855712 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd77802-3b60-449b-9377-16ee5d42b957 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:24:55.856018 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd77802-3b60-449b-9377-16ee5d42b957 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:24:55.865841 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd77802-3b60-449b-9377-16ee5d42b957 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:24:55.874226 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-efd77802-3b60-449b-9377-16ee5d42b957 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 14:24:55.874226 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:24:55.874226 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:24:55.874226 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:24:55.874226 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:24:55.874226 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:24:55.874226 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:24:55.874226 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:24:55.874226 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:24:55.874226 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:24:55.874226 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:24:55.874226 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:24:55.874226 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:24:55.874226 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:24:55.874226 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:24:55.874226 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:24:55.876894 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:24:55.876894 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:24:55.876894 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:24:55.876894 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:24:55.876894 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:24:55.876894 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:24:55.876894 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:24:55.876894 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:24:55.876894 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:24:55.876894 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:24:55.876894 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:24:55.876894 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jun 07 14:24:55.876894 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:24:55.876894 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:24:55.876894 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:24:55.876894 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:24:55.877965 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:24:55.877965 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:24:55.877965 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:24:55.877965 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:24:55.877965 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:24:55.877965 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:24:55.877965 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:24:55.877965 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:24:55.877965 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:24:55.877965 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:24:55.877965 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 14:24:55.877965 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:24:55.877965 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 629/1276] 10.222.0.86 () {56 vars in 1096 bytes} [Tue Jun 7 14:24:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:24:55.881755 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb168d8-779c-4a4f-ad10-ffe317221ff6 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:24:55.964385 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:24:55.981735 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb168d8-779c-4a4f-ad10-ffe317221ff6 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:24:56.013337 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c9913d-7cbd-4c43-a9ed-5e341b7bf57d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:24:56.013991 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c9913d-7cbd-4c43-a9ed-5e341b7bf57d None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:24:56.014278 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c9913d-7cbd-4c43-a9ed-5e341b7bf57d None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:24:56.014551 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c9913d-7cbd-4c43-a9ed-5e341b7bf57d None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:24:56.015289 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c9913d-7cbd-4c43-a9ed-5e341b7bf57d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:24:56.015597 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c9913d-7cbd-4c43-a9ed-5e341b7bf57d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:24:56.016975 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c9913d-7cbd-4c43-a9ed-5e341b7bf57d None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:24:56.024678 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 648/1277] 10.222.0.86 () {56 vars in 1099 bytes} [Tue Jun 7 14:24:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:24:56.031090 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd77802-3b60-449b-9377-16ee5d42b957 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:24:56.128034 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd77802-3b60-449b-9377-16ee5d42b957 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:24:56.160951 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741bfbbd-d6f9-4497-bf94-54cb23cce7c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:24:56.161732 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741bfbbd-d6f9-4497-bf94-54cb23cce7c6 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:24:56.162017 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741bfbbd-d6f9-4497-bf94-54cb23cce7c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:24:56.162296 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741bfbbd-d6f9-4497-bf94-54cb23cce7c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:24:56.177176 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741bfbbd-d6f9-4497-bf94-54cb23cce7c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:24:56.178604 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741bfbbd-d6f9-4497-bf94-54cb23cce7c6 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:24:56.195577 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-741bfbbd-d6f9-4497-bf94-54cb23cce7c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:24:56.195577 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:24:56.195577 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:24:56.195577 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:24:56.195577 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:24:56.195577 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:24:56.195577 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:24:56.195577 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:24:56.195577 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:24:56.195577 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:24:56.195577 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:24:56.195577 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:24:56.195577 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:24:56.195577 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:24:56.195577 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:24:56.196672 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:24:56.196672 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:24:56.196672 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:24:56.196672 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:24:56.196672 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:24:56.196672 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:24:56.196672 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:24:56.196672 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:24:56.196672 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jun 07 14:24:56.196672 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:24:56.196672 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:24:56.196672 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:24:56.196672 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:24:56.196672 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:24:56.196672 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:24:56.196672 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:24:56.196672 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:24:56.198011 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:24:56.198011 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:24:56.198011 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:24:56.198011 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:24:56.198011 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 630/1278] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jun 7 14:24:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:24:56.203353 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c9913d-7cbd-4c43-a9ed-5e341b7bf57d None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:24:56.300832 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c9913d-7cbd-4c43-a9ed-5e341b7bf57d None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:24:56.331989 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b78d719-f212-4929-8857-16971dffdbff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:24:56.332639 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b78d719-f212-4929-8857-16971dffdbff None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:24:56.332920 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b78d719-f212-4929-8857-16971dffdbff None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:24:56.333192 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b78d719-f212-4929-8857-16971dffdbff None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:24:56.333901 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b78d719-f212-4929-8857-16971dffdbff None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:24:56.334230 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b78d719-f212-4929-8857-16971dffdbff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:24:56.335539 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b78d719-f212-4929-8857-16971dffdbff None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:24:56.350223 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 649/1279] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jun 7 14:24:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:24:56.356562 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741bfbbd-d6f9-4497-bf94-54cb23cce7c6 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:24:56.386436 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:24:56.453762 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741bfbbd-d6f9-4497-bf94-54cb23cce7c6 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:24:56.485874 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2811850-dac0-47d0-8e9a-85281739be25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:24:56.486657 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2811850-dac0-47d0-8e9a-85281739be25 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:24:56.486940 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2811850-dac0-47d0-8e9a-85281739be25 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:24:56.487218 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2811850-dac0-47d0-8e9a-85281739be25 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:24:56.495893 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2811850-dac0-47d0-8e9a-85281739be25 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:24:56.497394 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2811850-dac0-47d0-8e9a-85281739be25 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:24:56.512073 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-d2811850-dac0-47d0-8e9a-85281739be25 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 07 14:24:56.512073 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:24:56.512073 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:24:56.512073 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:24:56.512073 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:24:56.512073 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:24:56.512073 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:24:56.512073 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:24:56.512073 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:24:56.512073 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:24:56.512073 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:24:56.512073 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:24:56.512073 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 14:24:56.512073 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 14:24:56.512073 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 14:24:56.512073 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 14:24:56.513195 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:24:56.513195 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:24:56.513195 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 14:24:56.513195 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:24:56.513195 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 14:24:56.513195 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:24:56.513195 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:24:56.513195 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:24:56.513195 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:24:56.513195 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:24:56.513195 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:24:56.513195 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jun 07 14:24:56.513195 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:24:56.513195 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:24:56.513195 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:24:56.513195 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:24:56.513195 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:24:56.513195 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:24:56.514330 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:24:56.514330 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:24:56.514330 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 14:24:56.514330 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 14:24:56.514330 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 14:24:56.514330 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 14:24:56.514330 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 14:24:56.514330 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 14:24:56.514330 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 07 14:24:56.514330 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:24:56.514330 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 631/1280] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jun 7 14:24:56 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 14:24:56.519038 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b78d719-f212-4929-8857-16971dffdbff None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:24:56.522821 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:24:56.614886 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b78d719-f212-4929-8857-16971dffdbff None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:24:56.648659 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca04f74-d56c-4dc6-96fa-79565bbab660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:24:56.649255 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca04f74-d56c-4dc6-96fa-79565bbab660 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:24:56.649530 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca04f74-d56c-4dc6-96fa-79565bbab660 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:24:56.649800 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca04f74-d56c-4dc6-96fa-79565bbab660 None admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:24:56.650667 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca04f74-d56c-4dc6-96fa-79565bbab660 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:24:56.650975 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca04f74-d56c-4dc6-96fa-79565bbab660 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:24:56.652438 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca04f74-d56c-4dc6-96fa-79565bbab660 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:24:56.670791 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 650/1281] 10.222.0.86 () {56 vars in 1143 bytes} [Tue Jun 7 14:24:56 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:24:56.676478 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2811850-dac0-47d0-8e9a-85281739be25 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:24:56.765734 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:24:56.774722 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2811850-dac0-47d0-8e9a-85281739be25 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:24:56.807425 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dc3f52-a4ea-4d96-9472-41a39e301ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:24:56.808161 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dc3f52-a4ea-4d96-9472-41a39e301ade None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:24:56.809353 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dc3f52-a4ea-4d96-9472-41a39e301ade None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:24:56.809633 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dc3f52-a4ea-4d96-9472-41a39e301ade None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:24:56.874632 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dc3f52-a4ea-4d96-9472-41a39e301ade None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:24:56.876087 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dc3f52-a4ea-4d96-9472-41a39e301ade None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:24:56.969994 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:24:56.979908 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 632/1282] 10.222.0.86 () {58 vars in 1282 bytes} [Tue Jun 7 14:24:56 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 07 14:24:56.985719 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca04f74-d56c-4dc6-96fa-79565bbab660 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:24:57.046760 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:24:57.083586 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca04f74-d56c-4dc6-96fa-79565bbab660 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:24:57.116207 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86dd197-cdb2-4415-b7e7-8faccc6e4265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:24:57.116979 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86dd197-cdb2-4415-b7e7-8faccc6e4265 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:24:57.117256 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86dd197-cdb2-4415-b7e7-8faccc6e4265 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:24:57.117528 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86dd197-cdb2-4415-b7e7-8faccc6e4265 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:24:57.127601 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86dd197-cdb2-4415-b7e7-8faccc6e4265 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:24:57.129048 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86dd197-cdb2-4415-b7e7-8faccc6e4265 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:24:57.146524 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-d86dd197-cdb2-4415-b7e7-8faccc6e4265 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:24:57.146524 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:24:57.146524 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:24:57.146524 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:24:57.146524 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:24:57.146524 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:24:57.146524 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:24:57.146524 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:24:57.146524 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:24:57.146524 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:24:57.146524 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:24:57.146524 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:24:57.146524 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:24:57.146524 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:24:57.146524 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:24:57.147500 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:24:57.147500 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:24:57.147500 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:24:57.147500 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:24:57.147500 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:24:57.147500 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:24:57.147500 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:24:57.147500 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:24:57.147500 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jun 07 14:24:57.147500 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:24:57.147500 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:24:57.147500 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:24:57.147500 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:24:57.147500 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:24:57.147500 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:24:57.147500 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:24:57.147500 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:24:57.148468 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:24:57.148468 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:24:57.148468 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:24:57.148468 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:24:57.148908 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 651/1283] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jun 7 14:24:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:24:57.153813 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dc3f52-a4ea-4d96-9472-41a39e301ade None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:24:57.251695 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dc3f52-a4ea-4d96-9472-41a39e301ade None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:24:57.285970 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1d92ea-dd76-46b3-92ef-5958d9955367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:24:57.286641 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1d92ea-dd76-46b3-92ef-5958d9955367 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:24:57.286912 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1d92ea-dd76-46b3-92ef-5958d9955367 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:24:57.287185 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1d92ea-dd76-46b3-92ef-5958d9955367 None admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:24:57.287930 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1d92ea-dd76-46b3-92ef-5958d9955367 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:24:57.288238 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1d92ea-dd76-46b3-92ef-5958d9955367 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:24:57.289590 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1d92ea-dd76-46b3-92ef-5958d9955367 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:24:57.300479 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 633/1284] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jun 7 14:24:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:24:57.306249 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86dd197-cdb2-4415-b7e7-8faccc6e4265 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:24:57.405244 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86dd197-cdb2-4415-b7e7-8faccc6e4265 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:24:57.418979 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:24:57.438032 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc630fc4-b272-4260-ba9e-005cec06bc46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:24:57.438809 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc630fc4-b272-4260-ba9e-005cec06bc46 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:24:57.439111 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc630fc4-b272-4260-ba9e-005cec06bc46 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:24:57.439362 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc630fc4-b272-4260-ba9e-005cec06bc46 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:24:57.445847 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc630fc4-b272-4260-ba9e-005cec06bc46 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:24:57.447260 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc630fc4-b272-4260-ba9e-005cec06bc46 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:24:57.461836 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-fc630fc4-b272-4260-ba9e-005cec06bc46 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:24:57.461836 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:24:57.461836 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:24:57.461836 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:24:57.461836 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:24:57.461836 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:24:57.461836 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:24:57.461836 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:24:57.461836 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:24:57.461836 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:24:57.461836 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:24:57.461836 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:24:57.461836 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 14:24:57.461836 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 14:24:57.461836 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 14:24:57.463013 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 14:24:57.463013 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:24:57.463013 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:24:57.463013 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:24:57.463013 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:24:57.463013 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:24:57.463013 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:24:57.463013 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:24:57.463013 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jun 07 14:24:57.463013 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:24:57.463013 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:24:57.463013 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:24:57.463013 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:24:57.463013 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:24:57.463013 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:24:57.463013 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:24:57.463013 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:24:57.464191 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 14:24:57.464191 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 14:24:57.464191 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 14:24:57.464191 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 14:24:57.464191 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 14:24:57.464191 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 14:24:57.464191 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:24:57.464191 dv-cinder-844974-1-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jun 07 14:24:57.464191 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 652/1285] 10.222.0.86 () {56 vars in 1111 bytes} [Tue Jun 7 14:24:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:24:57.469582 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1d92ea-dd76-46b3-92ef-5958d9955367 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:24:57.518868 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:24:57.569250 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1d92ea-dd76-46b3-92ef-5958d9955367 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:24:57.601824 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4f62c1-7ccf-4c88-aaed-3ca150f1ee2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:24:57.602474 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4f62c1-7ccf-4c88-aaed-3ca150f1ee2f None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:24:57.602790 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4f62c1-7ccf-4c88-aaed-3ca150f1ee2f None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:24:57.603069 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4f62c1-7ccf-4c88-aaed-3ca150f1ee2f None admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:24:57.603881 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4f62c1-7ccf-4c88-aaed-3ca150f1ee2f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:24:57.604194 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4f62c1-7ccf-4c88-aaed-3ca150f1ee2f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:24:57.606260 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4f62c1-7ccf-4c88-aaed-3ca150f1ee2f None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:24:57.617880 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 634/1286] 10.222.0.86 () {56 vars in 1148 bytes} [Tue Jun 7 14:24:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:24:57.624025 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc630fc4-b272-4260-ba9e-005cec06bc46 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:24:57.723914 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc630fc4-b272-4260-ba9e-005cec06bc46 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:24:57.757602 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912af9a2-575d-40ed-875a-0768c167b2df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:24:57.758330 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912af9a2-575d-40ed-875a-0768c167b2df None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:24:57.758679 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912af9a2-575d-40ed-875a-0768c167b2df None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:24:57.758956 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912af9a2-575d-40ed-875a-0768c167b2df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:24:57.759800 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912af9a2-575d-40ed-875a-0768c167b2df None admin] RBAC: Adding query filter params (role.id=e3bf6239f5bf477b965704b086786f11, scope.project.id=e429537b190c4c5ea7e1332ab044ca7a, user.id=7e042f9d4a9345bb947e6a30f64a59ea) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:24:57.760116 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912af9a2-575d-40ed-875a-0768c167b2df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:24:57.761739 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912af9a2-575d-40ed-875a-0768c167b2df None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:24:57.768092 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 653/1287] 10.222.0.86 () {56 vars in 1374 bytes} [Tue Jun 7 14:24:57 2022] GET /identity/v3/role_assignments?user.id=7e042f9d4a9345bb947e6a30f64a59ea&scope.project.id=e429537b190c4c5ea7e1332ab044ca7a&role.id=e3bf6239f5bf477b965704b086786f11 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:25:00.059039 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c871aa2c-bd11-4499-892c-357431a3fe59 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:25:00.059627 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c871aa2c-bd11-4499-892c-357431a3fe59 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:25:00.059627 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c871aa2c-bd11-4499-892c-357431a3fe59 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:25:00.060987 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 635/1288] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:25:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:25:00.066389 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07a1db5-ebe4-4375-b7e8-426aa46ff60a None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:25:00.066774 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07a1db5-ebe4-4375-b7e8-426aa46ff60a None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:25:00.066939 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07a1db5-ebe4-4375-b7e8-426aa46ff60a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:25:00.083092 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-a07a1db5-ebe4-4375-b7e8-426aa46ff60a None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:25:00.084301 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-a07a1db5-ebe4-4375-b7e8-426aa46ff60a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:25:00.113722 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:25:00.148049 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 654/1289] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:25:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 14:25:00.171210 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c871aa2c-bd11-4499-892c-357431a3fe59 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:25:00.272151 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c871aa2c-bd11-4499-892c-357431a3fe59 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:25:00.283271 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:25:00.305596 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af537c81-8ad9-4927-bb5c-0a901efed42c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:25:00.306382 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af537c81-8ad9-4927-bb5c-0a901efed42c None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:25:00.306666 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af537c81-8ad9-4927-bb5c-0a901efed42c None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:25:00.306982 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af537c81-8ad9-4927-bb5c-0a901efed42c None admin] PATH_INFO: `/v3/services/placement` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:25:00.307637 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af537c81-8ad9-4927-bb5c-0a901efed42c None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:25:00.309025 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af537c81-8ad9-4927-bb5c-0a901efed42c None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:25:00.320828 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-af537c81-8ad9-4927-bb5c-0a901efed42c None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 07 14:25:00.320828 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:25:00.320828 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 07 14:25:00.320828 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 07 14:25:00.320828 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 07 14:25:00.320828 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 07 14:25:00.320828 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 07 14:25:00.320828 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 14:25:00.320828 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 07 14:25:00.320828 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:25:00.320828 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 07 14:25:00.320828 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:25:00.320828 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:25:00.320828 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:25:00.320828 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:25:00.320828 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:25:00.320828 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:25:00.322018 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:25:00.322018 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:25:00.322018 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:25:00.322018 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:25:00.322018 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:25:00.322018 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:25:00.322018 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 07 14:25:00.322018 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 07 14:25:00.322018 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 07 14:25:00.322018 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 07 14:25:00.322018 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:25:00.322018 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:25:00.322018 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:25:00.322018 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:25:00.322018 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:25:00.322018 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:25:00.327329 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:25:00.327329 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jun 07 14:25:00.327329 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:25:00.327329 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:25:00.327329 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:25:00.327329 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:25:00.327329 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:25:00.327329 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:25:00.327329 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:25:00.327329 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:25:00.327329 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 07 14:25:00.327329 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 14:25:00.327329 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 07 14:25:00.327329 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:25:00.327329 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 636/1290] 10.222.0.86 () {56 vars in 1117 bytes} [Tue Jun 7 14:25:00 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:25:00.328816 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07a1db5-ebe4-4375-b7e8-426aa46ff60a None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:25:00.424679 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07a1db5-ebe4-4375-b7e8-426aa46ff60a None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:25:00.457578 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea33b7fe-0f99-4716-9226-6842e28b3194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:25:00.458237 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea33b7fe-0f99-4716-9226-6842e28b3194 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:25:00.458524 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea33b7fe-0f99-4716-9226-6842e28b3194 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:25:00.458843 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea33b7fe-0f99-4716-9226-6842e28b3194 None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:25:00.459502 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea33b7fe-0f99-4716-9226-6842e28b3194 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:25:00.459842 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea33b7fe-0f99-4716-9226-6842e28b3194 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:25:00.461199 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea33b7fe-0f99-4716-9226-6842e28b3194 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:25:00.466719 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 655/1291] 10.222.0.86 () {56 vars in 1116 bytes} [Tue Jun 7 14:25:00 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:25:00.472518 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af537c81-8ad9-4927-bb5c-0a901efed42c None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:25:00.569616 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af537c81-8ad9-4927-bb5c-0a901efed42c None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:25:00.601824 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3f86b6-6c0f-423d-b06e-d245af7f4442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:25:00.602411 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3f86b6-6c0f-423d-b06e-d245af7f4442 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:25:00.602726 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3f86b6-6c0f-423d-b06e-d245af7f4442 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:25:00.603071 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3f86b6-6c0f-423d-b06e-d245af7f4442 None admin] PATH_INFO: `/v3/services` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:25:00.603799 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3f86b6-6c0f-423d-b06e-d245af7f4442 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:25:00.604106 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3f86b6-6c0f-423d-b06e-d245af7f4442 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:25:00.605518 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3f86b6-6c0f-423d-b06e-d245af7f4442 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:25:00.609837 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 637/1292] 10.222.0.86 () {56 vars in 1116 bytes} [Tue Jun 7 14:25:00 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:25:02.828440 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a574897a-ada7-410f-83c3-caebf0cee7d8 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:25:02.828976 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a574897a-ada7-410f-83c3-caebf0cee7d8 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:25:02.828976 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a574897a-ada7-410f-83c3-caebf0cee7d8 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:25:02.830389 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 656/1293] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:25:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:25:02.835483 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ca5482-86b8-461f-89f0-ef67d566c711 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:25:02.835951 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ca5482-86b8-461f-89f0-ef67d566c711 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:25:02.836089 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ca5482-86b8-461f-89f0-ef67d566c711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:25:02.852777 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-b7ca5482-86b8-461f-89f0-ef67d566c711 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:25:02.853964 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-b7ca5482-86b8-461f-89f0-ef67d566c711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:25:02.883063 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:25:02.919565 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 638/1294] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:25:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 14:25:02.942721 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a574897a-ada7-410f-83c3-caebf0cee7d8 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:25:02.973810 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:25:03.041843 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a574897a-ada7-410f-83c3-caebf0cee7d8 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:25:03.077104 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b618b125-fb78-4098-b740-f385e2524ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:25:03.077786 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b618b125-fb78-4098-b740-f385e2524ad3 None admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:25:03.078071 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b618b125-fb78-4098-b740-f385e2524ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:25:03.078348 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b618b125-fb78-4098-b740-f385e2524ad3 None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:25:03.079121 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b618b125-fb78-4098-b740-f385e2524ad3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:25:03.080454 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b618b125-fb78-4098-b740-f385e2524ad3 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:25:03.177162 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 657/1295] 10.222.0.86 () {60 vars in 1141 bytes} [Tue Jun 7 14:25:02 2022] POST /identity/v3/services => generated 246 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 14:25:05.428478 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ccfd4e-e100-41ac-92fa-2be208a13ded None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:25:05.429035 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ccfd4e-e100-41ac-92fa-2be208a13ded None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:25:05.429035 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ccfd4e-e100-41ac-92fa-2be208a13ded None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:25:05.430464 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 639/1296] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:25:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:25:05.436407 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f406907a-c7ed-4e27-9864-d142f846c755 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:25:05.436802 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f406907a-c7ed-4e27-9864-d142f846c755 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:25:05.437003 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f406907a-c7ed-4e27-9864-d142f846c755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:25:05.453271 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-f406907a-c7ed-4e27-9864-d142f846c755 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:25:05.454446 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-f406907a-c7ed-4e27-9864-d142f846c755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:25:05.525133 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 658/1297] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:25:05 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 14:25:05.548335 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ccfd4e-e100-41ac-92fa-2be208a13ded None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:25:05.646744 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ccfd4e-e100-41ac-92fa-2be208a13ded None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:25:05.679927 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6fb830-32bc-4c0f-adfb-a9f621adf56f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:25:05.680711 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6fb830-32bc-4c0f-adfb-a9f621adf56f None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:25:05.680998 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6fb830-32bc-4c0f-adfb-a9f621adf56f None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:25:05.681272 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6fb830-32bc-4c0f-adfb-a9f621adf56f None admin] PATH_INFO: `/v3/services/placement` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:25:05.681919 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6fb830-32bc-4c0f-adfb-a9f621adf56f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:25:05.683280 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6fb830-32bc-4c0f-adfb-a9f621adf56f None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:25:05.695552 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-8f6fb830-32bc-4c0f-adfb-a9f621adf56f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 07 14:25:05.695552 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:25:05.695552 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 07 14:25:05.695552 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 07 14:25:05.695552 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 07 14:25:05.695552 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 07 14:25:05.695552 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 07 14:25:05.695552 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 14:25:05.695552 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 07 14:25:05.695552 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:25:05.695552 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 07 14:25:05.695552 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:25:05.695552 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:25:05.695552 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:25:05.695552 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:25:05.695552 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:25:05.695552 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:25:05.696789 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:25:05.696789 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:25:05.696789 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:25:05.696789 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:25:05.696789 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:25:05.696789 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:25:05.696789 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 07 14:25:05.696789 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 07 14:25:05.696789 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 07 14:25:05.696789 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 07 14:25:05.696789 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:25:05.696789 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:25:05.696789 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:25:05.696789 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:25:05.696789 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:25:05.696789 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:25:05.697838 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:25:05.697838 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jun 07 14:25:05.697838 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:25:05.697838 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:25:05.697838 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:25:05.697838 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:25:05.697838 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:25:05.697838 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:25:05.697838 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:25:05.697838 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:25:05.697838 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 07 14:25:05.697838 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 14:25:05.697838 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 07 14:25:05.697838 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:25:05.697838 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 640/1298] 10.222.0.86 () {56 vars in 1117 bytes} [Tue Jun 7 14:25:05 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:25:05.702932 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f406907a-c7ed-4e27-9864-d142f846c755 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:25:05.721148 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:25:05.799381 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f406907a-c7ed-4e27-9864-d142f846c755 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:25:05.832888 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8a3170-bf51-42ce-bbe8-5a127106e605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:25:05.833567 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8a3170-bf51-42ce-bbe8-5a127106e605 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:25:05.833854 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8a3170-bf51-42ce-bbe8-5a127106e605 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:25:05.834126 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8a3170-bf51-42ce-bbe8-5a127106e605 None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:25:05.834827 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8a3170-bf51-42ce-bbe8-5a127106e605 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:25:05.835161 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8a3170-bf51-42ce-bbe8-5a127106e605 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:25:05.836566 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8a3170-bf51-42ce-bbe8-5a127106e605 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:25:05.842212 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 659/1299] 10.222.0.86 () {56 vars in 1116 bytes} [Tue Jun 7 14:25:05 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:25:05.848179 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6fb830-32bc-4c0f-adfb-a9f621adf56f None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:25:05.879525 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:25:05.945621 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6fb830-32bc-4c0f-adfb-a9f621adf56f None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:25:05.979512 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1d8b0b-6337-4fb2-a348-964dba78ccca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:25:05.980179 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1d8b0b-6337-4fb2-a348-964dba78ccca None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:25:05.981099 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1d8b0b-6337-4fb2-a348-964dba78ccca None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:25:05.981377 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1d8b0b-6337-4fb2-a348-964dba78ccca None admin] PATH_INFO: `/v3/endpoints` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:25:05.982167 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1d8b0b-6337-4fb2-a348-964dba78ccca None admin] RBAC: Adding query filter params (interface=public, service_id=8d2ab23c07fb4a8cafb644150082088d, region_id=RegionOne) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:25:05.982481 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1d8b0b-6337-4fb2-a348-964dba78ccca None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:25:05.983859 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1d8b0b-6337-4fb2-a348-964dba78ccca None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:25:05.988838 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 641/1300] 10.222.0.86 () {56 vars in 1251 bytes} [Tue Jun 7 14:25:05 2022] GET /identity/v3/endpoints?service_id=8d2ab23c07fb4a8cafb644150082088d&interface=public®ion_id=RegionOne => generated 194 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:25:05.994548 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8a3170-bf51-42ce-bbe8-5a127106e605 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:25:06.073081 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:25:06.090793 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8a3170-bf51-42ce-bbe8-5a127106e605 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:25:06.123746 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8696d8fb-9c8e-400d-ab29-e66a15bf9009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:25:06.124433 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8696d8fb-9c8e-400d-ab29-e66a15bf9009 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:25:06.124721 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8696d8fb-9c8e-400d-ab29-e66a15bf9009 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:25:06.124999 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8696d8fb-9c8e-400d-ab29-e66a15bf9009 None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:25:06.125680 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8696d8fb-9c8e-400d-ab29-e66a15bf9009 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:25:06.127043 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8696d8fb-9c8e-400d-ab29-e66a15bf9009 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:25:06.133828 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 660/1301] 10.222.0.86 () {56 vars in 1087 bytes} [Tue Jun 7 14:25:05 2022] GET /identity/v3/services => generated 2191 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:25:08.337362 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1660763-9334-48bb-83f7-8a26574f120c None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:25:08.337912 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1660763-9334-48bb-83f7-8a26574f120c None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:25:08.337912 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1660763-9334-48bb-83f7-8a26574f120c None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:25:08.339316 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 642/1302] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:25:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:25:08.344894 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6fff3e-d8c0-4940-b7a7-9017146e3993 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:25:08.345298 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6fff3e-d8c0-4940-b7a7-9017146e3993 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:25:08.345450 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6fff3e-d8c0-4940-b7a7-9017146e3993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:25:08.362437 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-1b6fff3e-d8c0-4940-b7a7-9017146e3993 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:25:08.363721 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-1b6fff3e-d8c0-4940-b7a7-9017146e3993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:25:08.427953 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 661/1303] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:25:08 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 14:25:08.450648 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1660763-9334-48bb-83f7-8a26574f120c None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:25:08.544128 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:25:08.550683 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1660763-9334-48bb-83f7-8a26574f120c None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:25:08.582787 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0329a7d6-f976-4681-ad4c-3c9043102154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:25:08.583583 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0329a7d6-f976-4681-ad4c-3c9043102154 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:25:08.583905 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0329a7d6-f976-4681-ad4c-3c9043102154 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:25:08.584184 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0329a7d6-f976-4681-ad4c-3c9043102154 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:25:08.584832 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0329a7d6-f976-4681-ad4c-3c9043102154 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:25:08.586185 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0329a7d6-f976-4681-ad4c-3c9043102154 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:25:08.598404 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-0329a7d6-f976-4681-ad4c-3c9043102154 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 07 14:25:08.598404 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:25:08.598404 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 07 14:25:08.598404 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 07 14:25:08.598404 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 07 14:25:08.598404 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 07 14:25:08.598404 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 07 14:25:08.598404 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 14:25:08.598404 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 07 14:25:08.598404 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:25:08.598404 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 07 14:25:08.598404 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:25:08.598404 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:25:08.598404 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:25:08.598404 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:25:08.598404 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:25:08.598404 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:25:08.599565 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:25:08.599565 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:25:08.599565 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:25:08.599565 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:25:08.599565 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:25:08.599565 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:25:08.599565 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 07 14:25:08.599565 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 07 14:25:08.599565 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 07 14:25:08.599565 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 07 14:25:08.599565 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:25:08.599565 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:25:08.599565 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:25:08.599565 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:25:08.599565 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:25:08.599565 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:25:08.600511 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:25:08.600511 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jun 07 14:25:08.600511 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:25:08.600511 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:25:08.600511 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:25:08.600511 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:25:08.600511 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:25:08.600511 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:25:08.600511 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:25:08.600511 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:25:08.600511 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 07 14:25:08.600511 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 14:25:08.600511 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 07 14:25:08.600511 dv-cinder-844974-1-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jun 07 14:25:08.600511 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 643/1304] 10.222.0.86 () {56 vars in 1117 bytes} [Tue Jun 7 14:25:08 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:25:08.606056 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6fff3e-d8c0-4940-b7a7-9017146e3993 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:25:08.679844 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:25:08.701508 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6fff3e-d8c0-4940-b7a7-9017146e3993 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:25:08.733632 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7225e3-049c-43ac-abd9-f2b5a9226fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:25:08.734282 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7225e3-049c-43ac-abd9-f2b5a9226fe4 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:25:08.734564 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7225e3-049c-43ac-abd9-f2b5a9226fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:25:08.734840 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7225e3-049c-43ac-abd9-f2b5a9226fe4 None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:25:08.735537 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7225e3-049c-43ac-abd9-f2b5a9226fe4 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:25:08.735872 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7225e3-049c-43ac-abd9-f2b5a9226fe4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:25:08.737230 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7225e3-049c-43ac-abd9-f2b5a9226fe4 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:25:08.742232 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 662/1305] 10.222.0.86 () {56 vars in 1116 bytes} [Tue Jun 7 14:25:08 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:25:08.748114 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0329a7d6-f976-4681-ad4c-3c9043102154 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:25:08.847856 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0329a7d6-f976-4681-ad4c-3c9043102154 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:25:08.882256 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166d3596-ecff-4648-ba10-cd945f5c59e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:25:08.882914 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166d3596-ecff-4648-ba10-cd945f5c59e1 None admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:25:08.883194 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166d3596-ecff-4648-ba10-cd945f5c59e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:25:08.883471 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166d3596-ecff-4648-ba10-cd945f5c59e1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:25:08.884248 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166d3596-ecff-4648-ba10-cd945f5c59e1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:25:08.885699 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166d3596-ecff-4648-ba10-cd945f5c59e1 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:25:08.986351 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 644/1306] 10.222.0.86 () {60 vars in 1144 bytes} [Tue Jun 7 14:25:08 2022] POST /identity/v3/endpoints => generated 331 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:25:18.775038 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=30 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:25:18.981595 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:31:41.624155 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3921889-e28b-4a85-9c87-26734eed85e3 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:31:41.624730 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3921889-e28b-4a85-9c87-26734eed85e3 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:31:41.624730 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3921889-e28b-4a85-9c87-26734eed85e3 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:31:41.631403 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e011d4-1a07-42d7-ad0a-ef23c46b39db None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:31:41.631898 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e011d4-1a07-42d7-ad0a-ef23c46b39db None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:31:41.632009 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e011d4-1a07-42d7-ad0a-ef23c46b39db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:31:41.635483 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 663/1307] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:31:41 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:31:41.715990 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-b8e011d4-1a07-42d7-ad0a-ef23c46b39db None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:31:41.717206 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-b8e011d4-1a07-42d7-ad0a-ef23c46b39db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:31:41.856634 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 645/1308] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:31:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 14:31:41.902916 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6fb12b-8b38-4237-ba04-4b8257a67e85 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:31:41.903146 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6fb12b-8b38-4237-ba04-4b8257a67e85 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:31:41.903437 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6fb12b-8b38-4237-ba04-4b8257a67e85 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:31:41.905167 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 664/1309] 10.222.0.86 () {54 vars in 964 bytes} [Tue Jun 7 14:31:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:31:41.918825 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f405ac7a-5ae8-4aa1-8d90-12a923548a1e None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:31:41.919519 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f405ac7a-5ae8-4aa1-8d90-12a923548a1e None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:31:41.920469 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f405ac7a-5ae8-4aa1-8d90-12a923548a1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:31:42.012526 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-f405ac7a-5ae8-4aa1-8d90-12a923548a1e None None] MFA Rules not processed for user `dda603ec5517460a83c333db2af804d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:31:42.013764 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-f405ac7a-5ae8-4aa1-8d90-12a923548a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:31:42.042249 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:31:42.244540 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 646/1310] 10.222.0.86 () {58 vars in 1061 bytes} [Tue Jun 7 14:31:41 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:31:42.253918 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6fb12b-8b38-4237-ba04-4b8257a67e85 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:31:42.255826 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-3b6fb12b-8b38-4237-ba04-4b8257a67e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:31:42.375005 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6fb12b-8b38-4237-ba04-4b8257a67e85 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:31:42.459196 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bf0c32-2f4e-4668-816e-9fe7e61755df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dda603ec5517460a83c333db2af804d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:31:42.460226 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bf0c32-2f4e-4668-816e-9fe7e61755df service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:31:42.460650 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bf0c32-2f4e-4668-816e-9fe7e61755df service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:31:42.461287 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bf0c32-2f4e-4668-816e-9fe7e61755df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:31:42.463068 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-40bf0c32-2f4e-4668-816e-9fe7e61755df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:31:42.523522 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:31:42.581452 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bf0c32-2f4e-4668-816e-9fe7e61755df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:31:42.582893 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bf0c32-2f4e-4668-816e-9fe7e61755df service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:31:42.602175 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 665/1311] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:31:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:31:45.119504 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69313fc7-a04b-4f11-9589-027417d0a0e6 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:31:45.120070 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69313fc7-a04b-4f11-9589-027417d0a0e6 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:31:45.120185 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69313fc7-a04b-4f11-9589-027417d0a0e6 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:31:45.121765 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 647/1312] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:31:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:31:45.127473 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d547973b-ccc4-4004-99d0-816804b5a5cd None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:31:45.127919 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d547973b-ccc4-4004-99d0-816804b5a5cd None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:31:45.128044 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d547973b-ccc4-4004-99d0-816804b5a5cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:31:45.213464 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-d547973b-ccc4-4004-99d0-816804b5a5cd None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:31:45.214662 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-d547973b-ccc4-4004-99d0-816804b5a5cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:31:45.317596 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 666/1313] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:31:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:31:45.370820 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3215426-0dd1-4906-9ac9-b4e97ad0b290 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:31:45.371222 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3215426-0dd1-4906-9ac9-b4e97ad0b290 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:31:45.371604 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3215426-0dd1-4906-9ac9-b4e97ad0b290 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:31:45.373283 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 648/1314] 10.222.0.86 () {54 vars in 964 bytes} [Tue Jun 7 14:31:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:31:45.379868 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762da1c6-182a-4f8c-810f-365eef752b15 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:31:45.380285 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762da1c6-182a-4f8c-810f-365eef752b15 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:31:45.380679 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762da1c6-182a-4f8c-810f-365eef752b15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:31:45.391161 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:31:45.458127 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-762da1c6-182a-4f8c-810f-365eef752b15 None None] MFA Rules not processed for user `dda603ec5517460a83c333db2af804d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:31:45.459419 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-762da1c6-182a-4f8c-810f-365eef752b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:31:45.541130 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 667/1315] 10.222.0.86 () {58 vars in 1061 bytes} [Tue Jun 7 14:31:45 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:31:45.550938 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3215426-0dd1-4906-9ac9-b4e97ad0b290 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:31:45.552717 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-a3215426-0dd1-4906-9ac9-b4e97ad0b290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:31:45.663413 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3215426-0dd1-4906-9ac9-b4e97ad0b290 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:31:45.737708 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:31:45.740382 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999f2082-e248-4c83-969f-ad8cb7b2fc2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dda603ec5517460a83c333db2af804d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:31:45.741031 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999f2082-e248-4c83-969f-ad8cb7b2fc2b service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:31:45.741317 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999f2082-e248-4c83-969f-ad8cb7b2fc2b service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:31:45.741598 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999f2082-e248-4c83-969f-ad8cb7b2fc2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:31:45.743403 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-999f2082-e248-4c83-969f-ad8cb7b2fc2b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:31:45.855913 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999f2082-e248-4c83-969f-ad8cb7b2fc2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:31:45.857400 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999f2082-e248-4c83-969f-ad8cb7b2fc2b service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:31:45.878262 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 649/1316] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:31:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:31:48.937446 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705db4a1-b3dd-4fa4-affd-bdf4265d3d58 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:31:48.937992 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705db4a1-b3dd-4fa4-affd-bdf4265d3d58 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:31:48.937992 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705db4a1-b3dd-4fa4-affd-bdf4265d3d58 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:31:48.940041 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 668/1317] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:31:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:31:48.945124 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e182fad2-158d-484b-af69-8c1ee0e57789 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:31:48.945500 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e182fad2-158d-484b-af69-8c1ee0e57789 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:31:48.945672 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e182fad2-158d-484b-af69-8c1ee0e57789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:31:49.008142 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-e182fad2-158d-484b-af69-8c1ee0e57789 None None] MFA Rules not processed for user `a453037a2b4a425fa2238ee5e0d74396`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:31:49.009333 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-e182fad2-158d-484b-af69-8c1ee0e57789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:31:49.061831 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:31:49.104342 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 650/1318] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:31:48 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:31:49.143465 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705db4a1-b3dd-4fa4-affd-bdf4265d3d58 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:31:49.145053 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-705db4a1-b3dd-4fa4-affd-bdf4265d3d58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:31:49.248113 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705db4a1-b3dd-4fa4-affd-bdf4265d3d58 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:31:49.250890 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:31:49.320618 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276e12a9-ba84-4ee4-a11a-40017079017e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dda603ec5517460a83c333db2af804d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:31:49.321256 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276e12a9-ba84-4ee4-a11a-40017079017e service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:31:49.321545 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276e12a9-ba84-4ee4-a11a-40017079017e service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:31:49.321821 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276e12a9-ba84-4ee4-a11a-40017079017e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:31:49.323440 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-276e12a9-ba84-4ee4-a11a-40017079017e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:31:49.429432 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276e12a9-ba84-4ee4-a11a-40017079017e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:31:49.430858 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276e12a9-ba84-4ee4-a11a-40017079017e service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:31:49.449368 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 669/1319] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:31:49 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:31:52.471884 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e435919c-7d76-44b5-bc0d-1fd2d9e38f81 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:31:52.472410 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e435919c-7d76-44b5-bc0d-1fd2d9e38f81 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:31:52.472502 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e435919c-7d76-44b5-bc0d-1fd2d9e38f81 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:31:52.473816 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 651/1320] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:31:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:31:52.479018 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d7e314-a1ac-4edb-942a-6f09c4fbdaf1 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:31:52.479445 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d7e314-a1ac-4edb-942a-6f09c4fbdaf1 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:31:52.479645 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d7e314-a1ac-4edb-942a-6f09c4fbdaf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:31:52.518557 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:31:52.543112 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-53d7e314-a1ac-4edb-942a-6f09c4fbdaf1 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:31:52.544376 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-53d7e314-a1ac-4edb-942a-6f09c4fbdaf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:31:52.638035 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 670/1321] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:31:52 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:31:52.677530 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e435919c-7d76-44b5-bc0d-1fd2d9e38f81 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:31:52.679050 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-e435919c-7d76-44b5-bc0d-1fd2d9e38f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:31:52.780673 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e435919c-7d76-44b5-bc0d-1fd2d9e38f81 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:31:52.865738 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f3fe9d-c93f-40c7-bb21-5e9516e1d4cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dda603ec5517460a83c333db2af804d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:31:52.866871 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f3fe9d-c93f-40c7-bb21-5e9516e1d4cb service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:31:52.867239 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f3fe9d-c93f-40c7-bb21-5e9516e1d4cb service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:31:52.867578 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f3fe9d-c93f-40c7-bb21-5e9516e1d4cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:31:52.869537 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-d8f3fe9d-c93f-40c7-bb21-5e9516e1d4cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:31:52.878043 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:31:52.978598 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f3fe9d-c93f-40c7-bb21-5e9516e1d4cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:31:52.980042 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f3fe9d-c93f-40c7-bb21-5e9516e1d4cb service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:31:52.997684 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 652/1322] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:31:52 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:31:56.355266 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85f8092-8f5e-4cf2-8e3b-7aa797de0fe2 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:31:56.355848 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85f8092-8f5e-4cf2-8e3b-7aa797de0fe2 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:31:56.355848 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85f8092-8f5e-4cf2-8e3b-7aa797de0fe2 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:31:56.357366 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 671/1323] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:31:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:31:56.362889 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4083873-a490-433d-98d4-8883a335897c None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:31:56.363306 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4083873-a490-433d-98d4-8883a335897c None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:31:56.363485 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4083873-a490-433d-98d4-8883a335897c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:31:56.426451 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-f4083873-a490-433d-98d4-8883a335897c None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:31:56.427694 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-f4083873-a490-433d-98d4-8883a335897c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:31:56.484166 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:31:56.523800 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 653/1324] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:31:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:31:56.560000 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85f8092-8f5e-4cf2-8e3b-7aa797de0fe2 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:31:56.561616 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-e85f8092-8f5e-4cf2-8e3b-7aa797de0fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:31:56.663486 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85f8092-8f5e-4cf2-8e3b-7aa797de0fe2 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:31:56.676088 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:31:56.738719 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3215db-a6cd-40fc-9e2a-4ce9308e48b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dda603ec5517460a83c333db2af804d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:31:56.739281 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3215db-a6cd-40fc-9e2a-4ce9308e48b2 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:31:56.739560 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3215db-a6cd-40fc-9e2a-4ce9308e48b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:31:56.739865 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3215db-a6cd-40fc-9e2a-4ce9308e48b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:31:56.741480 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-fd3215db-a6cd-40fc-9e2a-4ce9308e48b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:31:56.847883 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3215db-a6cd-40fc-9e2a-4ce9308e48b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:31:56.849329 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3215db-a6cd-40fc-9e2a-4ce9308e48b2 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:31:56.869243 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 672/1325] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:31:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:31:59.161384 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb793bd-d728-4449-9720-6ad2aba851c9 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:31:59.161935 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb793bd-d728-4449-9720-6ad2aba851c9 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:31:59.161935 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb793bd-d728-4449-9720-6ad2aba851c9 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:31:59.163333 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 654/1326] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:31:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:31:59.168706 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d1084a-3f3d-40a7-bb11-6571b8bd778b None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:31:59.169107 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d1084a-3f3d-40a7-bb11-6571b8bd778b None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:31:59.169270 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d1084a-3f3d-40a7-bb11-6571b8bd778b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:31:59.215442 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:31:59.237106 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-f9d1084a-3f3d-40a7-bb11-6571b8bd778b None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:31:59.238349 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-f9d1084a-3f3d-40a7-bb11-6571b8bd778b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:31:59.336020 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 673/1327] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:31:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:31:59.371633 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb793bd-d728-4449-9720-6ad2aba851c9 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:31:59.373258 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-6eb793bd-d728-4449-9720-6ad2aba851c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:31:59.478138 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb793bd-d728-4449-9720-6ad2aba851c9 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:31:59.553087 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeacd59b-5ce5-4eb3-96ef-52536b35be48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dda603ec5517460a83c333db2af804d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:31:59.553730 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeacd59b-5ce5-4eb3-96ef-52536b35be48 service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:31:59.554013 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeacd59b-5ce5-4eb3-96ef-52536b35be48 service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:31:59.554287 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeacd59b-5ce5-4eb3-96ef-52536b35be48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:31:59.555948 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-aeacd59b-5ce5-4eb3-96ef-52536b35be48 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:31:59.573336 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:31:59.666101 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeacd59b-5ce5-4eb3-96ef-52536b35be48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:31:59.668217 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeacd59b-5ce5-4eb3-96ef-52536b35be48 service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:31:59.686030 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 655/1328] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:31:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:32:01.998131 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a98f1b5-8767-4863-bc39-9eb29a5d2569 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:32:01.998640 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a98f1b5-8767-4863-bc39-9eb29a5d2569 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:32:01.998640 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a98f1b5-8767-4863-bc39-9eb29a5d2569 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:32:02.000020 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 674/1329] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:32:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:32:02.005755 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b114b8-f25a-4744-b2a8-d7c347364782 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:32:02.006197 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b114b8-f25a-4744-b2a8-d7c347364782 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:32:02.006328 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b114b8-f25a-4744-b2a8-d7c347364782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:32:02.070578 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-e8b114b8-f25a-4744-b2a8-d7c347364782 None None] MFA Rules not processed for user `a453037a2b4a425fa2238ee5e0d74396`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:32:02.071814 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-e8b114b8-f25a-4744-b2a8-d7c347364782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:32:02.136017 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:32:02.167861 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 656/1330] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:32:02 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:32:02.206293 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a98f1b5-8767-4863-bc39-9eb29a5d2569 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:32:02.207973 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-9a98f1b5-8767-4863-bc39-9eb29a5d2569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:32:02.316325 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a98f1b5-8767-4863-bc39-9eb29a5d2569 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:32:02.336417 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:32:02.388680 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4abd3e-b618-4277-91f3-3d5d9bf221a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dda603ec5517460a83c333db2af804d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:32:02.389331 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4abd3e-b618-4277-91f3-3d5d9bf221a8 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:32:02.389618 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4abd3e-b618-4277-91f3-3d5d9bf221a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:32:02.389897 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4abd3e-b618-4277-91f3-3d5d9bf221a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:32:02.391521 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-8c4abd3e-b618-4277-91f3-3d5d9bf221a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:32:02.501097 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4abd3e-b618-4277-91f3-3d5d9bf221a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:32:02.503237 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4abd3e-b618-4277-91f3-3d5d9bf221a8 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:32:02.521683 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 675/1331] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:32:02 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:32:05.197374 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c36cc0-26ef-49d6-bbb2-90545ee2cc2e None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:32:05.197910 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c36cc0-26ef-49d6-bbb2-90545ee2cc2e None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:32:05.197910 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c36cc0-26ef-49d6-bbb2-90545ee2cc2e None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:32:05.199302 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 657/1332] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:32:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:32:05.204698 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8de297-cfbf-4c9a-89ac-ce1a986490b9 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:32:05.205131 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8de297-cfbf-4c9a-89ac-ce1a986490b9 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:32:05.205251 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8de297-cfbf-4c9a-89ac-ce1a986490b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:32:05.268222 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:32:05.271053 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-9e8de297-cfbf-4c9a-89ac-ce1a986490b9 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:32:05.272350 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-9e8de297-cfbf-4c9a-89ac-ce1a986490b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:32:05.370206 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 676/1333] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:32:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:32:05.406106 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c36cc0-26ef-49d6-bbb2-90545ee2cc2e None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:32:05.408282 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-49c36cc0-26ef-49d6-bbb2-90545ee2cc2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:32:05.511563 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c36cc0-26ef-49d6-bbb2-90545ee2cc2e None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:32:05.584086 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b632236-b44f-4de6-9f02-50f79bf130a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dda603ec5517460a83c333db2af804d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:32:05.584733 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b632236-b44f-4de6-9f02-50f79bf130a7 service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:32:05.585019 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b632236-b44f-4de6-9f02-50f79bf130a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:32:05.585297 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b632236-b44f-4de6-9f02-50f79bf130a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:32:05.586929 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-5b632236-b44f-4de6-9f02-50f79bf130a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:32:05.613994 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:32:05.700406 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b632236-b44f-4de6-9f02-50f79bf130a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:32:05.701783 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b632236-b44f-4de6-9f02-50f79bf130a7 service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:32:05.721159 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 658/1334] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:32:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:32:08.034901 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2786d76-8453-46e6-9813-61bfdd592f0d None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:32:08.035416 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2786d76-8453-46e6-9813-61bfdd592f0d None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:32:08.035530 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2786d76-8453-46e6-9813-61bfdd592f0d None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:32:08.037088 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 677/1335] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:32:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:32:08.042240 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489df63c-a5ec-40d6-ac34-ef7260570614 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:32:08.042640 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489df63c-a5ec-40d6-ac34-ef7260570614 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:32:08.042801 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489df63c-a5ec-40d6-ac34-ef7260570614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:32:08.105791 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-489df63c-a5ec-40d6-ac34-ef7260570614 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:32:08.106992 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-489df63c-a5ec-40d6-ac34-ef7260570614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:32:08.180130 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:32:08.202122 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 659/1336] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:32:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:32:08.242396 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2786d76-8453-46e6-9813-61bfdd592f0d None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:32:08.243974 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-d2786d76-8453-46e6-9813-61bfdd592f0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:32:08.346411 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2786d76-8453-46e6-9813-61bfdd592f0d None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:32:08.374178 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:32:08.418005 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050c2410-a60f-49ec-8e76-5acb33ef8bb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dda603ec5517460a83c333db2af804d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:32:08.418716 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050c2410-a60f-49ec-8e76-5acb33ef8bb7 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:32:08.419000 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050c2410-a60f-49ec-8e76-5acb33ef8bb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:32:08.419277 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050c2410-a60f-49ec-8e76-5acb33ef8bb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:32:08.420950 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-050c2410-a60f-49ec-8e76-5acb33ef8bb7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:32:08.528255 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050c2410-a60f-49ec-8e76-5acb33ef8bb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:32:08.529688 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050c2410-a60f-49ec-8e76-5acb33ef8bb7 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:32:08.548619 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 678/1337] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:32:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:32:11.413175 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c76f07c-eacf-4150-9815-481dc57e6b01 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:32:11.413703 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c76f07c-eacf-4150-9815-481dc57e6b01 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:32:11.413703 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c76f07c-eacf-4150-9815-481dc57e6b01 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:32:11.415096 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 660/1338] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:32:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:32:11.420544 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf933d2-901a-4481-a875-a87c291c00d9 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:32:11.420956 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf933d2-901a-4481-a875-a87c291c00d9 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:32:11.421099 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf933d2-901a-4481-a875-a87c291c00d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:32:11.483806 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-7bf933d2-901a-4481-a875-a87c291c00d9 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:32:11.485535 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-7bf933d2-901a-4481-a875-a87c291c00d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:32:11.493582 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:32:11.581258 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 679/1339] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:32:11 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:32:11.617300 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c76f07c-eacf-4150-9815-481dc57e6b01 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:32:11.618833 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-3c76f07c-eacf-4150-9815-481dc57e6b01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:32:11.728929 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c76f07c-eacf-4150-9815-481dc57e6b01 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:32:11.803369 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70705012-988b-4840-a19a-ec65ef2ee251 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dda603ec5517460a83c333db2af804d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:32:11.804042 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70705012-988b-4840-a19a-ec65ef2ee251 service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:32:11.804331 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70705012-988b-4840-a19a-ec65ef2ee251 service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:32:11.804610 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70705012-988b-4840-a19a-ec65ef2ee251 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:32:11.806714 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-70705012-988b-4840-a19a-ec65ef2ee251 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:32:11.842836 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:32:11.917382 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70705012-988b-4840-a19a-ec65ef2ee251 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:32:11.918803 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70705012-988b-4840-a19a-ec65ef2ee251 service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:32:11.939137 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 661/1340] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:32:11 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:32:16.490713 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5b3fe7-5e24-4d07-b59c-50a5941fc37b None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:32:16.491355 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5b3fe7-5e24-4d07-b59c-50a5941fc37b None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:32:16.491652 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5b3fe7-5e24-4d07-b59c-50a5941fc37b None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:32:16.493103 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 680/1341] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:32:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:32:16.498932 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa83f532-8b84-448b-8f35-9983992b0a21 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:32:16.499369 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa83f532-8b84-448b-8f35-9983992b0a21 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:32:16.499489 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa83f532-8b84-448b-8f35-9983992b0a21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:32:16.545727 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-fa83f532-8b84-448b-8f35-9983992b0a21 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:32:16.546939 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-fa83f532-8b84-448b-8f35-9983992b0a21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:32:16.623660 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 662/1342] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:32:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:32:16.663933 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5b3fe7-5e24-4d07-b59c-50a5941fc37b None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:32:16.666088 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-fe5b3fe7-5e24-4d07-b59c-50a5941fc37b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:32:16.702009 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5b3fe7-5e24-4d07-b59c-50a5941fc37b None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:32:16.706151 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b4f619-301c-4eca-b6ee-d66fe61dd305 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dda603ec5517460a83c333db2af804d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:32:16.706791 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b4f619-301c-4eca-b6ee-d66fe61dd305 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:32:16.707076 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b4f619-301c-4eca-b6ee-d66fe61dd305 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:32:16.707357 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b4f619-301c-4eca-b6ee-d66fe61dd305 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:32:16.716483 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b4f619-301c-4eca-b6ee-d66fe61dd305 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:32:16.717928 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b4f619-301c-4eca-b6ee-d66fe61dd305 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:32:16.727924 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 681/1343] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:32:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:32:19.887073 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c0832a-b9ea-4cc4-ae8f-0154b971b9a2 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:32:19.887603 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c0832a-b9ea-4cc4-ae8f-0154b971b9a2 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:32:19.887603 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c0832a-b9ea-4cc4-ae8f-0154b971b9a2 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:32:19.889008 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 663/1344] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:32:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:32:19.894606 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eb9494-f4f9-4fe9-8d56-3d7e38770934 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:32:19.895046 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eb9494-f4f9-4fe9-8d56-3d7e38770934 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:32:19.895144 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eb9494-f4f9-4fe9-8d56-3d7e38770934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:32:19.922755 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-93eb9494-f4f9-4fe9-8d56-3d7e38770934 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:32:19.923987 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-93eb9494-f4f9-4fe9-8d56-3d7e38770934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:32:19.931699 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 682/1345] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:32:19 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:32:19.969734 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c0832a-b9ea-4cc4-ae8f-0154b971b9a2 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:32:19.980851 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c0832a-b9ea-4cc4-ae8f-0154b971b9a2 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:32:19.984881 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fe97c4-b76b-45ac-85ce-7b35d09cf126 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dda603ec5517460a83c333db2af804d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:32:19.985469 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fe97c4-b76b-45ac-85ce-7b35d09cf126 service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:32:19.985756 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fe97c4-b76b-45ac-85ce-7b35d09cf126 service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:32:19.986036 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fe97c4-b76b-45ac-85ce-7b35d09cf126 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:32:19.995085 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fe97c4-b76b-45ac-85ce-7b35d09cf126 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:32:19.996532 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fe97c4-b76b-45ac-85ce-7b35d09cf126 service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:32:20.006473 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 664/1346] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:32:19 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:32:24.416132 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9644baea-0f28-4fd0-8aba-201dce1b8f83 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:32:24.416706 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9644baea-0f28-4fd0-8aba-201dce1b8f83 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:32:24.416706 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9644baea-0f28-4fd0-8aba-201dce1b8f83 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:32:24.418209 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 683/1347] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:32:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:32:24.423211 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e330440-97a1-49a2-be7f-82e74ed6678a None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:32:24.423627 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e330440-97a1-49a2-be7f-82e74ed6678a None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:32:24.423831 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e330440-97a1-49a2-be7f-82e74ed6678a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:32:24.441921 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-5e330440-97a1-49a2-be7f-82e74ed6678a None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:32:24.443116 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-5e330440-97a1-49a2-be7f-82e74ed6678a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:32:24.451014 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 665/1348] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:32:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:32:24.488685 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9644baea-0f28-4fd0-8aba-201dce1b8f83 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:32:24.502515 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9644baea-0f28-4fd0-8aba-201dce1b8f83 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:32:24.506047 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609de63d-faf9-4078-82ed-022b6cd555c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dda603ec5517460a83c333db2af804d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:32:24.506680 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609de63d-faf9-4078-82ed-022b6cd555c6 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:32:24.506966 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609de63d-faf9-4078-82ed-022b6cd555c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:32:24.507243 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609de63d-faf9-4078-82ed-022b6cd555c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:32:24.516653 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609de63d-faf9-4078-82ed-022b6cd555c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:32:24.518069 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609de63d-faf9-4078-82ed-022b6cd555c6 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:32:24.527512 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 684/1349] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:32:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:32:29.889279 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb582e1-de34-4fc9-ac0f-9c846ba53848 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:32:29.890124 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb582e1-de34-4fc9-ac0f-9c846ba53848 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:32:29.890600 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb582e1-de34-4fc9-ac0f-9c846ba53848 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:32:29.892395 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 666/1350] 10.222.0.86 () {54 vars in 921 bytes} [Tue Jun 7 14:32:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:32:29.897345 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f14c25f-af0b-476a-9749-db62aa04e050 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:32:29.898098 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f14c25f-af0b-476a-9749-db62aa04e050 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:32:29.898550 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f14c25f-af0b-476a-9749-db62aa04e050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:32:30.061565 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-0f14c25f-af0b-476a-9749-db62aa04e050 None None] MFA Rules not processed for user `7e042f9d4a9345bb947e6a30f64a59ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:32:30.063560 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-0f14c25f-af0b-476a-9749-db62aa04e050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:32:30.094894 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:32:30.200088 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 685/1351] 10.222.0.86 () {58 vars in 1018 bytes} [Tue Jun 7 14:32:29 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 14:32:34.436397 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=93 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:32:34.663692 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f7fc35-7c9a-4292-9ec2-b8510586f1b8 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:32:34.663990 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f7fc35-7c9a-4292-9ec2-b8510586f1b8 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:32:34.664433 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f7fc35-7c9a-4292-9ec2-b8510586f1b8 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:32:34.665807 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 667/1352] 10.222.0.86 () {54 vars in 921 bytes} [Tue Jun 7 14:32:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:32:34.671483 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06af930a-dc74-4678-8c81-4927646e1f91 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:32:34.672847 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06af930a-dc74-4678-8c81-4927646e1f91 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:32:34.673363 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06af930a-dc74-4678-8c81-4927646e1f91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:32:34.692679 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-06af930a-dc74-4678-8c81-4927646e1f91 None None] MFA Rules not processed for user `7e042f9d4a9345bb947e6a30f64a59ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:32:34.694140 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-06af930a-dc74-4678-8c81-4927646e1f91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:32:34.703718 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 686/1353] 10.222.0.86 () {58 vars in 1018 bytes} [Tue Jun 7 14:32:34 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:32:35.917503 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeb1fd6-0496-449b-970f-fbe486adccbc None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:32:35.918048 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeb1fd6-0496-449b-970f-fbe486adccbc None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:32:35.918048 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeb1fd6-0496-449b-970f-fbe486adccbc None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:32:35.919596 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 668/1354] 10.222.0.86 () {54 vars in 921 bytes} [Tue Jun 7 14:32:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:32:35.924346 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb8e0da-8fea-45e7-bf50-d7ca6d2235ad None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:32:35.924765 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb8e0da-8fea-45e7-bf50-d7ca6d2235ad None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:32:35.925045 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb8e0da-8fea-45e7-bf50-d7ca6d2235ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:32:35.943425 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-4fb8e0da-8fea-45e7-bf50-d7ca6d2235ad None None] MFA Rules not processed for user `7e042f9d4a9345bb947e6a30f64a59ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:32:35.944809 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-4fb8e0da-8fea-45e7-bf50-d7ca6d2235ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:32:35.953976 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 687/1355] 10.222.0.86 () {58 vars in 1018 bytes} [Tue Jun 7 14:32:35 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 14:32:39.811984 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f843c7c2-2d23-46a8-87fe-7aac3af57eba None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:32:39.813078 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f843c7c2-2d23-46a8-87fe-7aac3af57eba None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:32:39.813078 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f843c7c2-2d23-46a8-87fe-7aac3af57eba None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:32:39.814683 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 669/1356] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:32:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:32:39.819629 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d27bdfe-68ce-45ff-b9ba-ab2e5417dceb None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:32:39.820078 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d27bdfe-68ce-45ff-b9ba-ab2e5417dceb None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:32:39.820272 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d27bdfe-68ce-45ff-b9ba-ab2e5417dceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:32:39.838748 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-3d27bdfe-68ce-45ff-b9ba-ab2e5417dceb None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:32:39.839976 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-3d27bdfe-68ce-45ff-b9ba-ab2e5417dceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:32:39.848418 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 688/1357] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:32:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:32:39.903739 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9173596a-398c-4151-b91f-3deea6ecc191 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:32:39.904684 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9173596a-398c-4151-b91f-3deea6ecc191 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:32:39.905177 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9173596a-398c-4151-b91f-3deea6ecc191 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:32:39.907470 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 670/1358] 10.222.0.86 () {54 vars in 961 bytes} [Tue Jun 7 14:32:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:32:39.920034 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6662f8c1-614a-4a43-a22b-2451ff41e93c None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:32:39.922122 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6662f8c1-614a-4a43-a22b-2451ff41e93c None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:32:39.922122 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6662f8c1-614a-4a43-a22b-2451ff41e93c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:32:39.970741 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-6662f8c1-614a-4a43-a22b-2451ff41e93c None None] MFA Rules not processed for user `b99cfb70f54c45c8870369359da20378`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:32:39.972077 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-6662f8c1-614a-4a43-a22b-2451ff41e93c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:32:40.058970 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 689/1359] 10.222.0.86 () {58 vars in 1058 bytes} [Tue Jun 7 14:32:39 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:32:40.067597 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9173596a-398c-4151-b91f-3deea6ecc191 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:32:40.082637 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9173596a-398c-4151-b91f-3deea6ecc191 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:32:40.088103 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe88ed1-4c62-40f7-9a7b-6b24720f4aa6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99cfb70f54c45c8870369359da20378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:32:40.088732 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe88ed1-4c62-40f7-9a7b-6b24720f4aa6 service nova] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:32:40.089123 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe88ed1-4c62-40f7-9a7b-6b24720f4aa6 service nova] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:32:40.089496 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe88ed1-4c62-40f7-9a7b-6b24720f4aa6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:32:40.098135 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe88ed1-4c62-40f7-9a7b-6b24720f4aa6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:32:40.099997 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe88ed1-4c62-40f7-9a7b-6b24720f4aa6 service nova] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:32:40.110263 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 671/1360] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:32:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:32:42.581974 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6358fe7f-79f6-4375-b3ea-f1e081fb3fe2 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:32:42.582539 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6358fe7f-79f6-4375-b3ea-f1e081fb3fe2 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:32:42.582539 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6358fe7f-79f6-4375-b3ea-f1e081fb3fe2 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:32:42.584081 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 690/1361] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:32:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 07 14:32:42.589254 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d79860d-95b9-4953-acf6-781a95669295 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:32:42.589658 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d79860d-95b9-4953-acf6-781a95669295 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:32:42.589815 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d79860d-95b9-4953-acf6-781a95669295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:32:42.608562 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-0d79860d-95b9-4953-acf6-781a95669295 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:32:42.610601 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-0d79860d-95b9-4953-acf6-781a95669295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:32:42.618842 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 672/1362] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:32:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:32:42.666181 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6358fe7f-79f6-4375-b3ea-f1e081fb3fe2 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:32:42.683243 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6358fe7f-79f6-4375-b3ea-f1e081fb3fe2 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:32:42.688798 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22af168c-828c-4a9c-87c7-a746b38042f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99cfb70f54c45c8870369359da20378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:32:42.689442 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22af168c-828c-4a9c-87c7-a746b38042f0 service nova] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:32:42.689729 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22af168c-828c-4a9c-87c7-a746b38042f0 service nova] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:32:42.690005 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22af168c-828c-4a9c-87c7-a746b38042f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:32:42.698560 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22af168c-828c-4a9c-87c7-a746b38042f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:32:42.700266 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22af168c-828c-4a9c-87c7-a746b38042f0 service nova] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:32:42.711850 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 691/1363] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:32:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:32:45.397709 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed65feb-c46d-4dfd-84b6-f6d9105d84e7 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:32:45.398221 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed65feb-c46d-4dfd-84b6-f6d9105d84e7 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:32:45.398315 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed65feb-c46d-4dfd-84b6-f6d9105d84e7 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:32:45.399643 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 673/1364] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:32:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:32:45.405109 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9f7308-ff57-4957-bc07-f8018e7c82c5 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:32:45.405505 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9f7308-ff57-4957-bc07-f8018e7c82c5 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:32:45.406233 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9f7308-ff57-4957-bc07-f8018e7c82c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:32:45.432227 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-2d9f7308-ff57-4957-bc07-f8018e7c82c5 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:32:45.433440 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-2d9f7308-ff57-4957-bc07-f8018e7c82c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:32:45.449695 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 692/1365] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:32:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:32:45.498201 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddd5615-2570-45cf-a1e8-9e795b0c97c4 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:32:45.498487 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddd5615-2570-45cf-a1e8-9e795b0c97c4 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:32:45.498763 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddd5615-2570-45cf-a1e8-9e795b0c97c4 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:32:45.500382 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 674/1366] 10.222.0.86 () {54 vars in 961 bytes} [Tue Jun 7 14:32:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:32:45.505588 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7734d68-9875-4077-8526-3bc1a09c16a1 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:32:45.505872 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7734d68-9875-4077-8526-3bc1a09c16a1 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:32:45.506259 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7734d68-9875-4077-8526-3bc1a09c16a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:32:45.524186 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-c7734d68-9875-4077-8526-3bc1a09c16a1 None None] MFA Rules not processed for user `b99cfb70f54c45c8870369359da20378`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:32:45.525353 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-c7734d68-9875-4077-8526-3bc1a09c16a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:32:45.535440 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 693/1367] 10.222.0.86 () {58 vars in 1058 bytes} [Tue Jun 7 14:32:45 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:32:45.543254 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddd5615-2570-45cf-a1e8-9e795b0c97c4 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:32:45.558150 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddd5615-2570-45cf-a1e8-9e795b0c97c4 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:32:45.563539 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b2f5fd-57c8-4519-a79e-05a515110e8f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99cfb70f54c45c8870369359da20378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:32:45.564209 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b2f5fd-57c8-4519-a79e-05a515110e8f service nova] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:32:45.564495 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b2f5fd-57c8-4519-a79e-05a515110e8f service nova] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:32:45.564771 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b2f5fd-57c8-4519-a79e-05a515110e8f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:32:45.572875 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b2f5fd-57c8-4519-a79e-05a515110e8f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:32:45.574504 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b2f5fd-57c8-4519-a79e-05a515110e8f service nova] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:32:45.583926 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 675/1368] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:32:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:32:48.131726 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e03392b-2e08-42ac-a1ce-aeada9c89d72 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:32:48.132295 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e03392b-2e08-42ac-a1ce-aeada9c89d72 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:32:48.132653 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e03392b-2e08-42ac-a1ce-aeada9c89d72 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:32:48.134265 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 694/1369] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:32:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:32:48.139581 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68903f2f-99ee-4a53-bee1-34c2b124cd9e None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:32:48.140599 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68903f2f-99ee-4a53-bee1-34c2b124cd9e None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:32:48.141012 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68903f2f-99ee-4a53-bee1-34c2b124cd9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:32:48.159593 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-68903f2f-99ee-4a53-bee1-34c2b124cd9e None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:32:48.161319 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-68903f2f-99ee-4a53-bee1-34c2b124cd9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:32:48.169810 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 676/1370] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:32:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:32:48.173455 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4524aa02-0a86-490e-b748-8be219fb246f None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:32:48.173753 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4524aa02-0a86-490e-b748-8be219fb246f None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:32:48.174035 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4524aa02-0a86-490e-b748-8be219fb246f None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:32:48.175540 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 695/1371] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:32:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:32:48.180929 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adec37ce-caf3-4959-b967-f9ac00dbf534 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:32:48.181224 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adec37ce-caf3-4959-b967-f9ac00dbf534 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:32:48.181509 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adec37ce-caf3-4959-b967-f9ac00dbf534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:32:48.202122 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-adec37ce-caf3-4959-b967-f9ac00dbf534 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:32:48.204227 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-adec37ce-caf3-4959-b967-f9ac00dbf534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:32:48.212728 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 677/1372] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:32:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:32:48.217276 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4524aa02-0a86-490e-b748-8be219fb246f None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:32:48.237415 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4524aa02-0a86-490e-b748-8be219fb246f None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:32:48.243635 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33700919-a874-420b-addd-9ec47cd32627 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99cfb70f54c45c8870369359da20378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:32:48.244298 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33700919-a874-420b-addd-9ec47cd32627 service nova] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:32:48.244695 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33700919-a874-420b-addd-9ec47cd32627 service nova] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:32:48.245081 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33700919-a874-420b-addd-9ec47cd32627 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:32:48.253885 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33700919-a874-420b-addd-9ec47cd32627 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:32:48.255511 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33700919-a874-420b-addd-9ec47cd32627 service nova] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:32:48.265951 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 696/1373] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:32:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:32:48.534252 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b89181a-76c3-4656-89b0-de74b57ccf15 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:32:48.534252 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b89181a-76c3-4656-89b0-de74b57ccf15 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:32:48.534252 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b89181a-76c3-4656-89b0-de74b57ccf15 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:32:48.536523 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 678/1374] 10.222.0.86 () {54 vars in 963 bytes} [Tue Jun 7 14:32:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:32:48.541444 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e16ba50-7880-48ee-a254-cc5c7cfff8b2 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:32:48.541812 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e16ba50-7880-48ee-a254-cc5c7cfff8b2 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:32:48.542011 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e16ba50-7880-48ee-a254-cc5c7cfff8b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:32:48.562522 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:32:48.599985 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-1e16ba50-7880-48ee-a254-cc5c7cfff8b2 None None] MFA Rules not processed for user `af5a95620a4b43538abfe09eed4bf115`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:32:48.601514 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-1e16ba50-7880-48ee-a254-cc5c7cfff8b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:32:48.672027 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 697/1375] 10.222.0.86 () {58 vars in 1060 bytes} [Tue Jun 7 14:32:48 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:32:48.678350 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b89181a-76c3-4656-89b0-de74b57ccf15 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:32:48.691416 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b89181a-76c3-4656-89b0-de74b57ccf15 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:32:48.695155 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b3b2c3-0a2a-40aa-a257-9da383de26bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af5a95620a4b43538abfe09eed4bf115', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:32:48.695922 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b3b2c3-0a2a-40aa-a257-9da383de26bc service cinder] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:32:48.696213 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b3b2c3-0a2a-40aa-a257-9da383de26bc service cinder] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:32:48.696494 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b3b2c3-0a2a-40aa-a257-9da383de26bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:32:48.706837 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b3b2c3-0a2a-40aa-a257-9da383de26bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:32:48.708296 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b3b2c3-0a2a-40aa-a257-9da383de26bc service cinder] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:32:48.718872 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 679/1376] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:32:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:32:50.709659 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d232676b-75d2-4e26-a3c5-3ae0a11c9297 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:32:50.710203 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d232676b-75d2-4e26-a3c5-3ae0a11c9297 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:32:50.710203 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d232676b-75d2-4e26-a3c5-3ae0a11c9297 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:32:50.711610 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 698/1377] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:32:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:32:50.717569 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efabf6e-ef17-4ec1-9072-71e21226b562 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:32:50.718625 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efabf6e-ef17-4ec1-9072-71e21226b562 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:32:50.718717 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efabf6e-ef17-4ec1-9072-71e21226b562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:32:50.737554 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-1efabf6e-ef17-4ec1-9072-71e21226b562 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:32:50.738793 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-1efabf6e-ef17-4ec1-9072-71e21226b562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:32:50.746775 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 680/1378] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:32:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 14:32:50.792097 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d232676b-75d2-4e26-a3c5-3ae0a11c9297 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:32:50.807471 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d232676b-75d2-4e26-a3c5-3ae0a11c9297 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:32:50.813147 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca28dff5-0065-49d9-80e3-673c5e8288d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99cfb70f54c45c8870369359da20378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:32:50.813805 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca28dff5-0065-49d9-80e3-673c5e8288d1 service nova] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:32:50.814091 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca28dff5-0065-49d9-80e3-673c5e8288d1 service nova] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:32:50.814373 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca28dff5-0065-49d9-80e3-673c5e8288d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:32:50.824243 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca28dff5-0065-49d9-80e3-673c5e8288d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:32:50.825847 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca28dff5-0065-49d9-80e3-673c5e8288d1 service nova] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:32:50.836649 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 699/1379] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:32:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:32:53.246712 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2a3149-5330-4e99-a2ec-216c0a69f9e4 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:32:53.247198 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2a3149-5330-4e99-a2ec-216c0a69f9e4 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:32:53.247280 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2a3149-5330-4e99-a2ec-216c0a69f9e4 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:32:53.248642 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 681/1380] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:32:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:32:53.254640 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad77754-0073-47e5-ae38-e0e08c4359de None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:32:53.255070 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad77754-0073-47e5-ae38-e0e08c4359de None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:32:53.255198 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad77754-0073-47e5-ae38-e0e08c4359de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:32:53.273642 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-0ad77754-0073-47e5-ae38-e0e08c4359de None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:32:53.274838 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-0ad77754-0073-47e5-ae38-e0e08c4359de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:32:53.282881 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 700/1381] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:32:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:32:53.326919 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2a3149-5330-4e99-a2ec-216c0a69f9e4 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:32:53.341668 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2a3149-5330-4e99-a2ec-216c0a69f9e4 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:32:53.347410 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354d249d-7f19-41d3-915f-a0ab355bedff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99cfb70f54c45c8870369359da20378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:32:53.348078 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354d249d-7f19-41d3-915f-a0ab355bedff service nova] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:32:53.348366 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354d249d-7f19-41d3-915f-a0ab355bedff service nova] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:32:53.348642 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354d249d-7f19-41d3-915f-a0ab355bedff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:32:53.356740 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354d249d-7f19-41d3-915f-a0ab355bedff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:32:53.358307 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354d249d-7f19-41d3-915f-a0ab355bedff service nova] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:32:53.369268 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 682/1382] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:32:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:32:55.819355 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81c4b12-9ed2-4e5f-815b-28255c1dc050 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:32:55.819984 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81c4b12-9ed2-4e5f-815b-28255c1dc050 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:32:55.819984 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81c4b12-9ed2-4e5f-815b-28255c1dc050 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:32:55.821308 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 701/1383] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:32:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:32:55.826731 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e52a3c0-484f-46be-b2a1-1e05612e96d9 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:32:55.827172 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e52a3c0-484f-46be-b2a1-1e05612e96d9 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:32:55.827429 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e52a3c0-484f-46be-b2a1-1e05612e96d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:32:55.845898 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-9e52a3c0-484f-46be-b2a1-1e05612e96d9 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:32:55.847403 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-9e52a3c0-484f-46be-b2a1-1e05612e96d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:32:55.855449 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 683/1384] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:32:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:32:55.898403 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81c4b12-9ed2-4e5f-815b-28255c1dc050 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:32:55.914189 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81c4b12-9ed2-4e5f-815b-28255c1dc050 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:32:55.919949 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb5df0e-d10d-4ab1-83f1-f86058362600 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99cfb70f54c45c8870369359da20378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:32:55.920593 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb5df0e-d10d-4ab1-83f1-f86058362600 service nova] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:32:55.921439 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb5df0e-d10d-4ab1-83f1-f86058362600 service nova] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:32:55.921732 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb5df0e-d10d-4ab1-83f1-f86058362600 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:32:55.930726 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb5df0e-d10d-4ab1-83f1-f86058362600 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:32:55.932330 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb5df0e-d10d-4ab1-83f1-f86058362600 service nova] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:32:55.942378 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 702/1385] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:32:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:32:58.388066 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8915cf75-ed6b-497f-8c34-ecebf1723b6b None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:32:58.388623 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8915cf75-ed6b-497f-8c34-ecebf1723b6b None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:32:58.388731 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8915cf75-ed6b-497f-8c34-ecebf1723b6b None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:32:58.390911 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 684/1386] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:32:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:32:58.396781 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e460ce-61db-4a76-8017-84d86b26c776 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:32:58.397206 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e460ce-61db-4a76-8017-84d86b26c776 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:32:58.397369 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e460ce-61db-4a76-8017-84d86b26c776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:32:58.415303 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-28e460ce-61db-4a76-8017-84d86b26c776 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:32:58.416562 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-28e460ce-61db-4a76-8017-84d86b26c776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:32:58.424542 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 703/1387] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:32:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 14:32:58.469877 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8915cf75-ed6b-497f-8c34-ecebf1723b6b None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:32:58.487951 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8915cf75-ed6b-497f-8c34-ecebf1723b6b None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:32:58.493431 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53284a41-a1a5-4b90-b500-e60c1b1531d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99cfb70f54c45c8870369359da20378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:32:58.494062 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53284a41-a1a5-4b90-b500-e60c1b1531d5 service nova] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:32:58.494343 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53284a41-a1a5-4b90-b500-e60c1b1531d5 service nova] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:32:58.494617 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53284a41-a1a5-4b90-b500-e60c1b1531d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:32:58.503589 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53284a41-a1a5-4b90-b500-e60c1b1531d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:32:58.505187 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53284a41-a1a5-4b90-b500-e60c1b1531d5 service nova] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:32:58.515358 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 685/1388] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:32:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:33:00.956473 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab0b7a0-7798-4298-9a47-86676d19c37b None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:33:00.957008 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab0b7a0-7798-4298-9a47-86676d19c37b None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:33:00.957008 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab0b7a0-7798-4298-9a47-86676d19c37b None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:33:00.958371 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 704/1389] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:33:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:33:00.963519 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e38c9b7-51f3-4dab-87fa-04d826d807a4 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:33:00.964136 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e38c9b7-51f3-4dab-87fa-04d826d807a4 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:33:00.964136 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e38c9b7-51f3-4dab-87fa-04d826d807a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:33:00.982055 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-0e38c9b7-51f3-4dab-87fa-04d826d807a4 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:33:00.983888 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-0e38c9b7-51f3-4dab-87fa-04d826d807a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:33:00.991561 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 686/1390] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:33:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:33:01.035574 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab0b7a0-7798-4298-9a47-86676d19c37b None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:33:01.055127 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab0b7a0-7798-4298-9a47-86676d19c37b None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:33:01.062931 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbf10e1-6dae-4db1-b0c1-535166352466 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99cfb70f54c45c8870369359da20378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:33:01.064125 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbf10e1-6dae-4db1-b0c1-535166352466 service nova] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:33:01.064516 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbf10e1-6dae-4db1-b0c1-535166352466 service nova] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:33:01.064880 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbf10e1-6dae-4db1-b0c1-535166352466 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:33:01.075720 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbf10e1-6dae-4db1-b0c1-535166352466 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:33:01.077879 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbf10e1-6dae-4db1-b0c1-535166352466 service nova] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:33:01.090708 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 705/1391] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:33:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:33:03.867643 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3af47d-8a1e-4cf0-9252-4aa6c83187d1 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:33:03.868260 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3af47d-8a1e-4cf0-9252-4aa6c83187d1 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:33:03.868260 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3af47d-8a1e-4cf0-9252-4aa6c83187d1 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:33:03.869624 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 687/1392] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:33:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:33:03.875085 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56536e39-6a7d-4054-87bc-0a5014b9474f None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:33:03.875530 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56536e39-6a7d-4054-87bc-0a5014b9474f None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:33:03.875667 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56536e39-6a7d-4054-87bc-0a5014b9474f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:33:03.893938 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-56536e39-6a7d-4054-87bc-0a5014b9474f None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:33:03.898535 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-56536e39-6a7d-4054-87bc-0a5014b9474f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:33:03.903143 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 706/1393] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:33:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:33:03.947320 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3af47d-8a1e-4cf0-9252-4aa6c83187d1 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:33:03.962485 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3af47d-8a1e-4cf0-9252-4aa6c83187d1 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:33:03.968841 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644441c3-fadd-4c5d-bfe2-4ad1d0b5bc28 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99cfb70f54c45c8870369359da20378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:33:03.969476 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644441c3-fadd-4c5d-bfe2-4ad1d0b5bc28 service nova] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:33:03.969763 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644441c3-fadd-4c5d-bfe2-4ad1d0b5bc28 service nova] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:33:03.970042 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644441c3-fadd-4c5d-bfe2-4ad1d0b5bc28 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:33:03.978399 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644441c3-fadd-4c5d-bfe2-4ad1d0b5bc28 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:33:03.979993 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644441c3-fadd-4c5d-bfe2-4ad1d0b5bc28 service nova] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:33:03.989982 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 688/1394] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:33:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:33:04.951326 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae8eb81-ac4a-4b35-bd30-973d67e70bf8 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:33:04.951950 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae8eb81-ac4a-4b35-bd30-973d67e70bf8 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:33:04.952073 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae8eb81-ac4a-4b35-bd30-973d67e70bf8 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:33:04.953389 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 707/1395] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:33:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:33:04.958884 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca71e739-b82f-4993-b53a-437b9376d55b None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:33:04.959298 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca71e739-b82f-4993-b53a-437b9376d55b None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:33:04.959611 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca71e739-b82f-4993-b53a-437b9376d55b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:33:04.965591 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=55 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:33:04.978116 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-ca71e739-b82f-4993-b53a-437b9376d55b None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:33:04.979303 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-ca71e739-b82f-4993-b53a-437b9376d55b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:33:04.987696 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 689/1396] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:33:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:33:05.042481 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba507608-4138-4dcc-bbab-d84a61de3822 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:33:05.042778 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba507608-4138-4dcc-bbab-d84a61de3822 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:33:05.043064 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba507608-4138-4dcc-bbab-d84a61de3822 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:33:05.044505 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 708/1397] 10.222.0.86 () {54 vars in 962 bytes} [Tue Jun 7 14:33:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:33:05.049571 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5cf2e3-f4df-4920-a518-d108e59da929 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:33:05.049866 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5cf2e3-f4df-4920-a518-d108e59da929 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:33:05.050149 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5cf2e3-f4df-4920-a518-d108e59da929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:33:05.098394 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-ce5cf2e3-f4df-4920-a518-d108e59da929 None None] MFA Rules not processed for user `b910435e5585436996ba5b5aeb7184bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:33:05.099579 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-ce5cf2e3-f4df-4920-a518-d108e59da929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:33:05.158041 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 690/1398] 10.222.0.86 () {58 vars in 1059 bytes} [Tue Jun 7 14:33:05 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:33:05.165732 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba507608-4138-4dcc-bbab-d84a61de3822 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:33:05.177053 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba507608-4138-4dcc-bbab-d84a61de3822 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:33:05.180527 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cee9be-f430-4aba-beba-b367b7cd5777 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b910435e5585436996ba5b5aeb7184bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:33:05.181151 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cee9be-f430-4aba-beba-b367b7cd5777 service glance] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:33:05.181435 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cee9be-f430-4aba-beba-b367b7cd5777 service glance] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:33:05.181709 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cee9be-f430-4aba-beba-b367b7cd5777 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:33:05.190442 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cee9be-f430-4aba-beba-b367b7cd5777 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:33:05.191880 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cee9be-f430-4aba-beba-b367b7cd5777 service glance] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:33:05.201225 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 709/1399] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:33:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 14:33:05.878528 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee1b73e-c31d-412c-a15a-b8a39c4beb58 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:33:05.878820 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee1b73e-c31d-412c-a15a-b8a39c4beb58 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:33:05.879103 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee1b73e-c31d-412c-a15a-b8a39c4beb58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:33:05.928317 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-bee1b73e-c31d-412c-a15a-b8a39c4beb58 None None] MFA Rules not processed for user `d7b598c6a3f642ef9edc971ad3ebbe31`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:33:05.929581 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-bee1b73e-c31d-412c-a15a-b8a39c4beb58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:33:05.995077 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 691/1400] 10.222.0.86 () {58 vars in 1009 bytes} [Tue Jun 7 14:33:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:33:06.040668 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a368c53-f7e1-492a-9249-2f81cc138b26 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:33:06.041151 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a368c53-f7e1-492a-9249-2f81cc138b26 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:33:06.041249 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a368c53-f7e1-492a-9249-2f81cc138b26 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:33:06.042596 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 710/1401] 10.222.0.86 () {54 vars in 942 bytes} [Tue Jun 7 14:33:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:33:06.049655 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6833cc5-36a0-4402-a8ee-a2a1c7667bdb None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:33:06.050023 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6833cc5-36a0-4402-a8ee-a2a1c7667bdb None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:33:06.050374 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6833cc5-36a0-4402-a8ee-a2a1c7667bdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:33:06.103661 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-e6833cc5-36a0-4402-a8ee-a2a1c7667bdb None None] MFA Rules not processed for user `c9774349dd2b4ec092ef04c3df050a7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:33:06.104873 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-e6833cc5-36a0-4402-a8ee-a2a1c7667bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:33:06.118410 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:33:06.177606 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 692/1402] 10.222.0.86 () {58 vars in 1039 bytes} [Tue Jun 7 14:33:06 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:33:06.186857 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a368c53-f7e1-492a-9249-2f81cc138b26 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:33:06.200819 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a368c53-f7e1-492a-9249-2f81cc138b26 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:33:06.206334 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310d7392-3b3b-43a9-ac56-ab06ef45f381 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9774349dd2b4ec092ef04c3df050a7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:33:06.207045 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d7392-3b3b-43a9-ac56-ab06ef45f381 service swift] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:33:06.207339 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d7392-3b3b-43a9-ac56-ab06ef45f381 service swift] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:33:06.207616 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d7392-3b3b-43a9-ac56-ab06ef45f381 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:33:06.216250 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310d7392-3b3b-43a9-ac56-ab06ef45f381 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:33:06.218459 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310d7392-3b3b-43a9-ac56-ab06ef45f381 service swift] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:33:06.226931 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 711/1403] 10.222.0.86 () {60 vars in 1384 bytes} [Tue Jun 7 14:33:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 07 14:33:06.413434 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697f074e-da2d-42eb-8408-f224136528c7 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:33:06.413681 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697f074e-da2d-42eb-8408-f224136528c7 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:33:06.413967 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697f074e-da2d-42eb-8408-f224136528c7 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:33:06.415416 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 693/1404] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:33:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:33:06.421160 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055ca498-b2d3-4bbd-87b8-09e0a4bdc3ae None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:33:06.421453 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055ca498-b2d3-4bbd-87b8-09e0a4bdc3ae None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:33:06.421736 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055ca498-b2d3-4bbd-87b8-09e0a4bdc3ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:33:06.442020 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-055ca498-b2d3-4bbd-87b8-09e0a4bdc3ae None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:33:06.443277 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-055ca498-b2d3-4bbd-87b8-09e0a4bdc3ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:33:06.451323 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 712/1405] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:33:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:33:06.495456 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697f074e-da2d-42eb-8408-f224136528c7 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:33:06.510138 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697f074e-da2d-42eb-8408-f224136528c7 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:33:06.516293 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263a9aa3-c368-4cac-9b8e-0d0d037cd07b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99cfb70f54c45c8870369359da20378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:33:06.516923 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263a9aa3-c368-4cac-9b8e-0d0d037cd07b service nova] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:33:06.517204 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263a9aa3-c368-4cac-9b8e-0d0d037cd07b service nova] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:33:06.517483 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263a9aa3-c368-4cac-9b8e-0d0d037cd07b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:33:06.525545 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263a9aa3-c368-4cac-9b8e-0d0d037cd07b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:33:06.527100 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263a9aa3-c368-4cac-9b8e-0d0d037cd07b service nova] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:33:06.536664 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 694/1406] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:33:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:33:09.001455 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdb1997-daaf-4058-a12f-7b7106e05a95 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:33:09.002011 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdb1997-daaf-4058-a12f-7b7106e05a95 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:33:09.002282 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdb1997-daaf-4058-a12f-7b7106e05a95 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:33:09.004055 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 713/1407] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:33:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:33:09.013235 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df12a17d-ee19-4c58-9db1-cf93d96ad42c None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:33:09.013752 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df12a17d-ee19-4c58-9db1-cf93d96ad42c None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:33:09.013848 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df12a17d-ee19-4c58-9db1-cf93d96ad42c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:33:09.033449 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-df12a17d-ee19-4c58-9db1-cf93d96ad42c None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:33:09.034948 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-df12a17d-ee19-4c58-9db1-cf93d96ad42c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:33:09.044940 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 695/1408] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:33:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 14:33:09.090047 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdb1997-daaf-4058-a12f-7b7106e05a95 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:33:09.105324 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdb1997-daaf-4058-a12f-7b7106e05a95 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:33:09.111527 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1101fed3-fa48-4b71-b262-3911bdd80355 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99cfb70f54c45c8870369359da20378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:33:09.112199 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1101fed3-fa48-4b71-b262-3911bdd80355 service nova] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:33:09.112491 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1101fed3-fa48-4b71-b262-3911bdd80355 service nova] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:33:09.112770 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1101fed3-fa48-4b71-b262-3911bdd80355 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:33:09.121845 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1101fed3-fa48-4b71-b262-3911bdd80355 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:33:09.123497 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1101fed3-fa48-4b71-b262-3911bdd80355 service nova] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:33:09.133581 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 714/1409] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:33:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:33:19.027537 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=33 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:33:19.266472 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=81 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:33:30.817909 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec295cb2-8c7e-48f0-96e8-249f46be17b6 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:33:30.818458 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec295cb2-8c7e-48f0-96e8-249f46be17b6 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:33:30.818458 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec295cb2-8c7e-48f0-96e8-249f46be17b6 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:33:30.819873 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 696/1410] 10.222.0.86 () {54 vars in 918 bytes} [Tue Jun 7 14:33:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:33:30.824823 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7923a4f-17d0-45a4-9599-497209e7a1e5 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:33:30.825272 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7923a4f-17d0-45a4-9599-497209e7a1e5 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:33:30.825390 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7923a4f-17d0-45a4-9599-497209e7a1e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:33:30.843870 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-b7923a4f-17d0-45a4-9599-497209e7a1e5 None None] MFA Rules not processed for user `7e042f9d4a9345bb947e6a30f64a59ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:33:30.845056 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-b7923a4f-17d0-45a4-9599-497209e7a1e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:33:30.853233 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 715/1411] 10.222.0.86 () {58 vars in 1015 bytes} [Tue Jun 7 14:33:30 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:33:30.866997 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d019906c-7914-4e73-8f02-3d0d162c75d4 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:33:30.867290 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d019906c-7914-4e73-8f02-3d0d162c75d4 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:33:30.867570 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d019906c-7914-4e73-8f02-3d0d162c75d4 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:33:30.868939 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 697/1412] 10.222.0.86 () {54 vars in 918 bytes} [Tue Jun 7 14:33:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:33:30.873315 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56accc56-758f-4b0c-b1ab-2c11a680f077 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:33:30.873606 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56accc56-758f-4b0c-b1ab-2c11a680f077 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:33:30.873890 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56accc56-758f-4b0c-b1ab-2c11a680f077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:33:30.891485 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-56accc56-758f-4b0c-b1ab-2c11a680f077 None None] MFA Rules not processed for user `b99cfb70f54c45c8870369359da20378`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:33:30.892719 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-56accc56-758f-4b0c-b1ab-2c11a680f077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:33:30.901757 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 716/1413] 10.222.0.86 () {58 vars in 1015 bytes} [Tue Jun 7 14:33:30 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:33:33.572706 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0fe49d-c36f-4329-a66a-b9e49626147b None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:33:33.573262 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0fe49d-c36f-4329-a66a-b9e49626147b None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:33:33.573262 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0fe49d-c36f-4329-a66a-b9e49626147b None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:33:33.574657 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 698/1414] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 7 14:33:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:33:33.580437 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e04296-fcda-4a81-b3a5-30abd840d569 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:33:33.581153 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e04296-fcda-4a81-b3a5-30abd840d569 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:33:33.581388 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e04296-fcda-4a81-b3a5-30abd840d569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:33:33.599677 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-12e04296-fcda-4a81-b3a5-30abd840d569 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:33:33.600900 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-12e04296-fcda-4a81-b3a5-30abd840d569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:33:33.608631 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 717/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 7 14:33:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:33:33.651887 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0fe49d-c36f-4329-a66a-b9e49626147b None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:33:33.666068 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0fe49d-c36f-4329-a66a-b9e49626147b None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:33:33.673053 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a49c33-194f-476c-a51f-41e8813a984b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99cfb70f54c45c8870369359da20378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:33:33.673053 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a49c33-194f-476c-a51f-41e8813a984b service nova] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:33:33.673053 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a49c33-194f-476c-a51f-41e8813a984b service nova] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:33:33.673053 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a49c33-194f-476c-a51f-41e8813a984b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:33:33.681019 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a49c33-194f-476c-a51f-41e8813a984b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:33:33.682629 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a49c33-194f-476c-a51f-41e8813a984b service nova] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:33:33.692836 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 699/1416] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:33:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:33:34.659483 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e11e479-08df-4ea9-b0db-a54da6962e6e None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:33:34.660062 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e11e479-08df-4ea9-b0db-a54da6962e6e None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:33:34.660062 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e11e479-08df-4ea9-b0db-a54da6962e6e None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:33:34.661484 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 718/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 7 14:33:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 07 14:33:34.666302 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902a3d8e-3ba5-48e8-9d64-26a9d574270f None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:33:34.666750 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902a3d8e-3ba5-48e8-9d64-26a9d574270f None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:33:34.666855 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902a3d8e-3ba5-48e8-9d64-26a9d574270f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:33:34.685304 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-902a3d8e-3ba5-48e8-9d64-26a9d574270f None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:33:34.686501 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-902a3d8e-3ba5-48e8-9d64-26a9d574270f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:33:34.694138 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 700/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 7 14:33:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:33:34.860617 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e11e479-08df-4ea9-b0db-a54da6962e6e None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:33:34.874707 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e11e479-08df-4ea9-b0db-a54da6962e6e None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:33:34.880011 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5c76fb-4c6b-403f-a5ac-8f732e0734d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99cfb70f54c45c8870369359da20378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:33:34.884078 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5c76fb-4c6b-403f-a5ac-8f732e0734d0 service nova] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:33:34.884078 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5c76fb-4c6b-403f-a5ac-8f732e0734d0 service nova] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:33:34.884078 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5c76fb-4c6b-403f-a5ac-8f732e0734d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:33:34.889771 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5c76fb-4c6b-403f-a5ac-8f732e0734d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:33:34.891340 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5c76fb-4c6b-403f-a5ac-8f732e0734d0 service nova] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:33:34.900705 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 719/1419] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:33:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:33:35.812131 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52da5b62-6eef-4b39-9bf1-240b0c7a1562 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:33:35.812597 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52da5b62-6eef-4b39-9bf1-240b0c7a1562 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:33:35.812713 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52da5b62-6eef-4b39-9bf1-240b0c7a1562 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:33:35.814033 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 701/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 7 14:33:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:33:35.818902 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15028a3-3482-4234-92fc-9e70cf2a5a79 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:33:35.824546 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15028a3-3482-4234-92fc-9e70cf2a5a79 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:33:35.824546 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15028a3-3482-4234-92fc-9e70cf2a5a79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:33:35.837936 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-f15028a3-3482-4234-92fc-9e70cf2a5a79 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:33:35.839134 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-f15028a3-3482-4234-92fc-9e70cf2a5a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:33:35.847460 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 720/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 7 14:33:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:33:35.998287 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52da5b62-6eef-4b39-9bf1-240b0c7a1562 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:33:36.012291 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52da5b62-6eef-4b39-9bf1-240b0c7a1562 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:33:36.018449 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eac20e2-9486-4f06-83c5-4c874a1bbd6e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99cfb70f54c45c8870369359da20378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:33:36.019207 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac20e2-9486-4f06-83c5-4c874a1bbd6e service nova] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:33:36.019492 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac20e2-9486-4f06-83c5-4c874a1bbd6e service nova] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:33:36.020973 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac20e2-9486-4f06-83c5-4c874a1bbd6e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:33:36.036378 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eac20e2-9486-4f06-83c5-4c874a1bbd6e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:33:36.036378 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eac20e2-9486-4f06-83c5-4c874a1bbd6e service nova] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:33:36.039453 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 702/1422] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:33:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:33:36.937089 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34f501e-4d26-4d91-b012-91e034100cb9 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:33:36.937746 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34f501e-4d26-4d91-b012-91e034100cb9 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:33:36.937746 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34f501e-4d26-4d91-b012-91e034100cb9 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:33:36.939025 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 721/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 7 14:33:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 07 14:33:36.943920 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a6c802-7d07-4ffd-873f-6b7f39bc3ad7 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:33:36.944340 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a6c802-7d07-4ffd-873f-6b7f39bc3ad7 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:33:36.944504 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a6c802-7d07-4ffd-873f-6b7f39bc3ad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:33:36.962336 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-05a6c802-7d07-4ffd-873f-6b7f39bc3ad7 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:33:36.963522 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-05a6c802-7d07-4ffd-873f-6b7f39bc3ad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:33:36.971779 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 703/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 7 14:33:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:33:37.121118 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34f501e-4d26-4d91-b012-91e034100cb9 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:33:37.134950 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34f501e-4d26-4d91-b012-91e034100cb9 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:33:37.140770 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da185faa-757c-4e74-9702-92fb910fdf0d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99cfb70f54c45c8870369359da20378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:33:37.141398 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da185faa-757c-4e74-9702-92fb910fdf0d service nova] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:33:37.141680 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da185faa-757c-4e74-9702-92fb910fdf0d service nova] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:33:37.141953 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da185faa-757c-4e74-9702-92fb910fdf0d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:33:37.149867 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da185faa-757c-4e74-9702-92fb910fdf0d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:33:37.151419 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da185faa-757c-4e74-9702-92fb910fdf0d service nova] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:33:37.161449 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 722/1425] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:33:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:33:38.055936 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd62ce5-7204-4515-8720-406c6f07bb36 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:33:38.056487 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd62ce5-7204-4515-8720-406c6f07bb36 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:33:38.056487 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd62ce5-7204-4515-8720-406c6f07bb36 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:33:38.057825 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 704/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 7 14:33:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:33:38.062652 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae864f4-b1e3-49b1-a2d1-bfe578327f68 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:33:38.063055 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae864f4-b1e3-49b1-a2d1-bfe578327f68 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:33:38.063208 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae864f4-b1e3-49b1-a2d1-bfe578327f68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:33:38.080981 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-1ae864f4-b1e3-49b1-a2d1-bfe578327f68 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:33:38.082181 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-1ae864f4-b1e3-49b1-a2d1-bfe578327f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:33:38.089941 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 723/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 7 14:33:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:33:38.239292 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd62ce5-7204-4515-8720-406c6f07bb36 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:33:38.253473 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd62ce5-7204-4515-8720-406c6f07bb36 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:33:38.258800 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41146d6-8c83-43b7-a2a5-88b5888307e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99cfb70f54c45c8870369359da20378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:33:38.259431 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41146d6-8c83-43b7-a2a5-88b5888307e2 service nova] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:33:38.259717 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41146d6-8c83-43b7-a2a5-88b5888307e2 service nova] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:33:38.260026 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41146d6-8c83-43b7-a2a5-88b5888307e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:33:38.268261 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41146d6-8c83-43b7-a2a5-88b5888307e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:33:38.269892 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41146d6-8c83-43b7-a2a5-88b5888307e2 service nova] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:33:38.279587 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 705/1428] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:33:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:33:39.191683 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b6476c-9aa3-4a62-891f-67451c7ac33d None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:33:39.192256 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b6476c-9aa3-4a62-891f-67451c7ac33d None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:33:39.192256 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b6476c-9aa3-4a62-891f-67451c7ac33d None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:33:39.193688 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 724/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 7 14:33:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:33:39.198651 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa15cf5c-7e5e-4ab8-a2e5-0ad9766f2527 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:33:39.199057 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa15cf5c-7e5e-4ab8-a2e5-0ad9766f2527 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:33:39.199221 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa15cf5c-7e5e-4ab8-a2e5-0ad9766f2527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:33:39.216775 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-aa15cf5c-7e5e-4ab8-a2e5-0ad9766f2527 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:33:39.217978 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-aa15cf5c-7e5e-4ab8-a2e5-0ad9766f2527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:33:39.225902 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 706/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 7 14:33:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:33:39.375080 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b6476c-9aa3-4a62-891f-67451c7ac33d None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:33:39.389212 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b6476c-9aa3-4a62-891f-67451c7ac33d None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:33:39.394528 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23736fd-d4eb-4378-a120-bd80241438ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99cfb70f54c45c8870369359da20378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:33:39.395207 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23736fd-d4eb-4378-a120-bd80241438ff service nova] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:33:39.395489 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23736fd-d4eb-4378-a120-bd80241438ff service nova] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:33:39.395787 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23736fd-d4eb-4378-a120-bd80241438ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:33:39.404308 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23736fd-d4eb-4378-a120-bd80241438ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:33:39.405865 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23736fd-d4eb-4378-a120-bd80241438ff service nova] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:33:39.415263 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 725/1431] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:33:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:33:40.358070 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a80c5cd-ef5f-4320-bef0-759586b17a25 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:33:40.358552 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a80c5cd-ef5f-4320-bef0-759586b17a25 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:33:40.358688 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a80c5cd-ef5f-4320-bef0-759586b17a25 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:33:40.360016 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 707/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 7 14:33:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:33:40.365060 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499ca2d7-65c8-43ec-a615-8cdf70a547da None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:33:40.365506 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499ca2d7-65c8-43ec-a615-8cdf70a547da None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:33:40.365617 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499ca2d7-65c8-43ec-a615-8cdf70a547da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:33:40.383994 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-499ca2d7-65c8-43ec-a615-8cdf70a547da None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:33:40.385182 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-499ca2d7-65c8-43ec-a615-8cdf70a547da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:33:40.393522 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 726/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 7 14:33:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:33:40.541718 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a80c5cd-ef5f-4320-bef0-759586b17a25 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:33:40.556086 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a80c5cd-ef5f-4320-bef0-759586b17a25 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:33:40.561943 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd13aecc-e93c-473f-be4a-7fd5725fb739 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99cfb70f54c45c8870369359da20378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:33:40.562564 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd13aecc-e93c-473f-be4a-7fd5725fb739 service nova] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:33:40.562845 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd13aecc-e93c-473f-be4a-7fd5725fb739 service nova] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:33:40.563120 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd13aecc-e93c-473f-be4a-7fd5725fb739 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:33:40.570938 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd13aecc-e93c-473f-be4a-7fd5725fb739 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:33:40.572517 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd13aecc-e93c-473f-be4a-7fd5725fb739 service nova] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:33:40.581641 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 708/1434] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:33:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:33:41.482849 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c4ad9c-05c5-413d-9fd2-4b46f0fb821d None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:33:41.483362 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c4ad9c-05c5-413d-9fd2-4b46f0fb821d None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:33:41.483362 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c4ad9c-05c5-413d-9fd2-4b46f0fb821d None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:33:41.484771 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 727/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 7 14:33:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:33:41.489791 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bff27d-2a9c-48d1-9d7a-1b41e064b875 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:33:41.490203 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bff27d-2a9c-48d1-9d7a-1b41e064b875 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:33:41.490343 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bff27d-2a9c-48d1-9d7a-1b41e064b875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:33:41.508318 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-e6bff27d-2a9c-48d1-9d7a-1b41e064b875 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:33:41.509560 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-e6bff27d-2a9c-48d1-9d7a-1b41e064b875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:33:41.518130 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 709/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 7 14:33:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:33:41.668725 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c4ad9c-05c5-413d-9fd2-4b46f0fb821d None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:33:41.683015 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c4ad9c-05c5-413d-9fd2-4b46f0fb821d None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:33:41.688928 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa482ee6-bc14-42b6-96ca-1d8aa53843c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99cfb70f54c45c8870369359da20378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:33:41.689690 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa482ee6-bc14-42b6-96ca-1d8aa53843c5 service nova] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:33:41.689911 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa482ee6-bc14-42b6-96ca-1d8aa53843c5 service nova] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:33:41.690188 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa482ee6-bc14-42b6-96ca-1d8aa53843c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:33:41.698736 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa482ee6-bc14-42b6-96ca-1d8aa53843c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:33:41.701004 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa482ee6-bc14-42b6-96ca-1d8aa53843c5 service nova] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:33:41.710433 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 728/1437] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:33:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:33:42.602862 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c092d2-a222-441f-a3e0-30f876d4f363 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:33:42.603399 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c092d2-a222-441f-a3e0-30f876d4f363 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:33:42.603497 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c092d2-a222-441f-a3e0-30f876d4f363 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:33:42.604866 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 710/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 7 14:33:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:33:42.610266 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422a9a85-61d9-4a4c-a57e-35dd4fa8892e None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:33:42.610684 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422a9a85-61d9-4a4c-a57e-35dd4fa8892e None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:33:42.610862 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422a9a85-61d9-4a4c-a57e-35dd4fa8892e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:33:42.628387 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-422a9a85-61d9-4a4c-a57e-35dd4fa8892e None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:33:42.637927 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-422a9a85-61d9-4a4c-a57e-35dd4fa8892e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:33:42.637927 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 729/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 7 14:33:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:33:42.784301 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c092d2-a222-441f-a3e0-30f876d4f363 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:33:42.798757 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c092d2-a222-441f-a3e0-30f876d4f363 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:33:42.804051 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d232be44-ac75-49cc-a0f4-5a0b3271a56c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99cfb70f54c45c8870369359da20378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:33:42.804705 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d232be44-ac75-49cc-a0f4-5a0b3271a56c service nova] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:33:42.804987 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d232be44-ac75-49cc-a0f4-5a0b3271a56c service nova] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:33:42.805262 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d232be44-ac75-49cc-a0f4-5a0b3271a56c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:33:42.813215 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d232be44-ac75-49cc-a0f4-5a0b3271a56c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:33:42.814779 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d232be44-ac75-49cc-a0f4-5a0b3271a56c service nova] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:33:42.824004 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 711/1440] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:33:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:33:44.903679 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced0d5f1-1e6c-4645-a3da-73b446387e9e None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:33:44.904251 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced0d5f1-1e6c-4645-a3da-73b446387e9e None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:33:44.904251 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced0d5f1-1e6c-4645-a3da-73b446387e9e None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:33:44.905687 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 730/1441] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 7 14:33:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:33:44.911139 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f17aab-8099-4247-9486-51a5a6b30c91 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:33:44.911570 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f17aab-8099-4247-9486-51a5a6b30c91 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:33:44.911700 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f17aab-8099-4247-9486-51a5a6b30c91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:33:44.929480 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-93f17aab-8099-4247-9486-51a5a6b30c91 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:33:44.930670 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-93f17aab-8099-4247-9486-51a5a6b30c91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:33:44.938380 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 712/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 7 14:33:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:33:44.976260 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced0d5f1-1e6c-4645-a3da-73b446387e9e None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:33:44.987833 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced0d5f1-1e6c-4645-a3da-73b446387e9e None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:33:44.991320 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306f7d16-7f78-43b2-86fe-6b1c24b7f9b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dda603ec5517460a83c333db2af804d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:33:44.991990 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306f7d16-7f78-43b2-86fe-6b1c24b7f9b9 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:33:44.992280 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306f7d16-7f78-43b2-86fe-6b1c24b7f9b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:33:44.992558 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306f7d16-7f78-43b2-86fe-6b1c24b7f9b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:33:45.001565 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306f7d16-7f78-43b2-86fe-6b1c24b7f9b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:33:45.002998 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306f7d16-7f78-43b2-86fe-6b1c24b7f9b9 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:33:45.012312 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 731/1443] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:33:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:33:47.405057 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29c2494-45b6-4df6-a241-dd62c687a102 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:33:47.405598 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29c2494-45b6-4df6-a241-dd62c687a102 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:33:47.405598 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29c2494-45b6-4df6-a241-dd62c687a102 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:33:47.407037 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 713/1444] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 7 14:33:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:33:47.412724 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4416c08-a7df-421f-9986-d2bbf9c316b2 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:33:47.413160 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4416c08-a7df-421f-9986-d2bbf9c316b2 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:33:47.413300 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4416c08-a7df-421f-9986-d2bbf9c316b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:33:47.431331 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-d4416c08-a7df-421f-9986-d2bbf9c316b2 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:33:47.432569 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-d4416c08-a7df-421f-9986-d2bbf9c316b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:33:47.440837 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 732/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 7 14:33:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:33:47.477681 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29c2494-45b6-4df6-a241-dd62c687a102 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:33:47.488626 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29c2494-45b6-4df6-a241-dd62c687a102 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:33:47.492214 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592f9d43-8d51-4ecb-b1f5-a68b8587e29c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dda603ec5517460a83c333db2af804d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:33:47.492843 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592f9d43-8d51-4ecb-b1f5-a68b8587e29c service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:33:47.493121 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592f9d43-8d51-4ecb-b1f5-a68b8587e29c service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:33:47.493393 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592f9d43-8d51-4ecb-b1f5-a68b8587e29c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:33:47.502849 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592f9d43-8d51-4ecb-b1f5-a68b8587e29c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:33:47.504295 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592f9d43-8d51-4ecb-b1f5-a68b8587e29c service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:33:47.513458 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 714/1446] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:33:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:33:50.095606 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbf8460-57ef-4dc3-8662-7eac98d1ebb7 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:33:50.096248 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbf8460-57ef-4dc3-8662-7eac98d1ebb7 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:33:50.096248 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbf8460-57ef-4dc3-8662-7eac98d1ebb7 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:33:50.097495 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 733/1447] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 7 14:33:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:33:50.102980 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3aaf96-7ff5-482f-9a2c-792e32b5295e None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:33:50.103430 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3aaf96-7ff5-482f-9a2c-792e32b5295e None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:33:50.103561 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3aaf96-7ff5-482f-9a2c-792e32b5295e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:33:50.121596 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-0e3aaf96-7ff5-482f-9a2c-792e32b5295e None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:33:50.122799 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-0e3aaf96-7ff5-482f-9a2c-792e32b5295e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:33:50.130579 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 715/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 7 14:33:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:33:50.171767 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbf8460-57ef-4dc3-8662-7eac98d1ebb7 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:33:50.182320 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbf8460-57ef-4dc3-8662-7eac98d1ebb7 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:33:50.185881 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ead1b1-7e5d-46cf-8bf7-36c8d4e09061 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dda603ec5517460a83c333db2af804d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:33:50.186507 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ead1b1-7e5d-46cf-8bf7-36c8d4e09061 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:33:50.186795 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ead1b1-7e5d-46cf-8bf7-36c8d4e09061 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:33:50.187076 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ead1b1-7e5d-46cf-8bf7-36c8d4e09061 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:33:50.195866 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ead1b1-7e5d-46cf-8bf7-36c8d4e09061 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:33:50.197292 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ead1b1-7e5d-46cf-8bf7-36c8d4e09061 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:33:50.206891 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 734/1449] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:33:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:33:52.553982 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f587155f-145b-4b85-a56d-e54d39b77f6e None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:33:52.554556 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f587155f-145b-4b85-a56d-e54d39b77f6e None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:33:52.554556 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f587155f-145b-4b85-a56d-e54d39b77f6e None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:33:52.555948 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 716/1450] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 7 14:33:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:33:52.561140 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5357a3ca-3733-45ee-8d76-a53525ed18fa None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:33:52.561554 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5357a3ca-3733-45ee-8d76-a53525ed18fa None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:33:52.561700 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5357a3ca-3733-45ee-8d76-a53525ed18fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:33:52.579533 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-5357a3ca-3733-45ee-8d76-a53525ed18fa None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:33:52.580751 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-5357a3ca-3733-45ee-8d76-a53525ed18fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:33:52.588489 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 735/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 7 14:33:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:33:52.626694 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f587155f-145b-4b85-a56d-e54d39b77f6e None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:33:52.637102 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f587155f-145b-4b85-a56d-e54d39b77f6e None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:33:52.641002 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f3b285-5f97-4529-be67-f4843aacaa52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dda603ec5517460a83c333db2af804d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:33:52.641620 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f3b285-5f97-4529-be67-f4843aacaa52 service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:33:52.641899 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f3b285-5f97-4529-be67-f4843aacaa52 service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:33:52.642177 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f3b285-5f97-4529-be67-f4843aacaa52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:33:52.650699 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f3b285-5f97-4529-be67-f4843aacaa52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:33:52.652147 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f3b285-5f97-4529-be67-f4843aacaa52 service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:33:52.662267 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 717/1452] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:33:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:33:54.925639 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36616e2-8a93-49a4-a081-b30fcf095e53 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:33:54.926207 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36616e2-8a93-49a4-a081-b30fcf095e53 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:33:54.926207 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36616e2-8a93-49a4-a081-b30fcf095e53 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:33:54.927571 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 736/1453] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 7 14:33:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:33:54.932765 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5f85db-6a48-48f8-860c-a41872bc5048 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:33:54.933176 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5f85db-6a48-48f8-860c-a41872bc5048 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:33:54.933404 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5f85db-6a48-48f8-860c-a41872bc5048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:33:54.951302 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-1b5f85db-6a48-48f8-860c-a41872bc5048 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:33:54.952559 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-1b5f85db-6a48-48f8-860c-a41872bc5048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:33:54.960305 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 718/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 7 14:33:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:33:54.997926 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36616e2-8a93-49a4-a081-b30fcf095e53 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:33:55.008475 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36616e2-8a93-49a4-a081-b30fcf095e53 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:33:55.012015 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7814793-7bf7-4480-977d-424d26ef0310 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dda603ec5517460a83c333db2af804d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:33:55.013168 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7814793-7bf7-4480-977d-424d26ef0310 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:33:55.013456 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7814793-7bf7-4480-977d-424d26ef0310 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:33:55.013734 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7814793-7bf7-4480-977d-424d26ef0310 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:33:55.022447 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7814793-7bf7-4480-977d-424d26ef0310 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:33:55.023877 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7814793-7bf7-4480-977d-424d26ef0310 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:33:55.033969 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 737/1455] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:33:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:33:57.314040 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5880da39-f73a-4938-a447-938807161f3d None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:33:57.314599 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5880da39-f73a-4938-a447-938807161f3d None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:33:57.314599 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5880da39-f73a-4938-a447-938807161f3d None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:33:57.316006 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 719/1456] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 7 14:33:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:33:57.321202 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70a08de-a1d8-4fb7-9fd7-94cb7b7bc62b None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:33:57.321740 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70a08de-a1d8-4fb7-9fd7-94cb7b7bc62b None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:33:57.321740 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70a08de-a1d8-4fb7-9fd7-94cb7b7bc62b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:33:57.339597 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-e70a08de-a1d8-4fb7-9fd7-94cb7b7bc62b None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:33:57.341412 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-e70a08de-a1d8-4fb7-9fd7-94cb7b7bc62b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:33:57.349204 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 738/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 7 14:33:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:33:57.386183 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5880da39-f73a-4938-a447-938807161f3d None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:33:57.397445 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5880da39-f73a-4938-a447-938807161f3d None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:33:57.400944 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4ccc2e-a4d6-4c3b-a257-8ebf5a345755 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dda603ec5517460a83c333db2af804d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:33:57.401574 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4ccc2e-a4d6-4c3b-a257-8ebf5a345755 service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:33:57.401862 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4ccc2e-a4d6-4c3b-a257-8ebf5a345755 service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:33:57.402144 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4ccc2e-a4d6-4c3b-a257-8ebf5a345755 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:33:57.412015 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4ccc2e-a4d6-4c3b-a257-8ebf5a345755 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:33:57.413440 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4ccc2e-a4d6-4c3b-a257-8ebf5a345755 service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:33:57.422675 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 720/1458] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:33:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:33:59.673983 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed84c14-5710-4072-b935-a2a230328146 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:33:59.674545 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed84c14-5710-4072-b935-a2a230328146 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:33:59.674545 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed84c14-5710-4072-b935-a2a230328146 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:33:59.675985 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 739/1459] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 7 14:33:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:33:59.681407 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e756d78-a238-45d7-b95c-ac3cd279688e None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:33:59.681841 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e756d78-a238-45d7-b95c-ac3cd279688e None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:33:59.681980 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e756d78-a238-45d7-b95c-ac3cd279688e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:33:59.688229 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=70 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:33:59.700099 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-7e756d78-a238-45d7-b95c-ac3cd279688e None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:33:59.701330 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-7e756d78-a238-45d7-b95c-ac3cd279688e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:33:59.709100 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 721/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 7 14:33:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:33:59.747477 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed84c14-5710-4072-b935-a2a230328146 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:33:59.749159 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-1ed84c14-5710-4072-b935-a2a230328146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:33:59.756866 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=73 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:33:59.762569 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed84c14-5710-4072-b935-a2a230328146 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:33:59.766119 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd33cc2-2c48-4db0-93f5-b86bf2b26eef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dda603ec5517460a83c333db2af804d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:33:59.766758 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd33cc2-2c48-4db0-93f5-b86bf2b26eef service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:33:59.767045 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd33cc2-2c48-4db0-93f5-b86bf2b26eef service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:33:59.767325 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd33cc2-2c48-4db0-93f5-b86bf2b26eef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:33:59.776175 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd33cc2-2c48-4db0-93f5-b86bf2b26eef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:33:59.778080 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd33cc2-2c48-4db0-93f5-b86bf2b26eef service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:33:59.787578 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 740/1461] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:33:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:34:02.065692 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d462f2fa-68fb-47e6-9d2c-c175cdefb1f8 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:34:02.066229 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d462f2fa-68fb-47e6-9d2c-c175cdefb1f8 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:34:02.066229 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d462f2fa-68fb-47e6-9d2c-c175cdefb1f8 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:34:02.067567 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 722/1462] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 7 14:34:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:34:02.072753 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd4324-0874-4eb4-a094-51f8ae5240ce None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:34:02.073201 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd4324-0874-4eb4-a094-51f8ae5240ce None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:34:02.073315 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd4324-0874-4eb4-a094-51f8ae5240ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:34:02.091155 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-bcdd4324-0874-4eb4-a094-51f8ae5240ce None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:34:02.092361 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-bcdd4324-0874-4eb4-a094-51f8ae5240ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:34:02.100158 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 741/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 7 14:34:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:34:02.137319 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d462f2fa-68fb-47e6-9d2c-c175cdefb1f8 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:34:02.147798 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d462f2fa-68fb-47e6-9d2c-c175cdefb1f8 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:34:02.151244 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa544fd2-4a9d-43ee-ad4a-9bffe109aaf5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dda603ec5517460a83c333db2af804d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:34:02.151910 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa544fd2-4a9d-43ee-ad4a-9bffe109aaf5 service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:34:02.152201 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa544fd2-4a9d-43ee-ad4a-9bffe109aaf5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:34:02.152969 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa544fd2-4a9d-43ee-ad4a-9bffe109aaf5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:34:02.162099 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa544fd2-4a9d-43ee-ad4a-9bffe109aaf5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:34:02.163511 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa544fd2-4a9d-43ee-ad4a-9bffe109aaf5 service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:34:02.173430 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 723/1464] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:34:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:34:04.419613 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5cbac3-d7e9-4d3f-8b03-bab72fb161e0 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:34:04.420202 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5cbac3-d7e9-4d3f-8b03-bab72fb161e0 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:34:04.420202 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5cbac3-d7e9-4d3f-8b03-bab72fb161e0 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:34:04.421552 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 742/1465] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 7 14:34:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:34:04.426736 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b663c8-df81-4931-b713-9fac09a96ab5 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:34:04.427155 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b663c8-df81-4931-b713-9fac09a96ab5 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:34:04.427295 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b663c8-df81-4931-b713-9fac09a96ab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:34:04.444622 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-98b663c8-df81-4931-b713-9fac09a96ab5 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:34:04.445854 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-98b663c8-df81-4931-b713-9fac09a96ab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:34:04.453503 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 724/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 7 14:34:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:34:04.489535 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5cbac3-d7e9-4d3f-8b03-bab72fb161e0 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:34:04.500120 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5cbac3-d7e9-4d3f-8b03-bab72fb161e0 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:34:04.503567 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985aa42b-caf6-4f47-8d92-de7d716d1e14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dda603ec5517460a83c333db2af804d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:34:04.504251 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985aa42b-caf6-4f47-8d92-de7d716d1e14 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:34:04.504537 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985aa42b-caf6-4f47-8d92-de7d716d1e14 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:34:04.504815 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985aa42b-caf6-4f47-8d92-de7d716d1e14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:34:04.513469 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985aa42b-caf6-4f47-8d92-de7d716d1e14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:34:04.514876 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985aa42b-caf6-4f47-8d92-de7d716d1e14 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:34:04.524283 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 743/1467] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:34:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:34:06.806319 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1515c7a4-f310-4d0e-b02f-8b0d11922c20 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:34:06.806896 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1515c7a4-f310-4d0e-b02f-8b0d11922c20 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:34:06.806896 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1515c7a4-f310-4d0e-b02f-8b0d11922c20 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:34:06.808266 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 725/1468] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 7 14:34:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:34:06.814039 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2374aa10-187d-4c10-b782-30489e40478d None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:34:06.814478 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2374aa10-187d-4c10-b782-30489e40478d None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:34:06.814596 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2374aa10-187d-4c10-b782-30489e40478d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:34:06.831856 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-2374aa10-187d-4c10-b782-30489e40478d None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:34:06.833036 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-2374aa10-187d-4c10-b782-30489e40478d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:34:06.840705 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 744/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 7 14:34:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:34:06.877239 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1515c7a4-f310-4d0e-b02f-8b0d11922c20 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:34:06.887601 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1515c7a4-f310-4d0e-b02f-8b0d11922c20 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:34:06.891095 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9b5800-77fe-461f-bb01-1f215b046639 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dda603ec5517460a83c333db2af804d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:34:06.891714 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9b5800-77fe-461f-bb01-1f215b046639 service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:34:06.892023 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9b5800-77fe-461f-bb01-1f215b046639 service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:34:06.892298 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9b5800-77fe-461f-bb01-1f215b046639 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:34:06.900915 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9b5800-77fe-461f-bb01-1f215b046639 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:34:06.902327 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9b5800-77fe-461f-bb01-1f215b046639 service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:34:06.911546 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 726/1470] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:34:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:34:16.826830 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=17 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:34:16.907305 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=17 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:34:38.605809 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ef991c-fac6-455f-9038-80be17129a8d None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:34:38.606403 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ef991c-fac6-455f-9038-80be17129a8d None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:34:38.606403 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ef991c-fac6-455f-9038-80be17129a8d None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:34:38.607792 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 745/1471] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:34:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:34:38.612964 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f015fd5d-8d2a-42de-a65b-52e05390b3cc None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:34:38.613451 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f015fd5d-8d2a-42de-a65b-52e05390b3cc None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:34:38.613560 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f015fd5d-8d2a-42de-a65b-52e05390b3cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:34:38.633718 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-f015fd5d-8d2a-42de-a65b-52e05390b3cc None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:34:38.634961 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-f015fd5d-8d2a-42de-a65b-52e05390b3cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:34:38.644250 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 727/1472] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:34:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:34:38.692316 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314f1b2f-7118-4a56-a429-fa89ac6e3ec7 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:34:38.692609 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314f1b2f-7118-4a56-a429-fa89ac6e3ec7 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:34:38.692918 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314f1b2f-7118-4a56-a429-fa89ac6e3ec7 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:34:38.694281 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 746/1473] 10.222.0.86 () {54 vars in 962 bytes} [Tue Jun 7 14:34:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:34:38.699717 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf051c97-cf09-4459-baa5-425bcdd72543 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:34:38.700064 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf051c97-cf09-4459-baa5-425bcdd72543 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:34:38.700367 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf051c97-cf09-4459-baa5-425bcdd72543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:34:38.718116 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-bf051c97-cf09-4459-baa5-425bcdd72543 None None] MFA Rules not processed for user `b910435e5585436996ba5b5aeb7184bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:34:38.719332 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-bf051c97-cf09-4459-baa5-425bcdd72543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:34:38.725905 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 728/1474] 10.222.0.86 () {58 vars in 1059 bytes} [Tue Jun 7 14:34:38 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:34:38.733309 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314f1b2f-7118-4a56-a429-fa89ac6e3ec7 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:34:38.744175 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314f1b2f-7118-4a56-a429-fa89ac6e3ec7 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:34:38.748282 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16b4cc1-9703-4b03-8058-9db79d4a9914 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b910435e5585436996ba5b5aeb7184bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:34:38.748936 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16b4cc1-9703-4b03-8058-9db79d4a9914 service glance] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:34:38.749222 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16b4cc1-9703-4b03-8058-9db79d4a9914 service glance] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:34:38.749503 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16b4cc1-9703-4b03-8058-9db79d4a9914 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:34:38.758391 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16b4cc1-9703-4b03-8058-9db79d4a9914 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:34:38.759889 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16b4cc1-9703-4b03-8058-9db79d4a9914 service glance] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:34:38.770049 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 747/1475] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:34:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:34:41.162993 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a62fd47-c80c-4ac8-910e-fd6a411fcca6 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:34:41.163553 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a62fd47-c80c-4ac8-910e-fd6a411fcca6 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:34:41.163553 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a62fd47-c80c-4ac8-910e-fd6a411fcca6 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:34:41.164963 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 729/1476] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:34:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:34:41.171079 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87890a3a-6d9a-4778-9c9f-64bc2aac3f76 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:34:41.171512 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87890a3a-6d9a-4778-9c9f-64bc2aac3f76 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:34:41.171620 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87890a3a-6d9a-4778-9c9f-64bc2aac3f76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:34:41.188987 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-87890a3a-6d9a-4778-9c9f-64bc2aac3f76 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:34:41.190170 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-87890a3a-6d9a-4778-9c9f-64bc2aac3f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:34:41.197899 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 748/1477] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:34:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:34:41.221521 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a62fd47-c80c-4ac8-910e-fd6a411fcca6 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:34:41.234754 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a62fd47-c80c-4ac8-910e-fd6a411fcca6 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:34:41.239113 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0a6078-eaf4-460c-8b1f-2a3eb9a02ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:34:41.239879 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0a6078-eaf4-460c-8b1f-2a3eb9a02ec2 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:34:41.240163 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0a6078-eaf4-460c-8b1f-2a3eb9a02ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:34:41.240434 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0a6078-eaf4-460c-8b1f-2a3eb9a02ec2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:34:41.241158 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0a6078-eaf4-460c-8b1f-2a3eb9a02ec2 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:34:41.242884 dv-cinder-844974-1-smb devstack@keystone.service[80418]: WARNING py.warnings [None req-ef0a6078-eaf4-460c-8b1f-2a3eb9a02ec2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 07 14:34:41.242884 dv-cinder-844974-1-smb devstack@keystone.service[80418]: warnings.warn(msg) Jun 07 14:34:41.242884 dv-cinder-844974-1-smb devstack@keystone.service[80418]: Jun 07 14:34:41.244058 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0a6078-eaf4-460c-8b1f-2a3eb9a02ec2 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:34:41.262690 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 730/1478] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jun 7 14:34:41 2022] GET /identity/v3/projects => generated 2553 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:34:43.619107 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b987311-653e-4091-8917-dbe40621e89a None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:34:43.619744 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b987311-653e-4091-8917-dbe40621e89a None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:34:43.619744 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b987311-653e-4091-8917-dbe40621e89a None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:34:43.621094 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 749/1479] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:34:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:34:43.626452 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89508ccf-ec26-4c0c-8512-4f3faf52cf18 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:34:43.628697 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89508ccf-ec26-4c0c-8512-4f3faf52cf18 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:34:43.628697 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89508ccf-ec26-4c0c-8512-4f3faf52cf18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:34:43.646448 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-89508ccf-ec26-4c0c-8512-4f3faf52cf18 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:34:43.647674 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-89508ccf-ec26-4c0c-8512-4f3faf52cf18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:34:43.656369 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 731/1480] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:34:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:34:43.702686 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b987311-653e-4091-8917-dbe40621e89a None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:34:43.717455 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b987311-653e-4091-8917-dbe40621e89a None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:34:43.723513 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1972e8c-121d-4e4d-a1e3-a548ff59b828 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99cfb70f54c45c8870369359da20378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:34:43.724183 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1972e8c-121d-4e4d-a1e3-a548ff59b828 service nova] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:34:43.724472 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1972e8c-121d-4e4d-a1e3-a548ff59b828 service nova] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:34:43.724752 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1972e8c-121d-4e4d-a1e3-a548ff59b828 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:34:43.733182 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1972e8c-121d-4e4d-a1e3-a548ff59b828 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:34:43.734782 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1972e8c-121d-4e4d-a1e3-a548ff59b828 service nova] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:34:43.744482 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 750/1481] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:34:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:34:46.251028 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8738d57e-8486-4523-b8a1-b5737cbcbfbf None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:34:46.251514 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8738d57e-8486-4523-b8a1-b5737cbcbfbf None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:34:46.251629 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8738d57e-8486-4523-b8a1-b5737cbcbfbf None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:34:46.252978 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 732/1482] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:34:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:34:46.258242 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d891365-0d2f-4059-8a03-9ad05f00abba None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:34:46.258676 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d891365-0d2f-4059-8a03-9ad05f00abba None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:34:46.258801 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d891365-0d2f-4059-8a03-9ad05f00abba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:34:46.277203 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-9d891365-0d2f-4059-8a03-9ad05f00abba None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:34:46.278940 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-9d891365-0d2f-4059-8a03-9ad05f00abba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:34:46.287094 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 751/1483] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:34:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:34:46.323749 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8738d57e-8486-4523-b8a1-b5737cbcbfbf None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:34:46.334317 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8738d57e-8486-4523-b8a1-b5737cbcbfbf None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:34:46.337770 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026ce464-d8f9-4422-9890-3b586e202ca6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dda603ec5517460a83c333db2af804d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:34:46.338478 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026ce464-d8f9-4422-9890-3b586e202ca6 service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:34:46.338757 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026ce464-d8f9-4422-9890-3b586e202ca6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:34:46.339031 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026ce464-d8f9-4422-9890-3b586e202ca6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:34:46.348123 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026ce464-d8f9-4422-9890-3b586e202ca6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:34:46.349524 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026ce464-d8f9-4422-9890-3b586e202ca6 service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:34:46.358636 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 733/1484] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:34:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:34:48.636311 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c3b9ac-2d90-4121-b7c3-c2f04c1f8e5b None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:34:48.636851 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c3b9ac-2d90-4121-b7c3-c2f04c1f8e5b None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:34:48.636851 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c3b9ac-2d90-4121-b7c3-c2f04c1f8e5b None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:34:48.638237 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 752/1485] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:34:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:34:48.643370 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c99cf7e-f34a-4e8f-81ad-9dbf16036fb8 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:34:48.643823 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c99cf7e-f34a-4e8f-81ad-9dbf16036fb8 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:34:48.643961 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c99cf7e-f34a-4e8f-81ad-9dbf16036fb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:34:48.662344 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-8c99cf7e-f34a-4e8f-81ad-9dbf16036fb8 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:34:48.663593 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-8c99cf7e-f34a-4e8f-81ad-9dbf16036fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:34:48.672423 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 734/1486] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:34:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:34:48.709472 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c3b9ac-2d90-4121-b7c3-c2f04c1f8e5b None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:34:48.720763 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c3b9ac-2d90-4121-b7c3-c2f04c1f8e5b None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:34:48.724313 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bc36f0-79da-4e02-a662-8a0f788ea9f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dda603ec5517460a83c333db2af804d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:34:48.724944 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bc36f0-79da-4e02-a662-8a0f788ea9f3 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:34:48.725228 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bc36f0-79da-4e02-a662-8a0f788ea9f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:34:48.725505 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bc36f0-79da-4e02-a662-8a0f788ea9f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:34:48.735065 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bc36f0-79da-4e02-a662-8a0f788ea9f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:34:48.736507 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bc36f0-79da-4e02-a662-8a0f788ea9f3 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:34:48.745987 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 753/1487] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:34:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:34:51.069766 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3deb8de-fd0d-44c3-95f8-d4cfadc5ddca None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:34:51.070364 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3deb8de-fd0d-44c3-95f8-d4cfadc5ddca None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:34:51.070364 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3deb8de-fd0d-44c3-95f8-d4cfadc5ddca None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:34:51.071685 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 735/1488] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:34:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:34:51.077405 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c249cf1c-083e-434e-8523-4b30285ae67a None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:34:51.077839 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c249cf1c-083e-434e-8523-4b30285ae67a None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:34:51.077965 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c249cf1c-083e-434e-8523-4b30285ae67a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:34:51.097136 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-c249cf1c-083e-434e-8523-4b30285ae67a None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:34:51.098340 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-c249cf1c-083e-434e-8523-4b30285ae67a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:34:51.106607 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 754/1489] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:34:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:34:51.146454 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3deb8de-fd0d-44c3-95f8-d4cfadc5ddca None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:34:51.157927 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3deb8de-fd0d-44c3-95f8-d4cfadc5ddca None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:34:51.161399 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db2b09e-8898-4a41-a891-e321b399c75c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dda603ec5517460a83c333db2af804d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:34:51.162025 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db2b09e-8898-4a41-a891-e321b399c75c service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:34:51.162310 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db2b09e-8898-4a41-a891-e321b399c75c service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:34:51.162587 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db2b09e-8898-4a41-a891-e321b399c75c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:34:51.171231 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db2b09e-8898-4a41-a891-e321b399c75c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:34:51.172670 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db2b09e-8898-4a41-a891-e321b399c75c service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:34:51.181821 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 736/1490] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:34:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:34:53.848509 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d892dcd-6642-4bbf-a31d-37a3f56bc189 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:34:53.849021 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d892dcd-6642-4bbf-a31d-37a3f56bc189 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:34:53.849145 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d892dcd-6642-4bbf-a31d-37a3f56bc189 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:34:53.850480 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 755/1491] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jun 7 14:34:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:34:53.855637 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e08de9b-cb25-4afb-8aad-39ce8b8c3901 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:34:53.856127 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e08de9b-cb25-4afb-8aad-39ce8b8c3901 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:34:53.856237 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e08de9b-cb25-4afb-8aad-39ce8b8c3901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:34:53.873748 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-8e08de9b-cb25-4afb-8aad-39ce8b8c3901 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:34:53.874941 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-8e08de9b-cb25-4afb-8aad-39ce8b8c3901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:34:53.882554 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 737/1492] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jun 7 14:34:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:34:53.920752 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d892dcd-6642-4bbf-a31d-37a3f56bc189 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:34:53.931080 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d892dcd-6642-4bbf-a31d-37a3f56bc189 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:34:53.935118 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca595fa6-8a1b-4a80-adeb-ac184799e461 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dda603ec5517460a83c333db2af804d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:34:53.935738 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca595fa6-8a1b-4a80-adeb-ac184799e461 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:34:53.936074 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca595fa6-8a1b-4a80-adeb-ac184799e461 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:34:53.936347 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca595fa6-8a1b-4a80-adeb-ac184799e461 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:34:53.944947 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca595fa6-8a1b-4a80-adeb-ac184799e461 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:34:53.946353 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca595fa6-8a1b-4a80-adeb-ac184799e461 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:34:53.956021 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 756/1493] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:34:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:35:03.868195 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=33 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:35:03.951995 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=33 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:36:27.073491 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360a8f6e-9c0f-424b-91ed-667c3e761e1d None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:36:27.074121 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360a8f6e-9c0f-424b-91ed-667c3e761e1d None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:36:27.074121 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360a8f6e-9c0f-424b-91ed-667c3e761e1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:36:27.092182 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-360a8f6e-9c0f-424b-91ed-667c3e761e1d None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:36:27.093382 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-360a8f6e-9c0f-424b-91ed-667c3e761e1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:36:27.101774 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 738/1494] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:36:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:36:27.109763 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e148a9c-191c-45c2-9e74-801ff180a940 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:36:27.110262 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e148a9c-191c-45c2-9e74-801ff180a940 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:36:27.110365 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e148a9c-191c-45c2-9e74-801ff180a940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:36:27.127830 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-0e148a9c-191c-45c2-9e74-801ff180a940 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:36:27.129045 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-0e148a9c-191c-45c2-9e74-801ff180a940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:36:27.136728 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 757/1495] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:36:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:36:27.141065 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360a8f6e-9c0f-424b-91ed-667c3e761e1d None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:36:27.151086 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360a8f6e-9c0f-424b-91ed-667c3e761e1d None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:36:27.155880 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48834bb-f642-4720-84b7-3ca31339a6f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:36:27.156530 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48834bb-f642-4720-84b7-3ca31339a6f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:36:27.156819 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48834bb-f642-4720-84b7-3ca31339a6f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:36:27.157099 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48834bb-f642-4720-84b7-3ca31339a6f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:36:27.157829 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48834bb-f642-4720-84b7-3ca31339a6f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:36:27.158140 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48834bb-f642-4720-84b7-3ca31339a6f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:36:27.159152 dv-cinder-844974-1-smb devstack@keystone.service[80418]: WARNING py.warnings [None req-c48834bb-f642-4720-84b7-3ca31339a6f5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 07 14:36:27.159152 dv-cinder-844974-1-smb devstack@keystone.service[80418]: warnings.warn(msg) Jun 07 14:36:27.159152 dv-cinder-844974-1-smb devstack@keystone.service[80418]: Jun 07 14:36:27.160053 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48834bb-f642-4720-84b7-3ca31339a6f5 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:36:27.171980 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 739/1496] 10.222.0.86 () {58 vars in 1152 bytes} [Tue Jun 7 14:36:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:36:27.179819 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e148a9c-191c-45c2-9e74-801ff180a940 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:36:27.188724 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e148a9c-191c-45c2-9e74-801ff180a940 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:36:27.193231 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8149ad3b-81f3-4a9f-914e-cbb5a12364eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:36:27.193896 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8149ad3b-81f3-4a9f-914e-cbb5a12364eb admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:36:27.194186 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8149ad3b-81f3-4a9f-914e-cbb5a12364eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:36:27.194468 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8149ad3b-81f3-4a9f-914e-cbb5a12364eb admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:36:27.195167 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8149ad3b-81f3-4a9f-914e-cbb5a12364eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:36:27.196912 dv-cinder-844974-1-smb devstack@keystone.service[80419]: WARNING py.warnings [None req-8149ad3b-81f3-4a9f-914e-cbb5a12364eb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 07 14:36:27.196912 dv-cinder-844974-1-smb devstack@keystone.service[80419]: warnings.warn(msg) Jun 07 14:36:27.196912 dv-cinder-844974-1-smb devstack@keystone.service[80419]: Jun 07 14:36:27.198100 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8149ad3b-81f3-4a9f-914e-cbb5a12364eb admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:36:27.321996 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 758/1497] 10.222.0.86 () {60 vars in 1152 bytes} [Tue Jun 7 14:36:27 2022] POST /identity/v3/projects => generated 379 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:36:27.326241 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48834bb-f642-4720-84b7-3ca31339a6f5 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:36:27.336693 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48834bb-f642-4720-84b7-3ca31339a6f5 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:36:27.393194 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45df23c-2d45-4beb-a1a1-0f882feacccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:36:27.393856 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45df23c-2d45-4beb-a1a1-0f882feacccf admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:36:27.394146 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45df23c-2d45-4beb-a1a1-0f882feacccf admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:36:27.394428 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45df23c-2d45-4beb-a1a1-0f882feacccf admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:36:27.395133 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45df23c-2d45-4beb-a1a1-0f882feacccf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:36:27.396172 dv-cinder-844974-1-smb devstack@keystone.service[80418]: WARNING py.warnings [None req-f45df23c-2d45-4beb-a1a1-0f882feacccf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 07 14:36:27.396172 dv-cinder-844974-1-smb devstack@keystone.service[80418]: warnings.warn(msg) Jun 07 14:36:27.396172 dv-cinder-844974-1-smb devstack@keystone.service[80418]: Jun 07 14:36:27.397921 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45df23c-2d45-4beb-a1a1-0f882feacccf admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:36:27.457279 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 740/1498] 10.222.0.86 () {60 vars in 1143 bytes} [Tue Jun 7 14:36:27 2022] POST /identity/v3/users => generated 290 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:36:27.461964 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8149ad3b-81f3-4a9f-914e-cbb5a12364eb admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:36:27.472439 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8149ad3b-81f3-4a9f-914e-cbb5a12364eb admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:36:27.477160 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f175c8-093a-4c5c-9d94-b5ba1043b408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:36:27.477814 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f175c8-093a-4c5c-9d94-b5ba1043b408 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:36:27.478093 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f175c8-093a-4c5c-9d94-b5ba1043b408 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:36:27.478372 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f175c8-093a-4c5c-9d94-b5ba1043b408 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:36:27.479178 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f175c8-093a-4c5c-9d94-b5ba1043b408 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:36:27.480213 dv-cinder-844974-1-smb devstack@keystone.service[80419]: WARNING py.warnings [None req-02f175c8-093a-4c5c-9d94-b5ba1043b408 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 07 14:36:27.480213 dv-cinder-844974-1-smb devstack@keystone.service[80419]: warnings.warn(msg) Jun 07 14:36:27.480213 dv-cinder-844974-1-smb devstack@keystone.service[80419]: Jun 07 14:36:27.481087 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f175c8-093a-4c5c-9d94-b5ba1043b408 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:36:27.493557 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 759/1499] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:36:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:36:27.497429 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45df23c-2d45-4beb-a1a1-0f882feacccf admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:36:27.507515 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45df23c-2d45-4beb-a1a1-0f882feacccf admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:36:27.511993 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776e7e63-9219-476c-b610-ae05bb4c840e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:36:27.512643 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776e7e63-9219-476c-b610-ae05bb4c840e admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:36:27.512927 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776e7e63-9219-476c-b610-ae05bb4c840e admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:36:27.513203 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776e7e63-9219-476c-b610-ae05bb4c840e admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:36:27.513930 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776e7e63-9219-476c-b610-ae05bb4c840e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:36:27.514935 dv-cinder-844974-1-smb devstack@keystone.service[80418]: WARNING py.warnings [None req-776e7e63-9219-476c-b610-ae05bb4c840e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 07 14:36:27.514935 dv-cinder-844974-1-smb devstack@keystone.service[80418]: warnings.warn(msg) Jun 07 14:36:27.514935 dv-cinder-844974-1-smb devstack@keystone.service[80418]: Jun 07 14:36:27.515847 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776e7e63-9219-476c-b610-ae05bb4c840e admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:36:27.529826 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 741/1500] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:36:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:36:27.533734 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f175c8-093a-4c5c-9d94-b5ba1043b408 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:36:27.543288 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f175c8-093a-4c5c-9d94-b5ba1043b408 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:36:27.547624 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f79a91-fa6f-4e6b-9879-53ba64e673f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:36:27.548519 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f79a91-fa6f-4e6b-9879-53ba64e673f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:36:27.548803 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f79a91-fa6f-4e6b-9879-53ba64e673f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:36:27.549077 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f79a91-fa6f-4e6b-9879-53ba64e673f6 admin admin] PATH_INFO: `/v3/projects/2bb491592ef64c369f75f216898237fc/users/a92079e257bb43b9b2dae59292249f7e/roles/c17acc2a8bb348f59ba7edd22fcf0c47` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:36:27.562921 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f79a91-fa6f-4e6b-9879-53ba64e673f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bb491592ef64c369f75f216898237fc, user_id=a92079e257bb43b9b2dae59292249f7e, role_id=c17acc2a8bb348f59ba7edd22fcf0c47)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:36:27.563962 dv-cinder-844974-1-smb devstack@keystone.service[80419]: WARNING py.warnings [None req-02f79a91-fa6f-4e6b-9879-53ba64e673f6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 07 14:36:27.563962 dv-cinder-844974-1-smb devstack@keystone.service[80419]: warnings.warn(msg) Jun 07 14:36:27.563962 dv-cinder-844974-1-smb devstack@keystone.service[80419]: Jun 07 14:36:27.565881 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f79a91-fa6f-4e6b-9879-53ba64e673f6 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:36:27.616946 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 760/1501] 10.222.0.86 () {60 vars in 1482 bytes} [Tue Jun 7 14:36:27 2022] PUT /identity/v3/projects/2bb491592ef64c369f75f216898237fc/users/a92079e257bb43b9b2dae59292249f7e/roles/c17acc2a8bb348f59ba7edd22fcf0c47 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:36:27.629202 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f49795-e1b0-483f-9905-1be129ef614d None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:36:27.629493 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f49795-e1b0-483f-9905-1be129ef614d None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:36:27.629770 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f49795-e1b0-483f-9905-1be129ef614d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:36:27.656412 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-a1f49795-e1b0-483f-9905-1be129ef614d None None] MFA Rules not processed for user `a92079e257bb43b9b2dae59292249f7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:36:27.657604 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-a1f49795-e1b0-483f-9905-1be129ef614d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:36:27.721553 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 742/1502] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:36:27 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:36:27.734504 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e80c3e8-1109-4267-a791-4c78fdc232bb None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:36:27.734800 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e80c3e8-1109-4267-a791-4c78fdc232bb None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:36:27.735084 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e80c3e8-1109-4267-a791-4c78fdc232bb None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:36:27.736488 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 761/1503] 10.222.0.86 () {54 vars in 963 bytes} [Tue Jun 7 14:36:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:36:27.741363 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad673d5a-a596-4dd2-852a-e887d7c6b20c None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:36:27.741656 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad673d5a-a596-4dd2-852a-e887d7c6b20c None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:36:27.741940 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad673d5a-a596-4dd2-852a-e887d7c6b20c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:36:27.759735 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-ad673d5a-a596-4dd2-852a-e887d7c6b20c None None] MFA Rules not processed for user `af5a95620a4b43538abfe09eed4bf115`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:36:27.760961 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-ad673d5a-a596-4dd2-852a-e887d7c6b20c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:36:27.804574 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:36:27.811711 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 743/1504] 10.222.0.86 () {58 vars in 1060 bytes} [Tue Jun 7 14:36:27 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:36:27.820192 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e80c3e8-1109-4267-a791-4c78fdc232bb None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:36:27.830620 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e80c3e8-1109-4267-a791-4c78fdc232bb None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:36:27.834124 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50834d2-c70f-4e3f-93ca-906efd818f2f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af5a95620a4b43538abfe09eed4bf115', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:36:27.834777 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50834d2-c70f-4e3f-93ca-906efd818f2f service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:36:27.835065 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50834d2-c70f-4e3f-93ca-906efd818f2f service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:36:27.835348 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50834d2-c70f-4e3f-93ca-906efd818f2f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:36:27.843578 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50834d2-c70f-4e3f-93ca-906efd818f2f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:36:27.845035 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50834d2-c70f-4e3f-93ca-906efd818f2f service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:36:27.853926 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 762/1505] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:36:27 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:36:27.896156 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400229f0-3849-4def-b741-bceaa168619f None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:36:27.896453 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400229f0-3849-4def-b741-bceaa168619f None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:36:27.896737 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400229f0-3849-4def-b741-bceaa168619f None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:36:27.898081 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 744/1506] 10.222.0.86 () {52 vars in 829 bytes} [Tue Jun 7 14:36:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:36:27.901558 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50834d2-c70f-4e3f-93ca-906efd818f2f service cinder] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:36:27.962406 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50834d2-c70f-4e3f-93ca-906efd818f2f service cinder] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:36:27.966889 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b64945-95fb-4825-a6b6-49540d2a1c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:36:27.967780 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b64945-95fb-4825-a6b6-49540d2a1c36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:36:27.968066 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b64945-95fb-4825-a6b6-49540d2a1c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:36:27.968344 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b64945-95fb-4825-a6b6-49540d2a1c36 admin admin] PATH_INFO: `/v3/users/a92079e257bb43b9b2dae59292249f7e` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:36:27.969513 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b64945-95fb-4825-a6b6-49540d2a1c36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a92079e257bb43b9b2dae59292249f7e)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:36:27.970513 dv-cinder-844974-1-smb devstack@keystone.service[80419]: WARNING py.warnings [None req-23b64945-95fb-4825-a6b6-49540d2a1c36 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 07 14:36:27.970513 dv-cinder-844974-1-smb devstack@keystone.service[80419]: warnings.warn(msg) Jun 07 14:36:27.970513 dv-cinder-844974-1-smb devstack@keystone.service[80419]: Jun 07 14:36:27.971709 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b64945-95fb-4825-a6b6-49540d2a1c36 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:36:28.196768 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-23b64945-95fb-4825-a6b6-49540d2a1c36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a92079e257bb43b9b2dae59292249f7e'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:36:28.197403 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-23b64945-95fb-4825-a6b6-49540d2a1c36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a92079e257bb43b9b2dae59292249f7e'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:36:28.213498 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-23b64945-95fb-4825-a6b6-49540d2a1c36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a92079e257bb43b9b2dae59292249f7e'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:36:28.232208 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-23b64945-95fb-4825-a6b6-49540d2a1c36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a92079e257bb43b9b2dae59292249f7e'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:36:28.232942 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-23b64945-95fb-4825-a6b6-49540d2a1c36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a92079e257bb43b9b2dae59292249f7e'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:36:28.236880 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:36:28.340760 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 763/1507] 10.222.0.86 () {58 vars in 1223 bytes} [Tue Jun 7 14:36:27 2022] DELETE /identity/v3/users/a92079e257bb43b9b2dae59292249f7e => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:36:28.345516 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693dbdd9-8d46-43b6-829f-93d7e22a8725 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:36:28.345984 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693dbdd9-8d46-43b6-829f-93d7e22a8725 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:36:28.346379 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693dbdd9-8d46-43b6-829f-93d7e22a8725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:36:28.364070 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-693dbdd9-8d46-43b6-829f-93d7e22a8725 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:36:28.365271 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-693dbdd9-8d46-43b6-829f-93d7e22a8725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:36:28.423378 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 745/1508] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:36:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:36:28.433261 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b64945-95fb-4825-a6b6-49540d2a1c36 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:36:28.434666 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-23b64945-95fb-4825-a6b6-49540d2a1c36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:36:28.491452 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b64945-95fb-4825-a6b6-49540d2a1c36 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:36:28.495037 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0799c345-4b08-4afe-959b-31e9f2bd8dd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dda603ec5517460a83c333db2af804d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:36:28.495683 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0799c345-4b08-4afe-959b-31e9f2bd8dd9 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:36:28.496000 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0799c345-4b08-4afe-959b-31e9f2bd8dd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:36:28.496377 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0799c345-4b08-4afe-959b-31e9f2bd8dd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:36:28.505406 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0799c345-4b08-4afe-959b-31e9f2bd8dd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:36:28.506885 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0799c345-4b08-4afe-959b-31e9f2bd8dd9 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:36:28.516114 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 764/1509] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:36:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:36:29.140147 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693dbdd9-8d46-43b6-829f-93d7e22a8725 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:36:29.143937 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-693dbdd9-8d46-43b6-829f-93d7e22a8725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:36:29.154492 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693dbdd9-8d46-43b6-829f-93d7e22a8725 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:36:29.159342 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da78d3b-3d0c-452d-90f4-fa4a55716fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:36:29.160238 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da78d3b-3d0c-452d-90f4-fa4a55716fc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:36:29.160523 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da78d3b-3d0c-452d-90f4-fa4a55716fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:36:29.160801 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da78d3b-3d0c-452d-90f4-fa4a55716fc5 admin admin] PATH_INFO: `/v3/projects/2bb491592ef64c369f75f216898237fc` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:36:29.162088 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da78d3b-3d0c-452d-90f4-fa4a55716fc5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2bb491592ef64c369f75f216898237fc)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:36:29.163062 dv-cinder-844974-1-smb devstack@keystone.service[80418]: WARNING py.warnings [None req-4da78d3b-3d0c-452d-90f4-fa4a55716fc5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 07 14:36:29.163062 dv-cinder-844974-1-smb devstack@keystone.service[80418]: warnings.warn(msg) Jun 07 14:36:29.163062 dv-cinder-844974-1-smb devstack@keystone.service[80418]: Jun 07 14:36:29.164211 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da78d3b-3d0c-452d-90f4-fa4a55716fc5 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:36:29.291517 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-4da78d3b-3d0c-452d-90f4-fa4a55716fc5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2bb491592ef64c369f75f216898237fc', 'request_id': 'req-4da78d3b-3d0c-452d-90f4-fa4a55716fc5'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:36:29.304924 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-4da78d3b-3d0c-452d-90f4-fa4a55716fc5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2bb491592ef64c369f75f216898237fc', 'request_id': 'req-4da78d3b-3d0c-452d-90f4-fa4a55716fc5'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:36:29.478151 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-4da78d3b-3d0c-452d-90f4-fa4a55716fc5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2bb491592ef64c369f75f216898237fc', 'request_id': 'req-4da78d3b-3d0c-452d-90f4-fa4a55716fc5'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:36:29.490008 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-4da78d3b-3d0c-452d-90f4-fa4a55716fc5 admin admin] The token cache is being invalidate because project 2bb491592ef64c369f75f216898237fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:36:29.490308 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-4da78d3b-3d0c-452d-90f4-fa4a55716fc5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:36:29.491494 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-4da78d3b-3d0c-452d-90f4-fa4a55716fc5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:36:29.493179 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 746/1510] 10.222.0.86 () {58 vars in 1232 bytes} [Tue Jun 7 14:36:29 2022] DELETE /identity/v3/projects/2bb491592ef64c369f75f216898237fc => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:36:38.512069 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:36:39.486597 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:38:17.228939 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a57efc0-7839-4cc6-8929-65b55867237b None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:38:17.229563 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a57efc0-7839-4cc6-8929-65b55867237b None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:38:17.229563 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a57efc0-7839-4cc6-8929-65b55867237b None None] PATH_INFO: `/v3` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:38:17.231151 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 765/1511] 10.222.0.15 () {54 vars in 925 bytes} [Tue Jun 7 14:38:17 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:38:17.238037 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e1554e-c58c-466c-8fac-e01fb106b288 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:38:17.238511 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e1554e-c58c-466c-8fac-e01fb106b288 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:38:17.238617 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e1554e-c58c-466c-8fac-e01fb106b288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:38:17.256225 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-07e1554e-c58c-466c-8fac-e01fb106b288 None None] MFA Rules not processed for user `7e042f9d4a9345bb947e6a30f64a59ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:38:17.257419 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-07e1554e-c58c-466c-8fac-e01fb106b288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:38:17.321013 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 747/1512] 10.222.0.15 () {58 vars in 1015 bytes} [Tue Jun 7 14:38:17 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:38:17.401675 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37503513-3afd-4167-b288-7c6296e51cfb None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:38:17.401964 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37503513-3afd-4167-b288-7c6296e51cfb None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:38:17.402239 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37503513-3afd-4167-b288-7c6296e51cfb None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:38:17.403640 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 766/1513] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 7 14:38:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:38:17.409074 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33967e00-77e6-4c9b-b40a-76c920a1f877 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:38:17.409370 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33967e00-77e6-4c9b-b40a-76c920a1f877 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:38:17.409653 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33967e00-77e6-4c9b-b40a-76c920a1f877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:38:17.427314 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-33967e00-77e6-4c9b-b40a-76c920a1f877 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:38:17.428543 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-33967e00-77e6-4c9b-b40a-76c920a1f877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:38:17.485852 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 748/1514] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 7 14:38:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:38:17.651546 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37503513-3afd-4167-b288-7c6296e51cfb None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:38:17.653279 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-37503513-3afd-4167-b288-7c6296e51cfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:38:17.729684 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37503513-3afd-4167-b288-7c6296e51cfb None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:38:17.734970 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145e626c-88c6-4eaf-939b-6318dbba396b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99cfb70f54c45c8870369359da20378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:38:17.735612 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145e626c-88c6-4eaf-939b-6318dbba396b service nova] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:38:17.735991 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145e626c-88c6-4eaf-939b-6318dbba396b service nova] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:38:17.736215 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145e626c-88c6-4eaf-939b-6318dbba396b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:38:17.744172 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145e626c-88c6-4eaf-939b-6318dbba396b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:38:17.745737 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145e626c-88c6-4eaf-939b-6318dbba396b service nova] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:38:17.755531 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 767/1515] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:38:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:38:18.625645 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d99237f-13ae-4735-adc5-e559f8dfa0dd None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:38:18.626201 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d99237f-13ae-4735-adc5-e559f8dfa0dd None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:38:18.626308 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d99237f-13ae-4735-adc5-e559f8dfa0dd None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:38:18.627643 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 749/1516] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 7 14:38:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:38:18.632453 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a45e9cf-80b4-4ab9-b718-8197a147340b None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:38:18.632939 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a45e9cf-80b4-4ab9-b718-8197a147340b None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:38:18.633038 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a45e9cf-80b4-4ab9-b718-8197a147340b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:38:18.650597 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-3a45e9cf-80b4-4ab9-b718-8197a147340b None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:38:18.652073 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-3a45e9cf-80b4-4ab9-b718-8197a147340b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:38:18.660358 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 768/1517] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 7 14:38:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:38:18.810621 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d99237f-13ae-4735-adc5-e559f8dfa0dd None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:38:18.825855 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d99237f-13ae-4735-adc5-e559f8dfa0dd None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:38:18.831262 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab500df-bddc-40e5-90d1-08edd5615a06 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99cfb70f54c45c8870369359da20378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:38:18.831934 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab500df-bddc-40e5-90d1-08edd5615a06 service nova] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:38:18.832218 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab500df-bddc-40e5-90d1-08edd5615a06 service nova] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:38:18.832495 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab500df-bddc-40e5-90d1-08edd5615a06 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:38:18.840839 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab500df-bddc-40e5-90d1-08edd5615a06 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:38:18.842399 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab500df-bddc-40e5-90d1-08edd5615a06 service nova] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:38:18.851903 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 750/1518] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:38:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:38:26.607423 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fc0137-b873-4f72-baa4-7e6ec5aadb3a None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:38:26.608107 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fc0137-b873-4f72-baa4-7e6ec5aadb3a None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:38:26.608107 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fc0137-b873-4f72-baa4-7e6ec5aadb3a None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:38:26.609369 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 769/1519] 10.222.0.86 () {54 vars in 960 bytes} [Tue Jun 7 14:38:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:38:26.614379 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a83c3b-2c1a-4e97-8e66-57ace148f326 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:38:26.614841 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a83c3b-2c1a-4e97-8e66-57ace148f326 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:38:26.614965 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a83c3b-2c1a-4e97-8e66-57ace148f326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:38:26.632518 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-a7a83c3b-2c1a-4e97-8e66-57ace148f326 None None] MFA Rules not processed for user `7e042f9d4a9345bb947e6a30f64a59ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:38:26.633722 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-a7a83c3b-2c1a-4e97-8e66-57ace148f326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:38:26.642530 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 751/1520] 10.222.0.86 () {58 vars in 1057 bytes} [Tue Jun 7 14:38:26 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:38:26.649665 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fc0137-b873-4f72-baa4-7e6ec5aadb3a None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:38:26.663618 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fc0137-b873-4f72-baa4-7e6ec5aadb3a None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:38:26.668764 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f368d35a-eba6-4fab-bfc3-139e76cc7a90 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e042f9d4a9345bb947e6a30f64a59ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:38:26.669392 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f368d35a-eba6-4fab-bfc3-139e76cc7a90 service placement] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:38:26.669679 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f368d35a-eba6-4fab-bfc3-139e76cc7a90 service placement] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:38:26.669997 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f368d35a-eba6-4fab-bfc3-139e76cc7a90 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:38:26.678403 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f368d35a-eba6-4fab-bfc3-139e76cc7a90 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:38:26.679995 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f368d35a-eba6-4fab-bfc3-139e76cc7a90 service placement] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:38:26.689804 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 770/1521] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:38:26 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 14:38:30.118832 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c4cfdb-6f9a-44e2-9136-b52ee7095298 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:38:30.119397 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c4cfdb-6f9a-44e2-9136-b52ee7095298 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:38:30.119511 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c4cfdb-6f9a-44e2-9136-b52ee7095298 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:38:30.120916 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 752/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 7 14:38:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:38:30.126192 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06c1029-18b0-4ab1-a67c-23d319dbd9b3 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:38:30.126649 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06c1029-18b0-4ab1-a67c-23d319dbd9b3 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:38:30.126764 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06c1029-18b0-4ab1-a67c-23d319dbd9b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:38:30.144285 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-d06c1029-18b0-4ab1-a67c-23d319dbd9b3 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:38:30.145477 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-d06c1029-18b0-4ab1-a67c-23d319dbd9b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:38:30.153472 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 771/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 7 14:38:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:38:30.306103 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c4cfdb-6f9a-44e2-9136-b52ee7095298 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:38:30.320476 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c4cfdb-6f9a-44e2-9136-b52ee7095298 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:38:30.326010 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f46439-4509-45e8-bc96-897adc9b8e90 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99cfb70f54c45c8870369359da20378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:38:30.326669 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f46439-4509-45e8-bc96-897adc9b8e90 service nova] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:38:30.326949 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f46439-4509-45e8-bc96-897adc9b8e90 service nova] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:38:30.327223 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f46439-4509-45e8-bc96-897adc9b8e90 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:38:30.336081 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f46439-4509-45e8-bc96-897adc9b8e90 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:38:30.337681 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f46439-4509-45e8-bc96-897adc9b8e90 service nova] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:38:30.347592 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 753/1524] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:38:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:38:31.206320 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192dd37c-662d-4bb2-856a-93209b068e31 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:38:31.206903 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192dd37c-662d-4bb2-856a-93209b068e31 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:38:31.206903 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192dd37c-662d-4bb2-856a-93209b068e31 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:38:31.208336 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 772/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 7 14:38:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:38:31.213012 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8b3f09-3acb-4383-a95e-0b3370642265 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:38:31.213438 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8b3f09-3acb-4383-a95e-0b3370642265 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:38:31.213564 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8b3f09-3acb-4383-a95e-0b3370642265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:38:31.231422 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-5e8b3f09-3acb-4383-a95e-0b3370642265 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:38:31.232655 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-5e8b3f09-3acb-4383-a95e-0b3370642265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:38:31.240546 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 754/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 7 14:38:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:38:31.389551 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192dd37c-662d-4bb2-856a-93209b068e31 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:38:31.404601 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192dd37c-662d-4bb2-856a-93209b068e31 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:38:31.410518 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb9430c-d10f-4ab6-9aac-259f2abc39d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99cfb70f54c45c8870369359da20378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:38:31.411063 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb9430c-d10f-4ab6-9aac-259f2abc39d9 service nova] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:38:31.411351 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb9430c-d10f-4ab6-9aac-259f2abc39d9 service nova] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:38:31.411636 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb9430c-d10f-4ab6-9aac-259f2abc39d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:38:31.420645 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb9430c-d10f-4ab6-9aac-259f2abc39d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:38:31.422393 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb9430c-d10f-4ab6-9aac-259f2abc39d9 service nova] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:38:31.431804 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 773/1527] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:38:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:38:35.425096 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ec4c63-d041-4e6a-bf03-c76a11a95e7f None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:38:35.425632 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ec4c63-d041-4e6a-bf03-c76a11a95e7f None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:38:35.425632 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ec4c63-d041-4e6a-bf03-c76a11a95e7f None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:38:35.427049 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 755/1528] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 7 14:38:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:38:35.432302 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca723f30-7853-496b-9a70-a9c1fbeade8c None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:38:35.432736 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca723f30-7853-496b-9a70-a9c1fbeade8c None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:38:35.432884 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca723f30-7853-496b-9a70-a9c1fbeade8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:38:35.451223 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-ca723f30-7853-496b-9a70-a9c1fbeade8c None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:38:35.452458 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-ca723f30-7853-496b-9a70-a9c1fbeade8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:38:35.460377 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 774/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 7 14:38:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:38:35.496630 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ec4c63-d041-4e6a-bf03-c76a11a95e7f None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:38:35.498707 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-30ec4c63-d041-4e6a-bf03-c76a11a95e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:38:35.555447 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ec4c63-d041-4e6a-bf03-c76a11a95e7f None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:38:35.558962 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20da60e8-9c7a-4dab-a6d1-ae00ffb14ddd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dda603ec5517460a83c333db2af804d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:38:35.559603 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20da60e8-9c7a-4dab-a6d1-ae00ffb14ddd service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:38:35.559936 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20da60e8-9c7a-4dab-a6d1-ae00ffb14ddd service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:38:35.560219 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20da60e8-9c7a-4dab-a6d1-ae00ffb14ddd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:38:35.569349 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20da60e8-9c7a-4dab-a6d1-ae00ffb14ddd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:38:35.570766 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20da60e8-9c7a-4dab-a6d1-ae00ffb14ddd service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:38:35.575668 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:38:35.580844 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 756/1530] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:38:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:38:37.825733 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3b3c50-ae14-45d1-b50b-b404f111f305 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:38:37.826341 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3b3c50-ae14-45d1-b50b-b404f111f305 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:38:37.826341 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3b3c50-ae14-45d1-b50b-b404f111f305 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:38:37.827657 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 775/1531] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 7 14:38:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:38:37.833677 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d931f7dd-b028-4ae5-bcb6-45ddfad6a582 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:38:37.834101 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d931f7dd-b028-4ae5-bcb6-45ddfad6a582 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:38:37.834237 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d931f7dd-b028-4ae5-bcb6-45ddfad6a582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:38:37.852443 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-d931f7dd-b028-4ae5-bcb6-45ddfad6a582 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:38:37.853661 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-d931f7dd-b028-4ae5-bcb6-45ddfad6a582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:38:37.861953 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 757/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 7 14:38:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:38:37.897222 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3b3c50-ae14-45d1-b50b-b404f111f305 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:38:37.909794 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3b3c50-ae14-45d1-b50b-b404f111f305 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:38:37.913272 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bded8f7-3bf2-4026-a78d-f58f0a0d9211 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dda603ec5517460a83c333db2af804d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:38:37.913895 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bded8f7-3bf2-4026-a78d-f58f0a0d9211 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:38:37.914175 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bded8f7-3bf2-4026-a78d-f58f0a0d9211 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:38:37.914449 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bded8f7-3bf2-4026-a78d-f58f0a0d9211 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:38:37.923261 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bded8f7-3bf2-4026-a78d-f58f0a0d9211 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:38:37.924696 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bded8f7-3bf2-4026-a78d-f58f0a0d9211 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:38:37.933774 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 776/1533] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:38:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:38:41.783615 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7a4b37-fe3c-41a7-aea4-c24928853a2f None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:38:41.784210 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7a4b37-fe3c-41a7-aea4-c24928853a2f None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:38:41.784210 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7a4b37-fe3c-41a7-aea4-c24928853a2f None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:38:41.785567 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 758/1534] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 7 14:38:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:38:41.790902 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ff2ee-b3ef-4d0e-9d83-7c1a2c01d215 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:38:41.791301 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ff2ee-b3ef-4d0e-9d83-7c1a2c01d215 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:38:41.791497 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ff2ee-b3ef-4d0e-9d83-7c1a2c01d215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:38:41.798444 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=62 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:38:41.810306 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-c26ff2ee-b3ef-4d0e-9d83-7c1a2c01d215 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:38:41.811718 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-c26ff2ee-b3ef-4d0e-9d83-7c1a2c01d215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:38:41.819556 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 777/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 7 14:38:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:38:42.091188 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7a4b37-fe3c-41a7-aea4-c24928853a2f None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:38:42.093004 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-3e7a4b37-fe3c-41a7-aea4-c24928853a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:38:42.151682 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7a4b37-fe3c-41a7-aea4-c24928853a2f None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:38:42.155317 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83f1ea9-d432-472b-bbab-fd0039279f74 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af5a95620a4b43538abfe09eed4bf115', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:38:42.156015 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83f1ea9-d432-472b-bbab-fd0039279f74 service cinder] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:38:42.157824 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83f1ea9-d432-472b-bbab-fd0039279f74 service cinder] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:38:42.157824 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83f1ea9-d432-472b-bbab-fd0039279f74 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:38:42.166414 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83f1ea9-d432-472b-bbab-fd0039279f74 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:38:42.167874 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83f1ea9-d432-472b-bbab-fd0039279f74 service cinder] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:38:42.177304 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 759/1536] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:38:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:38:44.434159 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c839a1-0bf0-4e60-a6da-696fc23d2081 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:38:44.434722 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c839a1-0bf0-4e60-a6da-696fc23d2081 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:38:44.434722 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c839a1-0bf0-4e60-a6da-696fc23d2081 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:38:44.436137 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 778/1537] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 7 14:38:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:38:44.441908 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d8e545-a146-4849-bf61-aa3244b1ee02 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:38:44.442321 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d8e545-a146-4849-bf61-aa3244b1ee02 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:38:44.442496 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d8e545-a146-4849-bf61-aa3244b1ee02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:38:44.459538 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-71d8e545-a146-4849-bf61-aa3244b1ee02 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:38:44.460791 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-71d8e545-a146-4849-bf61-aa3244b1ee02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:38:44.468508 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 760/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 7 14:38:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:38:44.738226 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c839a1-0bf0-4e60-a6da-696fc23d2081 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:38:44.739937 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-e9c839a1-0bf0-4e60-a6da-696fc23d2081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:38:44.753394 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c839a1-0bf0-4e60-a6da-696fc23d2081 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:38:44.756969 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc24b61-763d-46fd-a43f-dd75d308ba18 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af5a95620a4b43538abfe09eed4bf115', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:38:44.757604 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc24b61-763d-46fd-a43f-dd75d308ba18 service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:38:44.757886 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc24b61-763d-46fd-a43f-dd75d308ba18 service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:38:44.758160 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc24b61-763d-46fd-a43f-dd75d308ba18 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:38:44.767624 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc24b61-763d-46fd-a43f-dd75d308ba18 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:38:44.769054 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc24b61-763d-46fd-a43f-dd75d308ba18 service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:38:44.778614 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 779/1539] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:38:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:38:54.454879 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=32 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:38:54.774161 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=8 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:40:29.378873 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da19a215-45d9-42bb-a8d6-d65b5f8f8ee9 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:29.379512 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da19a215-45d9-42bb-a8d6-d65b5f8f8ee9 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:29.379512 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da19a215-45d9-42bb-a8d6-d65b5f8f8ee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:29.413281 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-da19a215-45d9-42bb-a8d6-d65b5f8f8ee9 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:40:29.414544 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-da19a215-45d9-42bb-a8d6-d65b5f8f8ee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:40:29.433669 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 761/1540] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:40:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:40:29.442636 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c486076-ac2d-4293-ae75-1d2f6f47c264 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:29.443233 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c486076-ac2d-4293-ae75-1d2f6f47c264 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:29.443233 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c486076-ac2d-4293-ae75-1d2f6f47c264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:29.473298 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-5c486076-ac2d-4293-ae75-1d2f6f47c264 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:40:29.474545 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-5c486076-ac2d-4293-ae75-1d2f6f47c264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:40:29.498393 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 780/1541] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:40:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:40:29.503103 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da19a215-45d9-42bb-a8d6-d65b5f8f8ee9 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:40:29.517138 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da19a215-45d9-42bb-a8d6-d65b5f8f8ee9 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:40:29.525433 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44311964-00cd-4e6a-9bf1-5c5d641b5aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:40:29.526218 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44311964-00cd-4e6a-9bf1-5c5d641b5aa9 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:29.526566 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44311964-00cd-4e6a-9bf1-5c5d641b5aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:29.526854 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44311964-00cd-4e6a-9bf1-5c5d641b5aa9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:29.527597 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44311964-00cd-4e6a-9bf1-5c5d641b5aa9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:40:29.527939 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44311964-00cd-4e6a-9bf1-5c5d641b5aa9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:40:29.529555 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44311964-00cd-4e6a-9bf1-5c5d641b5aa9 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:40:29.542872 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 762/1542] 10.222.0.86 () {58 vars in 1152 bytes} [Tue Jun 7 14:40:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:40:29.548368 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c520c8d-76da-41c2-81cd-4abf077d2677 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:29.548700 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c520c8d-76da-41c2-81cd-4abf077d2677 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:29.548952 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c520c8d-76da-41c2-81cd-4abf077d2677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:29.562610 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44311964-00cd-4e6a-9bf1-5c5d641b5aa9 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:40:29.579968 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-8c520c8d-76da-41c2-81cd-4abf077d2677 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:40:29.581194 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-8c520c8d-76da-41c2-81cd-4abf077d2677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:40:29.585664 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44311964-00cd-4e6a-9bf1-5c5d641b5aa9 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:40:29.596581 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040c7e91-b947-4695-a223-d55b883e4810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:40:29.597264 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040c7e91-b947-4695-a223-d55b883e4810 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:29.597554 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040c7e91-b947-4695-a223-d55b883e4810 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:29.597839 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040c7e91-b947-4695-a223-d55b883e4810 admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:29.599479 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040c7e91-b947-4695-a223-d55b883e4810 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:40:29.600546 dv-cinder-844974-1-smb devstack@keystone.service[80418]: WARNING py.warnings [None req-040c7e91-b947-4695-a223-d55b883e4810 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 07 14:40:29.600546 dv-cinder-844974-1-smb devstack@keystone.service[80418]: warnings.warn(msg) Jun 07 14:40:29.600546 dv-cinder-844974-1-smb devstack@keystone.service[80418]: Jun 07 14:40:29.601744 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040c7e91-b947-4695-a223-d55b883e4810 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:40:29.609757 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 781/1543] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:40:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:40:29.618604 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31688904-8a6b-4e57-900b-9ce13d655c0c None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:29.618890 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31688904-8a6b-4e57-900b-9ce13d655c0c None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:29.619179 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31688904-8a6b-4e57-900b-9ce13d655c0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:29.648973 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-31688904-8a6b-4e57-900b-9ce13d655c0c None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:40:29.656605 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-31688904-8a6b-4e57-900b-9ce13d655c0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:40:29.668211 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 782/1544] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:40:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 14:40:29.669777 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a95d88b-825d-4cc2-a217-d28fbe1b2d6d None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:29.670075 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a95d88b-825d-4cc2-a217-d28fbe1b2d6d None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:29.670360 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a95d88b-825d-4cc2-a217-d28fbe1b2d6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:29.695144 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-9a95d88b-825d-4cc2-a217-d28fbe1b2d6d None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:40:29.696408 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-9a95d88b-825d-4cc2-a217-d28fbe1b2d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:40:29.705338 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 783/1545] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:40:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:40:29.716238 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a95d88b-825d-4cc2-a217-d28fbe1b2d6d None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:40:29.724510 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 763/1546] 10.222.0.86 () {60 vars in 1152 bytes} [Tue Jun 7 14:40:29 2022] POST /identity/v3/projects => generated 373 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:40:29.725889 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce39a60-4030-4e4e-8962-f299eba7688f None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:29.726185 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce39a60-4030-4e4e-8962-f299eba7688f None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:29.726467 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce39a60-4030-4e4e-8962-f299eba7688f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:29.730837 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a95d88b-825d-4cc2-a217-d28fbe1b2d6d None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:40:29.763590 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-7ce39a60-4030-4e4e-8962-f299eba7688f None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:40:29.764801 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-7ce39a60-4030-4e4e-8962-f299eba7688f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:40:29.794942 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884a7a34-60b0-4847-a031-8c2f6899d1b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:40:29.795692 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884a7a34-60b0-4847-a031-8c2f6899d1b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:29.795948 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884a7a34-60b0-4847-a031-8c2f6899d1b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:29.796193 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884a7a34-60b0-4847-a031-8c2f6899d1b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:29.796922 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884a7a34-60b0-4847-a031-8c2f6899d1b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:40:29.797233 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884a7a34-60b0-4847-a031-8c2f6899d1b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:40:29.798246 dv-cinder-844974-1-smb devstack@keystone.service[80419]: WARNING py.warnings [None req-884a7a34-60b0-4847-a031-8c2f6899d1b7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 07 14:40:29.798246 dv-cinder-844974-1-smb devstack@keystone.service[80419]: warnings.warn(msg) Jun 07 14:40:29.798246 dv-cinder-844974-1-smb devstack@keystone.service[80419]: Jun 07 14:40:29.799132 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884a7a34-60b0-4847-a031-8c2f6899d1b7 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:40:29.812175 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 784/1547] 10.222.0.86 () {58 vars in 1152 bytes} [Tue Jun 7 14:40:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:40:29.813252 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b730073-6a69-4a6e-b195-ba8f9114c90b None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:29.813757 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b730073-6a69-4a6e-b195-ba8f9114c90b None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:29.814044 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b730073-6a69-4a6e-b195-ba8f9114c90b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:29.834264 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-2b730073-6a69-4a6e-b195-ba8f9114c90b None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:40:29.835499 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-2b730073-6a69-4a6e-b195-ba8f9114c90b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:40:29.837469 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 764/1548] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:40:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:40:29.839366 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95e261c-162e-498f-b472-e854445dfcb3 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:29.839660 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95e261c-162e-498f-b472-e854445dfcb3 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:29.839971 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95e261c-162e-498f-b472-e854445dfcb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:29.849932 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 785/1549] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:40:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:40:29.850907 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b730073-6a69-4a6e-b195-ba8f9114c90b None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:40:29.861131 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b730073-6a69-4a6e-b195-ba8f9114c90b None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:40:29.863127 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-f95e261c-162e-498f-b472-e854445dfcb3 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:40:29.864375 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-f95e261c-162e-498f-b472-e854445dfcb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:40:29.865822 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a805bdf6-74c8-453f-b581-9c73e868aac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:40:29.866482 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a805bdf6-74c8-453f-b581-9c73e868aac1 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:29.866769 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a805bdf6-74c8-453f-b581-9c73e868aac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:29.867052 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a805bdf6-74c8-453f-b581-9c73e868aac1 admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:29.867743 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a805bdf6-74c8-453f-b581-9c73e868aac1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:40:29.868776 dv-cinder-844974-1-smb devstack@keystone.service[80419]: WARNING py.warnings [None req-a805bdf6-74c8-453f-b581-9c73e868aac1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 07 14:40:29.868776 dv-cinder-844974-1-smb devstack@keystone.service[80419]: warnings.warn(msg) Jun 07 14:40:29.868776 dv-cinder-844974-1-smb devstack@keystone.service[80419]: Jun 07 14:40:29.870607 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a805bdf6-74c8-453f-b581-9c73e868aac1 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:40:29.872229 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 765/1550] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:40:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:40:29.873617 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2281aa1b-f2a6-4ece-ba57-f2e8452b2a06 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:29.873915 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2281aa1b-f2a6-4ece-ba57-f2e8452b2a06 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:29.874199 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2281aa1b-f2a6-4ece-ba57-f2e8452b2a06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:29.891726 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-2281aa1b-f2a6-4ece-ba57-f2e8452b2a06 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:40:29.892941 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-2281aa1b-f2a6-4ece-ba57-f2e8452b2a06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:40:29.901870 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 766/1551] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:40:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:40:29.903118 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e134e2c-69f5-4204-a161-44058bf9e061 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:29.903415 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e134e2c-69f5-4204-a161-44058bf9e061 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:29.903697 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e134e2c-69f5-4204-a161-44058bf9e061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:29.924341 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-5e134e2c-69f5-4204-a161-44058bf9e061 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:40:29.925710 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-5e134e2c-69f5-4204-a161-44058bf9e061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:40:29.933538 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 767/1552] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:40:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:40:29.934403 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e134e2c-69f5-4204-a161-44058bf9e061 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:40:29.943670 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e134e2c-69f5-4204-a161-44058bf9e061 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:40:29.948347 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340f2678-73ad-4cec-ad0c-b20a030d48c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:40:29.952666 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340f2678-73ad-4cec-ad0c-b20a030d48c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:29.952666 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340f2678-73ad-4cec-ad0c-b20a030d48c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:29.952666 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340f2678-73ad-4cec-ad0c-b20a030d48c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:29.952666 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340f2678-73ad-4cec-ad0c-b20a030d48c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:40:29.952666 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340f2678-73ad-4cec-ad0c-b20a030d48c1 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:40:29.983419 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 786/1553] 10.222.0.86 () {60 vars in 1143 bytes} [Tue Jun 7 14:40:29 2022] POST /identity/v3/users => generated 287 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:40:29.984808 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47749292-d0fa-4d4e-b50a-1539e25b74a8 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:29.985102 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47749292-d0fa-4d4e-b50a-1539e25b74a8 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:29.985383 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47749292-d0fa-4d4e-b50a-1539e25b74a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:30.002525 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-47749292-d0fa-4d4e-b50a-1539e25b74a8 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:40:30.003723 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-47749292-d0fa-4d4e-b50a-1539e25b74a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:40:30.012321 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 787/1554] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:40:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:40:30.013403 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc431478-8803-4203-8894-9d7c4416bdd9 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:30.013744 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc431478-8803-4203-8894-9d7c4416bdd9 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:30.014005 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc431478-8803-4203-8894-9d7c4416bdd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:30.033146 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-bc431478-8803-4203-8894-9d7c4416bdd9 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:40:30.034400 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-bc431478-8803-4203-8894-9d7c4416bdd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:40:30.042172 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 788/1555] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:40:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:40:30.043347 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef67fd62-3671-4454-85a5-2cf13e231eff None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:30.043637 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef67fd62-3671-4454-85a5-2cf13e231eff None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:30.043957 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef67fd62-3671-4454-85a5-2cf13e231eff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:30.061312 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-ef67fd62-3671-4454-85a5-2cf13e231eff None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:40:30.062539 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-ef67fd62-3671-4454-85a5-2cf13e231eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:40:30.070465 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 789/1556] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:40:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:40:30.071235 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef67fd62-3671-4454-85a5-2cf13e231eff None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:40:30.075066 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 768/1557] 10.222.0.86 () {60 vars in 1152 bytes} [Tue Jun 7 14:40:29 2022] POST /identity/v3/projects => generated 379 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:40:30.076443 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf3bb74-af27-4ccf-9c39-40773e310547 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:30.076738 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf3bb74-af27-4ccf-9c39-40773e310547 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:30.077021 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf3bb74-af27-4ccf-9c39-40773e310547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:30.081230 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef67fd62-3671-4454-85a5-2cf13e231eff None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:40:30.094826 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-fcf3bb74-af27-4ccf-9c39-40773e310547 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:40:30.096045 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-fcf3bb74-af27-4ccf-9c39-40773e310547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:40:30.137268 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4e9e66-353c-48b9-ba81-e6f423aaca9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:40:30.137938 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4e9e66-353c-48b9-ba81-e6f423aaca9b admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:30.138222 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4e9e66-353c-48b9-ba81-e6f423aaca9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:30.138505 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4e9e66-353c-48b9-ba81-e6f423aaca9b admin admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:30.139228 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4e9e66-353c-48b9-ba81-e6f423aaca9b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:40:30.139539 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4e9e66-353c-48b9-ba81-e6f423aaca9b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:40:30.141164 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4e9e66-353c-48b9-ba81-e6f423aaca9b admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:40:30.153566 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 790/1558] 10.222.0.86 () {58 vars in 1152 bytes} [Tue Jun 7 14:40:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:40:30.154843 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a33998-b539-4321-be43-23c37334b6e0 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:30.155136 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a33998-b539-4321-be43-23c37334b6e0 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:30.155418 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a33998-b539-4321-be43-23c37334b6e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:30.157895 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 769/1559] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:40:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:40:30.158648 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf3bb74-af27-4ccf-9c39-40773e310547 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:40:30.168913 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf3bb74-af27-4ccf-9c39-40773e310547 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:40:30.173502 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec59392-b63d-4766-8910-8233ceff865b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:40:30.174155 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec59392-b63d-4766-8910-8233ceff865b admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:30.174432 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec59392-b63d-4766-8910-8233ceff865b admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:30.174710 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec59392-b63d-4766-8910-8233ceff865b admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:30.175437 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec59392-b63d-4766-8910-8233ceff865b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:40:30.175957 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-c0a33998-b539-4321-be43-23c37334b6e0 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:40:30.177079 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec59392-b63d-4766-8910-8233ceff865b admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:40:30.177213 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-c0a33998-b539-4321-be43-23c37334b6e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:40:30.185337 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 791/1560] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:40:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:40:30.186706 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317ef585-9505-4031-8a33-3e9951b4e318 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:30.186998 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317ef585-9505-4031-8a33-3e9951b4e318 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:30.187279 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317ef585-9505-4031-8a33-3e9951b4e318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:30.189423 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 770/1561] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:40:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:40:30.190388 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec59392-b63d-4766-8910-8233ceff865b admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:40:30.200660 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec59392-b63d-4766-8910-8233ceff865b admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:40:30.205939 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-317ef585-9505-4031-8a33-3e9951b4e318 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:40:30.207130 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-317ef585-9505-4031-8a33-3e9951b4e318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:40:30.207282 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ee665b-df2c-475e-aaa4-73202a36594b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:40:30.207844 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee665b-df2c-475e-aaa4-73202a36594b admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:30.208134 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee665b-df2c-475e-aaa4-73202a36594b admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:30.208411 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee665b-df2c-475e-aaa4-73202a36594b admin admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:30.209133 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ee665b-df2c-475e-aaa4-73202a36594b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:40:30.209493 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ee665b-df2c-475e-aaa4-73202a36594b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:40:30.211080 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ee665b-df2c-475e-aaa4-73202a36594b admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:40:30.212750 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:40:30.215082 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 792/1562] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:40:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:40:30.215894 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317ef585-9505-4031-8a33-3e9951b4e318 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:40:30.221577 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:40:30.228827 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 771/1563] 10.222.0.86 () {58 vars in 1152 bytes} [Tue Jun 7 14:40:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:40:30.228827 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ee665b-df2c-475e-aaa4-73202a36594b admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:40:30.229656 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317ef585-9505-4031-8a33-3e9951b4e318 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:40:30.231334 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d54e51d-09cc-4671-b18e-56a027e39f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:40:30.232662 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d54e51d-09cc-4671-b18e-56a027e39f21 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:30.233071 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d54e51d-09cc-4671-b18e-56a027e39f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:30.233245 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d54e51d-09cc-4671-b18e-56a027e39f21 admin admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:30.233975 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d54e51d-09cc-4671-b18e-56a027e39f21 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:40:30.234290 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d54e51d-09cc-4671-b18e-56a027e39f21 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:40:30.235410 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ee665b-df2c-475e-aaa4-73202a36594b admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:40:30.236090 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d54e51d-09cc-4671-b18e-56a027e39f21 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:40:30.240835 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76959a97-3309-4dca-98a0-ae43c80a8ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:40:30.241500 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76959a97-3309-4dca-98a0-ae43c80a8ae2 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:30.241786 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76959a97-3309-4dca-98a0-ae43c80a8ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:30.242066 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76959a97-3309-4dca-98a0-ae43c80a8ae2 admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:30.242799 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76959a97-3309-4dca-98a0-ae43c80a8ae2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:40:30.245348 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76959a97-3309-4dca-98a0-ae43c80a8ae2 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:40:30.248707 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 793/1564] 10.222.0.86 () {58 vars in 1152 bytes} [Tue Jun 7 14:40:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:40:30.249664 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d54e51d-09cc-4671-b18e-56a027e39f21 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:40:30.259960 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d54e51d-09cc-4671-b18e-56a027e39f21 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:40:30.264994 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1075508a-2c00-40bd-817f-53aa9254111b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:40:30.265602 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1075508a-2c00-40bd-817f-53aa9254111b admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:30.265874 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1075508a-2c00-40bd-817f-53aa9254111b admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:30.266147 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1075508a-2c00-40bd-817f-53aa9254111b admin admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:30.266873 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1075508a-2c00-40bd-817f-53aa9254111b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:40:30.267188 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1075508a-2c00-40bd-817f-53aa9254111b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:40:30.268812 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1075508a-2c00-40bd-817f-53aa9254111b admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:40:30.280902 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 794/1565] 10.222.0.86 () {58 vars in 1152 bytes} [Tue Jun 7 14:40:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:40:30.281838 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1075508a-2c00-40bd-817f-53aa9254111b admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:40:30.291003 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1075508a-2c00-40bd-817f-53aa9254111b admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:40:30.296355 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcef65b-69af-4466-9e3f-71c8f4893cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:40:30.296971 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcef65b-69af-4466-9e3f-71c8f4893cd4 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:30.297257 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcef65b-69af-4466-9e3f-71c8f4893cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:30.297534 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcef65b-69af-4466-9e3f-71c8f4893cd4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:30.298215 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcef65b-69af-4466-9e3f-71c8f4893cd4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:40:30.300086 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcef65b-69af-4466-9e3f-71c8f4893cd4 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:40:30.354581 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 772/1566] 10.222.0.86 () {60 vars in 1143 bytes} [Tue Jun 7 14:40:30 2022] POST /identity/v3/users => generated 290 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:40:30.355485 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76959a97-3309-4dca-98a0-ae43c80a8ae2 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:40:30.364730 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76959a97-3309-4dca-98a0-ae43c80a8ae2 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:40:30.369189 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf983fa-fd69-4337-87f9-cd96661b11c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:40:30.370437 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf983fa-fd69-4337-87f9-cd96661b11c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:30.370721 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf983fa-fd69-4337-87f9-cd96661b11c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:30.370993 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf983fa-fd69-4337-87f9-cd96661b11c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:30.371704 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf983fa-fd69-4337-87f9-cd96661b11c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:40:30.372042 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf983fa-fd69-4337-87f9-cd96661b11c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:40:30.373602 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf983fa-fd69-4337-87f9-cd96661b11c3 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:40:30.385171 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 773/1567] 10.222.0.86 () {58 vars in 1152 bytes} [Tue Jun 7 14:40:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:40:30.385935 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf983fa-fd69-4337-87f9-cd96661b11c3 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:40:30.394952 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf983fa-fd69-4337-87f9-cd96661b11c3 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:40:30.399686 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ae0fcf-b2a8-4f43-bccd-fc63b2518d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:40:30.400374 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ae0fcf-b2a8-4f43-bccd-fc63b2518d1b admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:30.400661 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ae0fcf-b2a8-4f43-bccd-fc63b2518d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:30.401472 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ae0fcf-b2a8-4f43-bccd-fc63b2518d1b admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:30.402181 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ae0fcf-b2a8-4f43-bccd-fc63b2518d1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:40:30.403919 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ae0fcf-b2a8-4f43-bccd-fc63b2518d1b admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:40:30.413912 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 774/1568] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:40:30 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:40:30.414722 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ae0fcf-b2a8-4f43-bccd-fc63b2518d1b admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:40:30.424640 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ae0fcf-b2a8-4f43-bccd-fc63b2518d1b admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:40:30.429392 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3909c91f-9706-4fae-aa48-5adb4c768458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:40:30.430036 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3909c91f-9706-4fae-aa48-5adb4c768458 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:30.430324 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3909c91f-9706-4fae-aa48-5adb4c768458 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:30.430604 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3909c91f-9706-4fae-aa48-5adb4c768458 admin admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:30.431328 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3909c91f-9706-4fae-aa48-5adb4c768458 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:40:30.431640 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3909c91f-9706-4fae-aa48-5adb4c768458 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:40:30.433609 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3909c91f-9706-4fae-aa48-5adb4c768458 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:40:30.445639 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 775/1569] 10.222.0.86 () {58 vars in 1152 bytes} [Tue Jun 7 14:40:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:40:30.446401 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3909c91f-9706-4fae-aa48-5adb4c768458 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:40:30.455586 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3909c91f-9706-4fae-aa48-5adb4c768458 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:40:30.460206 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e340208-9782-4fe4-b17a-d91e35e1b0d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:40:30.460824 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e340208-9782-4fe4-b17a-d91e35e1b0d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:30.461110 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e340208-9782-4fe4-b17a-d91e35e1b0d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:30.461424 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e340208-9782-4fe4-b17a-d91e35e1b0d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:30.462107 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e340208-9782-4fe4-b17a-d91e35e1b0d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:40:30.464571 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e340208-9782-4fe4-b17a-d91e35e1b0d4 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:40:30.474673 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 795/1570] 10.222.0.86 () {60 vars in 1152 bytes} [Tue Jun 7 14:40:30 2022] POST /identity/v3/projects => generated 385 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:40:30.474673 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcef65b-69af-4466-9e3f-71c8f4893cd4 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:40:30.533302 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcef65b-69af-4466-9e3f-71c8f4893cd4 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:40:30.537913 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfb090f-ab1c-4137-8789-ac75b5d9c255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:40:30.538565 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfb090f-ab1c-4137-8789-ac75b5d9c255 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:30.538850 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfb090f-ab1c-4137-8789-ac75b5d9c255 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:30.539129 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfb090f-ab1c-4137-8789-ac75b5d9c255 admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:30.539846 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfb090f-ab1c-4137-8789-ac75b5d9c255 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:40:30.541744 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfb090f-ab1c-4137-8789-ac75b5d9c255 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:40:30.574700 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 776/1571] 10.222.0.86 () {60 vars in 1152 bytes} [Tue Jun 7 14:40:30 2022] POST /identity/v3/projects => generated 375 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:40:30.575647 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e340208-9782-4fe4-b17a-d91e35e1b0d4 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:40:30.635526 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e340208-9782-4fe4-b17a-d91e35e1b0d4 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:40:30.640191 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd614a83-920a-43bf-a445-f967ecfb8adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:40:30.640874 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd614a83-920a-43bf-a445-f967ecfb8adf admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:30.641162 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd614a83-920a-43bf-a445-f967ecfb8adf admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:30.641448 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd614a83-920a-43bf-a445-f967ecfb8adf admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:30.642136 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd614a83-920a-43bf-a445-f967ecfb8adf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:40:30.644048 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd614a83-920a-43bf-a445-f967ecfb8adf admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:40:30.682664 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 796/1572] 10.222.0.86 () {60 vars in 1152 bytes} [Tue Jun 7 14:40:30 2022] POST /identity/v3/projects => generated 373 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:40:30.683849 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfb090f-ab1c-4137-8789-ac75b5d9c255 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:40:30.741260 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 777/1573] 10.222.0.86 () {60 vars in 1152 bytes} [Tue Jun 7 14:40:30 2022] POST /identity/v3/projects => generated 389 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:40:30.741260 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd614a83-920a-43bf-a445-f967ecfb8adf admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:40:30.743966 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfb090f-ab1c-4137-8789-ac75b5d9c255 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:40:30.790004 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:40:30.801707 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d036807-3ed6-43da-a3e4-18f2bcde91b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:40:30.802415 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d036807-3ed6-43da-a3e4-18f2bcde91b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:30.802541 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd614a83-920a-43bf-a445-f967ecfb8adf admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:40:30.802700 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d036807-3ed6-43da-a3e4-18f2bcde91b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:30.802978 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d036807-3ed6-43da-a3e4-18f2bcde91b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:30.803714 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d036807-3ed6-43da-a3e4-18f2bcde91b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:40:30.805484 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d036807-3ed6-43da-a3e4-18f2bcde91b9 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:40:30.810023 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b915b98-0343-42e5-a696-1c55e1bf43a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:40:30.810023 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b915b98-0343-42e5-a696-1c55e1bf43a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:30.810023 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b915b98-0343-42e5-a696-1c55e1bf43a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:30.810023 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b915b98-0343-42e5-a696-1c55e1bf43a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:30.810420 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b915b98-0343-42e5-a696-1c55e1bf43a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:40:30.811111 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b915b98-0343-42e5-a696-1c55e1bf43a5 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:40:30.815191 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:40:30.815728 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 797/1574] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:40:30 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:40:30.816378 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d036807-3ed6-43da-a3e4-18f2bcde91b9 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:40:30.826255 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d036807-3ed6-43da-a3e4-18f2bcde91b9 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:40:30.830983 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533e35a7-0e3e-4bad-9973-80732323968b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:40:30.831889 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533e35a7-0e3e-4bad-9973-80732323968b admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:30.832175 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533e35a7-0e3e-4bad-9973-80732323968b admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:30.832482 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533e35a7-0e3e-4bad-9973-80732323968b admin admin] PATH_INFO: `/v3/projects/e59e1d05b81b453198df47d3978d2f2d/users/d3e940e2c333442384f9217e79573981/roles/c17acc2a8bb348f59ba7edd22fcf0c47` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:30.847379 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533e35a7-0e3e-4bad-9973-80732323968b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e59e1d05b81b453198df47d3978d2f2d, user_id=d3e940e2c333442384f9217e79573981, role_id=c17acc2a8bb348f59ba7edd22fcf0c47)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:40:30.850082 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533e35a7-0e3e-4bad-9973-80732323968b admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:40:30.922753 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 778/1575] 10.222.0.86 () {60 vars in 1152 bytes} [Tue Jun 7 14:40:30 2022] POST /identity/v3/projects => generated 393 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:40:30.923898 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b915b98-0343-42e5-a696-1c55e1bf43a5 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:40:30.943147 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 798/1576] 10.222.0.86 () {60 vars in 1482 bytes} [Tue Jun 7 14:40:30 2022] PUT /identity/v3/projects/e59e1d05b81b453198df47d3978d2f2d/users/d3e940e2c333442384f9217e79573981/roles/c17acc2a8bb348f59ba7edd22fcf0c47 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:40:30.946031 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533e35a7-0e3e-4bad-9973-80732323968b admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:40:30.985105 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b915b98-0343-42e5-a696-1c55e1bf43a5 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:40:31.004862 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533e35a7-0e3e-4bad-9973-80732323968b admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:40:31.009489 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8985962-a513-4834-b0c0-7cbc20b1ca65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:40:31.010667 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8985962-a513-4834-b0c0-7cbc20b1ca65 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:31.010954 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8985962-a513-4834-b0c0-7cbc20b1ca65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:31.011275 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8985962-a513-4834-b0c0-7cbc20b1ca65 admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:31.012044 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8985962-a513-4834-b0c0-7cbc20b1ca65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:40:31.014614 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8985962-a513-4834-b0c0-7cbc20b1ca65 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:40:31.040681 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068f4b68-4ea6-465e-889f-1f970456c05a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:40:31.041273 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068f4b68-4ea6-465e-889f-1f970456c05a admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:31.041599 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068f4b68-4ea6-465e-889f-1f970456c05a admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:31.041878 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068f4b68-4ea6-465e-889f-1f970456c05a admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:31.042576 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068f4b68-4ea6-465e-889f-1f970456c05a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:40:31.044564 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068f4b68-4ea6-465e-889f-1f970456c05a admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:40:31.105021 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 799/1577] 10.222.0.86 () {60 vars in 1143 bytes} [Tue Jun 7 14:40:30 2022] POST /identity/v3/users => generated 293 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:40:31.106108 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8985962-a513-4834-b0c0-7cbc20b1ca65 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:40:31.115254 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8985962-a513-4834-b0c0-7cbc20b1ca65 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:40:31.119775 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c8fb3a-46c4-414f-ae9f-985f52d8ab90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:40:31.120421 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c8fb3a-46c4-414f-ae9f-985f52d8ab90 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:31.120703 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c8fb3a-46c4-414f-ae9f-985f52d8ab90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:31.120977 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c8fb3a-46c4-414f-ae9f-985f52d8ab90 admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:31.121641 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c8fb3a-46c4-414f-ae9f-985f52d8ab90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:40:31.123525 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c8fb3a-46c4-414f-ae9f-985f52d8ab90 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:40:31.138315 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 779/1578] 10.222.0.86 () {60 vars in 1152 bytes} [Tue Jun 7 14:40:30 2022] POST /identity/v3/projects => generated 363 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:40:31.138315 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068f4b68-4ea6-465e-889f-1f970456c05a admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:40:31.196718 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068f4b68-4ea6-465e-889f-1f970456c05a admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:40:31.202231 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4685f6-e9f2-4b47-976c-bb7c7c7e2812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:40:31.202903 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4685f6-e9f2-4b47-976c-bb7c7c7e2812 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:31.203189 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4685f6-e9f2-4b47-976c-bb7c7c7e2812 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:31.203468 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4685f6-e9f2-4b47-976c-bb7c7c7e2812 admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:31.204242 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4685f6-e9f2-4b47-976c-bb7c7c7e2812 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:40:31.206242 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4685f6-e9f2-4b47-976c-bb7c7c7e2812 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:40:31.231719 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 800/1579] 10.222.0.86 () {60 vars in 1143 bytes} [Tue Jun 7 14:40:31 2022] POST /identity/v3/users => generated 288 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:40:31.231719 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c8fb3a-46c4-414f-ae9f-985f52d8ab90 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:40:31.241725 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c8fb3a-46c4-414f-ae9f-985f52d8ab90 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:40:31.246740 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ffcf17-15ab-495c-b38d-955d54f280a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:40:31.247384 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ffcf17-15ab-495c-b38d-955d54f280a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:31.247670 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ffcf17-15ab-495c-b38d-955d54f280a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:31.247984 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ffcf17-15ab-495c-b38d-955d54f280a7 admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:31.248673 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ffcf17-15ab-495c-b38d-955d54f280a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:40:31.250572 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ffcf17-15ab-495c-b38d-955d54f280a7 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:40:31.340040 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 780/1580] 10.222.0.86 () {60 vars in 1143 bytes} [Tue Jun 7 14:40:31 2022] POST /identity/v3/users => generated 287 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:40:31.340932 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4685f6-e9f2-4b47-976c-bb7c7c7e2812 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:40:31.350591 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4685f6-e9f2-4b47-976c-bb7c7c7e2812 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:40:31.355350 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3f78b2-0e08-4cd1-9499-dc9888128425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:40:31.356064 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3f78b2-0e08-4cd1-9499-dc9888128425 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:31.356351 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3f78b2-0e08-4cd1-9499-dc9888128425 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:31.356631 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3f78b2-0e08-4cd1-9499-dc9888128425 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:31.357360 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3f78b2-0e08-4cd1-9499-dc9888128425 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:40:31.358934 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3f78b2-0e08-4cd1-9499-dc9888128425 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:40:31.361031 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:40:31.370237 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 781/1581] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:40:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:40:31.370986 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3f78b2-0e08-4cd1-9499-dc9888128425 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:40:31.380279 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3f78b2-0e08-4cd1-9499-dc9888128425 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:40:31.384413 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 801/1582] 10.222.0.86 () {60 vars in 1143 bytes} [Tue Jun 7 14:40:31 2022] POST /identity/v3/users => generated 295 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:40:31.386339 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740d46b2-6486-414e-b89b-7ea5d07adc2c None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:31.386636 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740d46b2-6486-414e-b89b-7ea5d07adc2c None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:31.386916 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740d46b2-6486-414e-b89b-7ea5d07adc2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:31.388516 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6f88a6-b31c-4fa0-b94c-d4a9ad0f8fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:40:31.389728 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6f88a6-b31c-4fa0-b94c-d4a9ad0f8fe1 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:31.390034 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6f88a6-b31c-4fa0-b94c-d4a9ad0f8fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:31.390290 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6f88a6-b31c-4fa0-b94c-d4a9ad0f8fe1 admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:31.391011 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6f88a6-b31c-4fa0-b94c-d4a9ad0f8fe1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:40:31.393133 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6f88a6-b31c-4fa0-b94c-d4a9ad0f8fe1 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:40:31.414564 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-740d46b2-6486-414e-b89b-7ea5d07adc2c None None] MFA Rules not processed for user `d3e940e2c333442384f9217e79573981`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:40:31.415782 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-740d46b2-6486-414e-b89b-7ea5d07adc2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:40:31.479851 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 802/1583] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:40:31 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:40:31.480706 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740d46b2-6486-414e-b89b-7ea5d07adc2c None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:40:31.486825 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:40:31.491127 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740d46b2-6486-414e-b89b-7ea5d07adc2c None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:40:31.496531 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6293ff-3dd8-472f-8eca-98ccbaf7f0ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:40:31.497297 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6293ff-3dd8-472f-8eca-98ccbaf7f0ba admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:31.497491 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6293ff-3dd8-472f-8eca-98ccbaf7f0ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:31.497777 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6293ff-3dd8-472f-8eca-98ccbaf7f0ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:31.498461 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6293ff-3dd8-472f-8eca-98ccbaf7f0ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:40:31.500162 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6293ff-3dd8-472f-8eca-98ccbaf7f0ba admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:40:31.505534 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 782/1584] 10.222.0.86 () {60 vars in 1143 bytes} [Tue Jun 7 14:40:31 2022] POST /identity/v3/users => generated 297 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:40:31.506184 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6f88a6-b31c-4fa0-b94c-d4a9ad0f8fe1 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:40:31.513259 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 803/1585] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:40:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:40:31.514108 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6293ff-3dd8-472f-8eca-98ccbaf7f0ba admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:40:31.519878 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6f88a6-b31c-4fa0-b94c-d4a9ad0f8fe1 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:40:31.523746 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6293ff-3dd8-472f-8eca-98ccbaf7f0ba admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:40:31.524724 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32252a1c-68e1-47e0-8953-84b1f7044420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:40:31.525465 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32252a1c-68e1-47e0-8953-84b1f7044420 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:31.527028 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32252a1c-68e1-47e0-8953-84b1f7044420 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:31.527539 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32252a1c-68e1-47e0-8953-84b1f7044420 admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:31.528476 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32252a1c-68e1-47e0-8953-84b1f7044420 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:40:31.528982 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60be98a-fc99-42db-971a-fcfcbb983d4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:40:31.529652 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60be98a-fc99-42db-971a-fcfcbb983d4f admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:31.529940 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60be98a-fc99-42db-971a-fcfcbb983d4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:31.530222 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60be98a-fc99-42db-971a-fcfcbb983d4f admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:31.530685 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32252a1c-68e1-47e0-8953-84b1f7044420 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:40:31.530938 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60be98a-fc99-42db-971a-fcfcbb983d4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:40:31.532570 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60be98a-fc99-42db-971a-fcfcbb983d4f admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:40:31.545057 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 804/1586] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:40:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:40:31.545877 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60be98a-fc99-42db-971a-fcfcbb983d4f admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:40:31.555132 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60be98a-fc99-42db-971a-fcfcbb983d4f admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:40:31.560191 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75ec777-f5cd-47fb-8246-97015a23a8ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:40:31.560803 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75ec777-f5cd-47fb-8246-97015a23a8ca admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:31.561084 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75ec777-f5cd-47fb-8246-97015a23a8ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:31.561356 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75ec777-f5cd-47fb-8246-97015a23a8ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:31.562053 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75ec777-f5cd-47fb-8246-97015a23a8ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:40:31.563607 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75ec777-f5cd-47fb-8246-97015a23a8ca admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:40:31.573542 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 805/1587] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:40:31 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:40:31.574276 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75ec777-f5cd-47fb-8246-97015a23a8ca admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:40:31.583045 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75ec777-f5cd-47fb-8246-97015a23a8ca admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:40:31.587563 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16e495e-0228-4b5b-9d84-ce895152d497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:40:31.588648 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16e495e-0228-4b5b-9d84-ce895152d497 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:31.588929 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16e495e-0228-4b5b-9d84-ce895152d497 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:31.589206 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16e495e-0228-4b5b-9d84-ce895152d497 admin admin] PATH_INFO: `/v3/projects/a38ec3eb18bc42d2b83392f305fcfcc8/users/d71f4ee8182f48cdae6870a6e3be97e2/roles/c17acc2a8bb348f59ba7edd22fcf0c47` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:31.603097 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16e495e-0228-4b5b-9d84-ce895152d497 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a38ec3eb18bc42d2b83392f305fcfcc8, user_id=d71f4ee8182f48cdae6870a6e3be97e2, role_id=c17acc2a8bb348f59ba7edd22fcf0c47)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:40:31.606282 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16e495e-0228-4b5b-9d84-ce895152d497 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:40:31.630267 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 783/1588] 10.222.0.86 () {60 vars in 1143 bytes} [Tue Jun 7 14:40:31 2022] POST /identity/v3/users => generated 282 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:40:31.631391 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32252a1c-68e1-47e0-8953-84b1f7044420 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:40:31.640842 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32252a1c-68e1-47e0-8953-84b1f7044420 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:40:31.645426 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57885a16-ec2c-42a4-a6de-4e2804000419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:40:31.647974 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57885a16-ec2c-42a4-a6de-4e2804000419 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:31.647974 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57885a16-ec2c-42a4-a6de-4e2804000419 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:31.647974 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57885a16-ec2c-42a4-a6de-4e2804000419 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:31.647974 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57885a16-ec2c-42a4-a6de-4e2804000419 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:40:31.649207 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57885a16-ec2c-42a4-a6de-4e2804000419 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:40:31.658938 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 784/1589] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:40:31 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:40:31.660284 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfd3453-d33d-4a6e-9427-453179ef7033 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:31.660583 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfd3453-d33d-4a6e-9427-453179ef7033 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:31.660847 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfd3453-d33d-4a6e-9427-453179ef7033 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:31.662207 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 785/1590] 10.222.0.86 () {54 vars in 961 bytes} [Tue Jun 7 14:40:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:40:31.662905 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfd3453-d33d-4a6e-9427-453179ef7033 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:40:31.675557 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfd3453-d33d-4a6e-9427-453179ef7033 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:40:31.680004 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9711949-db73-4abe-a418-423c457d0fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:40:31.680608 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9711949-db73-4abe-a418-423c457d0fc2 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:31.680893 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9711949-db73-4abe-a418-423c457d0fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:31.681196 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9711949-db73-4abe-a418-423c457d0fc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:31.681908 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9711949-db73-4abe-a418-423c457d0fc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:40:31.684128 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9711949-db73-4abe-a418-423c457d0fc2 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:40:31.686070 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 806/1591] 10.222.0.86 () {60 vars in 1482 bytes} [Tue Jun 7 14:40:31 2022] PUT /identity/v3/projects/a38ec3eb18bc42d2b83392f305fcfcc8/users/d71f4ee8182f48cdae6870a6e3be97e2/roles/c17acc2a8bb348f59ba7edd22fcf0c47 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:40:31.686730 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16e495e-0228-4b5b-9d84-ce895152d497 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:40:31.698639 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 786/1592] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:40:31 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:40:31.699587 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9711949-db73-4abe-a418-423c457d0fc2 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:40:31.709132 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9711949-db73-4abe-a418-423c457d0fc2 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:40:31.749118 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16e495e-0228-4b5b-9d84-ce895152d497 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:40:31.753899 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1095a7-dc4c-4a90-a126-4979d40b14e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:40:31.754567 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1095a7-dc4c-4a90-a126-4979d40b14e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:31.754854 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1095a7-dc4c-4a90-a126-4979d40b14e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:31.755139 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1095a7-dc4c-4a90-a126-4979d40b14e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:31.756033 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1095a7-dc4c-4a90-a126-4979d40b14e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:40:31.757705 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1095a7-dc4c-4a90-a126-4979d40b14e2 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:40:31.765860 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262990fd-5d51-4770-a47d-9b6e40d05f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:40:31.766526 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262990fd-5d51-4770-a47d-9b6e40d05f53 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:31.766814 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262990fd-5d51-4770-a47d-9b6e40d05f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:31.767096 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262990fd-5d51-4770-a47d-9b6e40d05f53 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:31.767444 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 807/1593] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:40:31 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:40:31.767861 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262990fd-5d51-4770-a47d-9b6e40d05f53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:40:31.769510 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262990fd-5d51-4770-a47d-9b6e40d05f53 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:40:31.772827 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1095a7-dc4c-4a90-a126-4979d40b14e2 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:40:31.783701 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 787/1594] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:40:31 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:40:31.783701 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262990fd-5d51-4770-a47d-9b6e40d05f53 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:40:31.784010 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1095a7-dc4c-4a90-a126-4979d40b14e2 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:40:31.788700 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5b1256-19f7-448a-bfa4-a9f007583472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:40:31.789905 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5b1256-19f7-448a-bfa4-a9f007583472 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:31.790318 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5b1256-19f7-448a-bfa4-a9f007583472 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:31.790604 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5b1256-19f7-448a-bfa4-a9f007583472 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:31.791951 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5b1256-19f7-448a-bfa4-a9f007583472 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:40:31.793547 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5b1256-19f7-448a-bfa4-a9f007583472 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:40:31.793673 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262990fd-5d51-4770-a47d-9b6e40d05f53 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:40:31.798260 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37033187-82b0-44db-a04b-b6e561641019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:40:31.798934 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37033187-82b0-44db-a04b-b6e561641019 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:31.799220 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37033187-82b0-44db-a04b-b6e561641019 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:31.799499 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37033187-82b0-44db-a04b-b6e561641019 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:31.800258 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37033187-82b0-44db-a04b-b6e561641019 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:40:31.801833 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37033187-82b0-44db-a04b-b6e561641019 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:40:31.804633 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 808/1595] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:40:31 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:40:31.806661 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5b1256-19f7-448a-bfa4-a9f007583472 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:40:31.812844 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 788/1596] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:40:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:40:31.813723 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c487d984-5981-4f30-ad5f-8bf229e07f56 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:31.814047 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c487d984-5981-4f30-ad5f-8bf229e07f56 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:31.814386 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c487d984-5981-4f30-ad5f-8bf229e07f56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:31.816746 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5b1256-19f7-448a-bfa4-a9f007583472 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:40:31.821486 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e27af80-1c36-4425-9b84-0b39ef2a3f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:40:31.822134 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e27af80-1c36-4425-9b84-0b39ef2a3f4a admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:31.822419 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e27af80-1c36-4425-9b84-0b39ef2a3f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:31.823250 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e27af80-1c36-4425-9b84-0b39ef2a3f4a admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:31.824000 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e27af80-1c36-4425-9b84-0b39ef2a3f4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:40:31.825579 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e27af80-1c36-4425-9b84-0b39ef2a3f4a admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:40:31.832617 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-c487d984-5981-4f30-ad5f-8bf229e07f56 None None] MFA Rules not processed for user `b99cfb70f54c45c8870369359da20378`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:40:31.839470 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-c487d984-5981-4f30-ad5f-8bf229e07f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:40:31.839607 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 809/1597] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:40:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:40:31.839607 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e745e6-0fc1-4139-8d7b-5ccae9037f1f None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:31.839607 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e745e6-0fc1-4139-8d7b-5ccae9037f1f None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:31.839607 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e745e6-0fc1-4139-8d7b-5ccae9037f1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:31.856104 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-f0e745e6-0fc1-4139-8d7b-5ccae9037f1f None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:40:31.857411 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-f0e745e6-0fc1-4139-8d7b-5ccae9037f1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:40:31.864704 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 810/1598] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:40:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:40:31.866741 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e745e6-0fc1-4139-8d7b-5ccae9037f1f None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:40:31.875871 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e745e6-0fc1-4139-8d7b-5ccae9037f1f None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:40:31.880597 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352513f7-ecdc-4788-b607-2b956a7ba5a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:40:31.881265 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352513f7-ecdc-4788-b607-2b956a7ba5a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:31.881553 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352513f7-ecdc-4788-b607-2b956a7ba5a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:31.881829 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352513f7-ecdc-4788-b607-2b956a7ba5a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:31.882555 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352513f7-ecdc-4788-b607-2b956a7ba5a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:40:31.884219 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352513f7-ecdc-4788-b607-2b956a7ba5a9 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:40:31.896618 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 811/1599] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:40:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:40:31.897619 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352513f7-ecdc-4788-b607-2b956a7ba5a9 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:40:31.907524 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352513f7-ecdc-4788-b607-2b956a7ba5a9 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:40:31.912192 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddf00f6-0ba6-4a59-b401-8a91248589e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:40:31.913063 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddf00f6-0ba6-4a59-b401-8a91248589e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:31.913349 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddf00f6-0ba6-4a59-b401-8a91248589e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:31.913629 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddf00f6-0ba6-4a59-b401-8a91248589e4 admin admin] PATH_INFO: `/v3/projects/84fbbe1a32c745aabbde02f8eff9343a/users/bd70563183ab43d68df41f1be27cadc3/roles/c17acc2a8bb348f59ba7edd22fcf0c47` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:31.915571 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 789/1600] 10.222.0.86 () {58 vars in 1058 bytes} [Tue Jun 7 14:40:31 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:40:31.916536 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c487d984-5981-4f30-ad5f-8bf229e07f56 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:40:31.926759 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c487d984-5981-4f30-ad5f-8bf229e07f56 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:40:31.928750 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddf00f6-0ba6-4a59-b401-8a91248589e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84fbbe1a32c745aabbde02f8eff9343a, user_id=bd70563183ab43d68df41f1be27cadc3, role_id=c17acc2a8bb348f59ba7edd22fcf0c47)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:40:31.931217 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3a4f17-2c41-4518-bf9f-18668f5f821e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:40:31.931400 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddf00f6-0ba6-4a59-b401-8a91248589e4 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:40:31.932647 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3a4f17-2c41-4518-bf9f-18668f5f821e admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:31.932930 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3a4f17-2c41-4518-bf9f-18668f5f821e admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:31.933206 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3a4f17-2c41-4518-bf9f-18668f5f821e admin admin] PATH_INFO: `/v3/projects/0fc4ea7acf86499a8abd7b5f2cdfd6f1/users/3d5a010550bb4bf783a3cf75153d7e9f/roles/c17acc2a8bb348f59ba7edd22fcf0c47` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:31.947490 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3a4f17-2c41-4518-bf9f-18668f5f821e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fc4ea7acf86499a8abd7b5f2cdfd6f1, user_id=3d5a010550bb4bf783a3cf75153d7e9f, role_id=c17acc2a8bb348f59ba7edd22fcf0c47)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:40:31.948614 dv-cinder-844974-1-smb devstack@keystone.service[80418]: WARNING py.warnings [None req-7f3a4f17-2c41-4518-bf9f-18668f5f821e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 07 14:40:31.948614 dv-cinder-844974-1-smb devstack@keystone.service[80418]: warnings.warn(msg) Jun 07 14:40:31.948614 dv-cinder-844974-1-smb devstack@keystone.service[80418]: Jun 07 14:40:31.950533 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3a4f17-2c41-4518-bf9f-18668f5f821e admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:40:31.952720 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:40:31.999572 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 812/1601] 10.222.0.86 () {60 vars in 1482 bytes} [Tue Jun 7 14:40:31 2022] PUT /identity/v3/projects/84fbbe1a32c745aabbde02f8eff9343a/users/bd70563183ab43d68df41f1be27cadc3/roles/c17acc2a8bb348f59ba7edd22fcf0c47 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:40:32.000416 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddf00f6-0ba6-4a59-b401-8a91248589e4 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:40:32.035738 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 790/1602] 10.222.0.86 () {60 vars in 1482 bytes} [Tue Jun 7 14:40:31 2022] PUT /identity/v3/projects/0fc4ea7acf86499a8abd7b5f2cdfd6f1/users/3d5a010550bb4bf783a3cf75153d7e9f/roles/c17acc2a8bb348f59ba7edd22fcf0c47 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:40:32.036681 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3a4f17-2c41-4518-bf9f-18668f5f821e admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:40:32.045892 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:40:32.064762 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddf00f6-0ba6-4a59-b401-8a91248589e4 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:40:32.098721 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3a4f17-2c41-4518-bf9f-18668f5f821e admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:40:32.103721 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb790441-977e-41fe-97cb-c2af85aaf8d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:40:32.105021 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb790441-977e-41fe-97cb-c2af85aaf8d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:32.105307 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb790441-977e-41fe-97cb-c2af85aaf8d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:32.105584 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb790441-977e-41fe-97cb-c2af85aaf8d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:32.106375 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb790441-977e-41fe-97cb-c2af85aaf8d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:40:32.107939 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb790441-977e-41fe-97cb-c2af85aaf8d0 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:40:32.117632 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 791/1603] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:40:32 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:40:32.118444 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb790441-977e-41fe-97cb-c2af85aaf8d0 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:40:32.121535 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526da64e-cb49-48be-8af4-397bb022187d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:40:32.122428 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526da64e-cb49-48be-8af4-397bb022187d admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:32.122711 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526da64e-cb49-48be-8af4-397bb022187d admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:32.122991 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526da64e-cb49-48be-8af4-397bb022187d admin admin] PATH_INFO: `/v3/projects/fa5a3e974e494d8a8457f49e07aefba6/users/4116aad0b8384cebb6be85aab26a5afe/roles/c17acc2a8bb348f59ba7edd22fcf0c47` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:32.130500 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb790441-977e-41fe-97cb-c2af85aaf8d0 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:40:32.135400 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939f312f-bfd2-4e7f-9f21-2bda1a6ed6e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:40:32.136435 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939f312f-bfd2-4e7f-9f21-2bda1a6ed6e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:32.136731 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939f312f-bfd2-4e7f-9f21-2bda1a6ed6e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:32.137011 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939f312f-bfd2-4e7f-9f21-2bda1a6ed6e0 admin admin] PATH_INFO: `/v3/projects/9fae31b8695447cbb1ad3e82004bffd7/users/65552520abca41ab8728a75046dc94d5/roles/c17acc2a8bb348f59ba7edd22fcf0c47` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:32.137960 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526da64e-cb49-48be-8af4-397bb022187d admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa5a3e974e494d8a8457f49e07aefba6, user_id=4116aad0b8384cebb6be85aab26a5afe, role_id=c17acc2a8bb348f59ba7edd22fcf0c47)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:40:32.140680 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526da64e-cb49-48be-8af4-397bb022187d admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:40:32.152197 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939f312f-bfd2-4e7f-9f21-2bda1a6ed6e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fae31b8695447cbb1ad3e82004bffd7, user_id=65552520abca41ab8728a75046dc94d5, role_id=c17acc2a8bb348f59ba7edd22fcf0c47)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:40:32.154816 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939f312f-bfd2-4e7f-9f21-2bda1a6ed6e0 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:40:32.253386 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 813/1604] 10.222.0.86 () {60 vars in 1482 bytes} [Tue Jun 7 14:40:31 2022] PUT /identity/v3/projects/fa5a3e974e494d8a8457f49e07aefba6/users/4116aad0b8384cebb6be85aab26a5afe/roles/c17acc2a8bb348f59ba7edd22fcf0c47 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:40:32.254291 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526da64e-cb49-48be-8af4-397bb022187d admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:40:32.304966 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 792/1605] 10.222.0.86 () {60 vars in 1482 bytes} [Tue Jun 7 14:40:32 2022] PUT /identity/v3/projects/9fae31b8695447cbb1ad3e82004bffd7/users/65552520abca41ab8728a75046dc94d5/roles/c17acc2a8bb348f59ba7edd22fcf0c47 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:40:32.305813 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939f312f-bfd2-4e7f-9f21-2bda1a6ed6e0 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:40:32.309444 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526da64e-cb49-48be-8af4-397bb022187d admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:40:32.358704 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510b078b-3faa-411c-b346-2b0ed38f1461 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dda603ec5517460a83c333db2af804d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:40:32.359314 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510b078b-3faa-411c-b346-2b0ed38f1461 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:32.359599 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510b078b-3faa-411c-b346-2b0ed38f1461 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:32.360003 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510b078b-3faa-411c-b346-2b0ed38f1461 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:32.368819 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510b078b-3faa-411c-b346-2b0ed38f1461 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:40:32.370210 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939f312f-bfd2-4e7f-9f21-2bda1a6ed6e0 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:40:32.370806 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510b078b-3faa-411c-b346-2b0ed38f1461 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:40:32.374970 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755f400e-360e-4fbd-bf85-d167743716a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:40:32.375974 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755f400e-360e-4fbd-bf85-d167743716a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:32.376332 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755f400e-360e-4fbd-bf85-d167743716a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:32.376682 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755f400e-360e-4fbd-bf85-d167743716a2 admin admin] PATH_INFO: `/v3/projects/61d7568c92aa4becb13de9bdba6156e1/users/68698bf3cf7a4dee9daa865e9d6454ee/roles/c17acc2a8bb348f59ba7edd22fcf0c47` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:32.380124 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 814/1606] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:40:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:40:32.380921 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510b078b-3faa-411c-b346-2b0ed38f1461 service neutron] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:40:32.392466 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755f400e-360e-4fbd-bf85-d167743716a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61d7568c92aa4becb13de9bdba6156e1, user_id=68698bf3cf7a4dee9daa865e9d6454ee, role_id=c17acc2a8bb348f59ba7edd22fcf0c47)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:40:32.396017 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755f400e-360e-4fbd-bf85-d167743716a2 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:40:32.412661 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:40:32.450814 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510b078b-3faa-411c-b346-2b0ed38f1461 service neutron] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:40:32.456320 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59e65fd-ab96-4a14-9e57-99e5d71ee79b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99cfb70f54c45c8870369359da20378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:40:32.456987 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59e65fd-ab96-4a14-9e57-99e5d71ee79b service nova] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:32.457302 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59e65fd-ab96-4a14-9e57-99e5d71ee79b service nova] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:32.457709 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59e65fd-ab96-4a14-9e57-99e5d71ee79b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:32.465268 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 793/1607] 10.222.0.86 () {60 vars in 1482 bytes} [Tue Jun 7 14:40:32 2022] PUT /identity/v3/projects/61d7568c92aa4becb13de9bdba6156e1/users/68698bf3cf7a4dee9daa865e9d6454ee/roles/c17acc2a8bb348f59ba7edd22fcf0c47 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:40:32.469006 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15313fc0-0ee6-43c4-80d4-a4fa181e4fa1 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:32.469006 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15313fc0-0ee6-43c4-80d4-a4fa181e4fa1 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:32.469006 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15313fc0-0ee6-43c4-80d4-a4fa181e4fa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:32.484164 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-15313fc0-0ee6-43c4-80d4-a4fa181e4fa1 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:40:32.485477 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-15313fc0-0ee6-43c4-80d4-a4fa181e4fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:40:32.518548 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59e65fd-ab96-4a14-9e57-99e5d71ee79b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:40:32.520722 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59e65fd-ab96-4a14-9e57-99e5d71ee79b service nova] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:40:32.531216 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 815/1608] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:40:32 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:40:32.533790 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759566fa-44b9-4dd6-ab7d-cab1b12a33a5 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:32.534540 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759566fa-44b9-4dd6-ab7d-cab1b12a33a5 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:32.535185 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759566fa-44b9-4dd6-ab7d-cab1b12a33a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:32.536211 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:40:32.553611 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 794/1609] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:40:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:40:32.554887 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15313fc0-0ee6-43c4-80d4-a4fa181e4fa1 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:40:32.558802 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-759566fa-44b9-4dd6-ab7d-cab1b12a33a5 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:40:32.561135 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-759566fa-44b9-4dd6-ab7d-cab1b12a33a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:40:32.566317 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15313fc0-0ee6-43c4-80d4-a4fa181e4fa1 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:40:32.571790 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacc1fad-bf11-41c7-8bf1-e6ed28455ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:40:32.572125 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 816/1610] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:40:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:40:32.573701 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacc1fad-bf11-41c7-8bf1-e6ed28455ceb admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:32.574221 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89741eb-c264-4300-9850-22ce294b2909 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:32.574457 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacc1fad-bf11-41c7-8bf1-e6ed28455ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:32.574841 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89741eb-c264-4300-9850-22ce294b2909 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:32.574971 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacc1fad-bf11-41c7-8bf1-e6ed28455ceb admin admin] PATH_INFO: `/v3/projects/a312f7d64da543c29266f37cbc9719be/users/828ba267fd494266a7b4c22cb852fbd6/roles/c17acc2a8bb348f59ba7edd22fcf0c47` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:32.575418 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89741eb-c264-4300-9850-22ce294b2909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:32.593036 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacc1fad-bf11-41c7-8bf1-e6ed28455ceb admin admin] RBAC: Authorizing `identity:create_grant(project_id=a312f7d64da543c29266f37cbc9719be, user_id=828ba267fd494266a7b4c22cb852fbd6, role_id=c17acc2a8bb348f59ba7edd22fcf0c47)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:40:32.598896 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacc1fad-bf11-41c7-8bf1-e6ed28455ceb admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:40:32.608561 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-d89741eb-c264-4300-9850-22ce294b2909 None None] MFA Rules not processed for user `4116aad0b8384cebb6be85aab26a5afe`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:40:32.609826 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-d89741eb-c264-4300-9850-22ce294b2909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:40:32.672584 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 817/1611] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:40:32 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:40:32.673905 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b343c49b-2c09-4098-8180-c408f196c810 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:32.674196 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b343c49b-2c09-4098-8180-c408f196c810 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:32.674610 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b343c49b-2c09-4098-8180-c408f196c810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:32.692476 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 795/1612] 10.222.0.86 () {60 vars in 1482 bytes} [Tue Jun 7 14:40:32 2022] PUT /identity/v3/projects/a312f7d64da543c29266f37cbc9719be/users/828ba267fd494266a7b4c22cb852fbd6/roles/c17acc2a8bb348f59ba7edd22fcf0c47 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:40:32.693664 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-b343c49b-2c09-4098-8180-c408f196c810 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:40:32.695281 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-b343c49b-2c09-4098-8180-c408f196c810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:40:32.704420 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e211d0f6-9cb8-492e-9b7c-7ea10cb2a5e7 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:32.704721 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e211d0f6-9cb8-492e-9b7c-7ea10cb2a5e7 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:32.705614 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e211d0f6-9cb8-492e-9b7c-7ea10cb2a5e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:32.726449 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-e211d0f6-9cb8-492e-9b7c-7ea10cb2a5e7 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:40:32.728149 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-e211d0f6-9cb8-492e-9b7c-7ea10cb2a5e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:40:32.784882 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 818/1613] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:40:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:40:32.786184 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b343c49b-2c09-4098-8180-c408f196c810 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:40:32.793550 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-b343c49b-2c09-4098-8180-c408f196c810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:40:32.805637 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:40:32.813383 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 796/1614] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:40:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:40:32.814174 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e211d0f6-9cb8-492e-9b7c-7ea10cb2a5e7 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:40:32.823179 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-e211d0f6-9cb8-492e-9b7c-7ea10cb2a5e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:40:32.863645 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b343c49b-2c09-4098-8180-c408f196c810 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:40:32.867240 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a65f2ab-a39c-4a94-827b-67bcc8400a3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dda603ec5517460a83c333db2af804d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:40:32.867946 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a65f2ab-a39c-4a94-827b-67bcc8400a3b service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:32.868245 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a65f2ab-a39c-4a94-827b-67bcc8400a3b service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:32.868557 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a65f2ab-a39c-4a94-827b-67bcc8400a3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:32.872835 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e211d0f6-9cb8-492e-9b7c-7ea10cb2a5e7 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:40:32.876414 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73910ce-d3ab-441a-be0b-3a81a5f93075 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dda603ec5517460a83c333db2af804d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:40:32.877063 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73910ce-d3ab-441a-be0b-3a81a5f93075 service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:32.877348 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73910ce-d3ab-441a-be0b-3a81a5f93075 service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:32.877591 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a65f2ab-a39c-4a94-827b-67bcc8400a3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:40:32.877710 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73910ce-d3ab-441a-be0b-3a81a5f93075 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:32.879077 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a65f2ab-a39c-4a94-827b-67bcc8400a3b service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:40:32.887744 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73910ce-d3ab-441a-be0b-3a81a5f93075 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:40:32.890187 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 819/1615] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:40:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:40:32.890308 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73910ce-d3ab-441a-be0b-3a81a5f93075 service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:40:32.890410 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a65f2ab-a39c-4a94-827b-67bcc8400a3b service neutron] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:40:32.898605 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a65f2ab-a39c-4a94-827b-67bcc8400a3b service neutron] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:40:32.900314 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 797/1616] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:40:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:40:32.902771 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b13c578-e519-43fd-9086-8db311fe936b None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:32.902912 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b13c578-e519-43fd-9086-8db311fe936b None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:32.903154 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b13c578-e519-43fd-9086-8db311fe936b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:32.903968 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cb7864-c4fd-4d61-9e69-acf67d631b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:40:32.904627 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cb7864-c4fd-4d61-9e69-acf67d631b84 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:32.904910 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cb7864-c4fd-4d61-9e69-acf67d631b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:32.905187 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cb7864-c4fd-4d61-9e69-acf67d631b84 admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:32.905881 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cb7864-c4fd-4d61-9e69-acf67d631b84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:40:32.919152 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cb7864-c4fd-4d61-9e69-acf67d631b84 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:40:32.938837 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-2b13c578-e519-43fd-9086-8db311fe936b None None] MFA Rules not processed for user `828ba267fd494266a7b4c22cb852fbd6`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:40:32.940907 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-2b13c578-e519-43fd-9086-8db311fe936b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:40:33.000459 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:40:33.005827 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 798/1617] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:40:32 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:40:33.007152 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4440a00-f87b-40df-a9dd-08db1e3a6074 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:33.007440 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4440a00-f87b-40df-a9dd-08db1e3a6074 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:33.007717 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4440a00-f87b-40df-a9dd-08db1e3a6074 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:33.009189 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 799/1618] 10.222.0.86 () {54 vars in 912 bytes} [Tue Jun 7 14:40:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:40:33.010028 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4440a00-f87b-40df-a9dd-08db1e3a6074 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:40:33.026909 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4440a00-f87b-40df-a9dd-08db1e3a6074 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:40:33.028089 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 820/1619] 10.222.0.86 () {60 vars in 1152 bytes} [Tue Jun 7 14:40:32 2022] POST /identity/v3/projects => generated 371 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:40:33.031975 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cb7864-c4fd-4d61-9e69-acf67d631b84 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:40:33.086200 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd26994-4a0e-4906-af68-0bc52f96a455 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dda603ec5517460a83c333db2af804d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:40:33.087789 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd26994-4a0e-4906-af68-0bc52f96a455 service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:33.088465 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd26994-4a0e-4906-af68-0bc52f96a455 service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:33.088990 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd26994-4a0e-4906-af68-0bc52f96a455 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:33.110049 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cb7864-c4fd-4d61-9e69-acf67d631b84 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:40:33.115552 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0276fe74-ee42-450b-bcf8-095a1762be67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dda603ec5517460a83c333db2af804d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:40:33.116196 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0276fe74-ee42-450b-bcf8-095a1762be67 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:33.116484 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0276fe74-ee42-450b-bcf8-095a1762be67 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:33.116748 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0276fe74-ee42-450b-bcf8-095a1762be67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:33.187435 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd26994-4a0e-4906-af68-0bc52f96a455 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:40:33.189173 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd26994-4a0e-4906-af68-0bc52f96a455 service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:40:33.200396 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 800/1620] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:40:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:40:33.201063 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd26994-4a0e-4906-af68-0bc52f96a455 service neutron] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:40:33.203790 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0276fe74-ee42-450b-bcf8-095a1762be67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:40:33.205255 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0276fe74-ee42-450b-bcf8-095a1762be67 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:40:33.211597 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd26994-4a0e-4906-af68-0bc52f96a455 service neutron] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:40:33.223363 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183c8e63-320d-43a5-8997-18800362e99b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:40:33.223485 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 821/1621] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:40:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:40:33.223570 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183c8e63-320d-43a5-8997-18800362e99b admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:33.223570 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183c8e63-320d-43a5-8997-18800362e99b admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:33.223570 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183c8e63-320d-43a5-8997-18800362e99b admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:33.223839 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15842751-bd97-4919-ace1-51868530321d None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:33.223948 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183c8e63-320d-43a5-8997-18800362e99b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:40:33.224032 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15842751-bd97-4919-ace1-51868530321d None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:33.224032 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15842751-bd97-4919-ace1-51868530321d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:33.224178 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183c8e63-320d-43a5-8997-18800362e99b admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:40:33.242473 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-15842751-bd97-4919-ace1-51868530321d None None] MFA Rules not processed for user `b99cfb70f54c45c8870369359da20378`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:40:33.243684 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-15842751-bd97-4919-ace1-51868530321d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:40:33.257515 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:40:33.315358 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 822/1622] 10.222.0.86 () {58 vars in 1009 bytes} [Tue Jun 7 14:40:33 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:40:33.316239 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15842751-bd97-4919-ace1-51868530321d None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:40:33.327914 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15842751-bd97-4919-ace1-51868530321d None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:40:33.333712 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcdd438-d7e7-4b9e-97c0-386a6e4a8d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:40:33.334501 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcdd438-d7e7-4b9e-97c0-386a6e4a8d32 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:33.335058 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcdd438-d7e7-4b9e-97c0-386a6e4a8d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:33.335243 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcdd438-d7e7-4b9e-97c0-386a6e4a8d32 admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:33.336182 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcdd438-d7e7-4b9e-97c0-386a6e4a8d32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:40:33.341124 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcdd438-d7e7-4b9e-97c0-386a6e4a8d32 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:40:33.370544 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 801/1623] 10.222.0.86 () {60 vars in 1152 bytes} [Tue Jun 7 14:40:33 2022] POST /identity/v3/projects => generated 365 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:40:33.371401 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183c8e63-320d-43a5-8997-18800362e99b admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:40:33.440439 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183c8e63-320d-43a5-8997-18800362e99b admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:40:33.444313 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18131c54-32b9-495d-a4ac-70300caef82f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af5a95620a4b43538abfe09eed4bf115', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:40:33.445062 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18131c54-32b9-495d-a4ac-70300caef82f service cinder] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:33.445270 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18131c54-32b9-495d-a4ac-70300caef82f service cinder] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:33.445515 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18131c54-32b9-495d-a4ac-70300caef82f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:33.474275 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 823/1624] 10.222.0.86 () {60 vars in 1143 bytes} [Tue Jun 7 14:40:33 2022] POST /identity/v3/users => generated 292 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:40:33.474833 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcdd438-d7e7-4b9e-97c0-386a6e4a8d32 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:40:33.507689 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:40:33.509115 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcdd438-d7e7-4b9e-97c0-386a6e4a8d32 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:40:33.546240 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18131c54-32b9-495d-a4ac-70300caef82f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:40:33.547914 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18131c54-32b9-495d-a4ac-70300caef82f service cinder] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:40:33.560720 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 802/1625] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:40:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:40:33.562261 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18131c54-32b9-495d-a4ac-70300caef82f service cinder] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:40:33.597891 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607b61c7-95ad-48a2-9e5c-d59a9d070cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:40:33.598589 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607b61c7-95ad-48a2-9e5c-d59a9d070cb4 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:33.598884 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607b61c7-95ad-48a2-9e5c-d59a9d070cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:33.599163 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607b61c7-95ad-48a2-9e5c-d59a9d070cb4 admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:33.604130 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607b61c7-95ad-48a2-9e5c-d59a9d070cb4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:40:33.607553 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607b61c7-95ad-48a2-9e5c-d59a9d070cb4 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:40:33.640814 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18131c54-32b9-495d-a4ac-70300caef82f service cinder] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:40:33.643649 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d6bb3c-97a9-406c-832b-228b1cf3f4b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:40:33.644374 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d6bb3c-97a9-406c-832b-228b1cf3f4b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:33.644789 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d6bb3c-97a9-406c-832b-228b1cf3f4b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:33.645079 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d6bb3c-97a9-406c-832b-228b1cf3f4b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:33.645827 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d6bb3c-97a9-406c-832b-228b1cf3f4b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:40:33.647746 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d6bb3c-97a9-406c-832b-228b1cf3f4b5 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:40:33.663501 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 803/1626] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:40:33 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:40:33.664970 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d6bb3c-97a9-406c-832b-228b1cf3f4b5 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:40:33.677592 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d6bb3c-97a9-406c-832b-228b1cf3f4b5 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:40:33.685170 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12319ecb-d032-4f5c-9138-b74b0165c046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:40:33.686465 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12319ecb-d032-4f5c-9138-b74b0165c046 admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:33.686996 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12319ecb-d032-4f5c-9138-b74b0165c046 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:33.687709 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12319ecb-d032-4f5c-9138-b74b0165c046 admin admin] PATH_INFO: `/v3/projects/0132488f39a6484caed6638b1f2dad85/users/0fcda42fc503407cbed63bd9abe9e224/roles/e3bf6239f5bf477b965704b086786f11` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:33.707850 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12319ecb-d032-4f5c-9138-b74b0165c046 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0132488f39a6484caed6638b1f2dad85, user_id=0fcda42fc503407cbed63bd9abe9e224, role_id=e3bf6239f5bf477b965704b086786f11)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:40:33.709137 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 824/1627] 10.222.0.86 () {60 vars in 1143 bytes} [Tue Jun 7 14:40:33 2022] POST /identity/v3/users => generated 289 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:40:33.710189 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607b61c7-95ad-48a2-9e5c-d59a9d070cb4 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:40:33.711873 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12319ecb-d032-4f5c-9138-b74b0165c046 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:40:33.731769 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607b61c7-95ad-48a2-9e5c-d59a9d070cb4 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:40:33.740277 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6998c0-bc7e-4265-b754-4d410c1bfbe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:40:33.741111 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6998c0-bc7e-4265-b754-4d410c1bfbe6 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:33.741471 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6998c0-bc7e-4265-b754-4d410c1bfbe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:33.741818 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6998c0-bc7e-4265-b754-4d410c1bfbe6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:33.743144 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6998c0-bc7e-4265-b754-4d410c1bfbe6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:40:33.744790 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6998c0-bc7e-4265-b754-4d410c1bfbe6 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:40:33.761660 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 825/1628] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:40:33 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:40:33.767291 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6998c0-bc7e-4265-b754-4d410c1bfbe6 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:40:33.797076 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 804/1629] 10.222.0.86 () {60 vars in 1482 bytes} [Tue Jun 7 14:40:33 2022] PUT /identity/v3/projects/0132488f39a6484caed6638b1f2dad85/users/0fcda42fc503407cbed63bd9abe9e224/roles/e3bf6239f5bf477b965704b086786f11 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:40:33.797311 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6998c0-bc7e-4265-b754-4d410c1bfbe6 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:40:33.798212 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12319ecb-d032-4f5c-9138-b74b0165c046 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:40:33.894278 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12319ecb-d032-4f5c-9138-b74b0165c046 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:40:33.899435 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7f2ae5-506f-4c25-84f9-152416cf6a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:40:33.901234 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7f2ae5-506f-4c25-84f9-152416cf6a6e admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:33.901234 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7f2ae5-506f-4c25-84f9-152416cf6a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:33.901480 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7f2ae5-506f-4c25-84f9-152416cf6a6e admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:33.902303 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7f2ae5-506f-4c25-84f9-152416cf6a6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:40:33.903939 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7f2ae5-506f-4c25-84f9-152416cf6a6e admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:40:33.923184 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 805/1630] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:40:33 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:40:33.927488 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7f2ae5-506f-4c25-84f9-152416cf6a6e admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:40:33.936978 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac1ba13-5de1-4918-bbf1-ba460ab09f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:40:33.938043 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac1ba13-5de1-4918-bbf1-ba460ab09f4e admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:33.938376 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac1ba13-5de1-4918-bbf1-ba460ab09f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:33.938655 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac1ba13-5de1-4918-bbf1-ba460ab09f4e admin admin] PATH_INFO: `/v3/projects/fcb003527af746e689a46e9bb3bf1a7b/users/d556424cebdd47859f5604e068eca81f/roles/e3bf6239f5bf477b965704b086786f11` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:33.943145 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7f2ae5-506f-4c25-84f9-152416cf6a6e admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:40:33.950931 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc34d3f9-ca2d-4ae8-aba4-c0639818a606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:40:33.952907 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc34d3f9-ca2d-4ae8-aba4-c0639818a606 admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:33.952907 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc34d3f9-ca2d-4ae8-aba4-c0639818a606 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:33.952907 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc34d3f9-ca2d-4ae8-aba4-c0639818a606 admin admin] PATH_INFO: `/v3/projects/0132488f39a6484caed6638b1f2dad85/users/0fcda42fc503407cbed63bd9abe9e224/roles/e3bf6239f5bf477b965704b086786f11` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:33.955435 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc34d3f9-ca2d-4ae8-aba4-c0639818a606 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0132488f39a6484caed6638b1f2dad85, user_id=0fcda42fc503407cbed63bd9abe9e224, role_id=e3bf6239f5bf477b965704b086786f11)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:40:33.960084 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac1ba13-5de1-4918-bbf1-ba460ab09f4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcb003527af746e689a46e9bb3bf1a7b, user_id=d556424cebdd47859f5604e068eca81f, role_id=e3bf6239f5bf477b965704b086786f11)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:40:33.960797 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc34d3f9-ca2d-4ae8-aba4-c0639818a606 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:40:33.964357 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac1ba13-5de1-4918-bbf1-ba460ab09f4e admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:40:33.968554 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:40:33.974053 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 806/1631] 10.222.0.86 () {60 vars in 1482 bytes} [Tue Jun 7 14:40:33 2022] PUT /identity/v3/projects/0132488f39a6484caed6638b1f2dad85/users/0fcda42fc503407cbed63bd9abe9e224/roles/e3bf6239f5bf477b965704b086786f11 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:40:33.984890 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899a8110-c39d-4923-a839-baba9b8c3dbe None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:33.985188 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899a8110-c39d-4923-a839-baba9b8c3dbe None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:33.987331 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899a8110-c39d-4923-a839-baba9b8c3dbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:34.015714 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-899a8110-c39d-4923-a839-baba9b8c3dbe None None] MFA Rules not processed for user `0fcda42fc503407cbed63bd9abe9e224`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:40:34.017321 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-899a8110-c39d-4923-a839-baba9b8c3dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:40:34.031056 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:40:34.113404 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 826/1632] 10.222.0.86 () {60 vars in 1482 bytes} [Tue Jun 7 14:40:33 2022] PUT /identity/v3/projects/fcb003527af746e689a46e9bb3bf1a7b/users/d556424cebdd47859f5604e068eca81f/roles/e3bf6239f5bf477b965704b086786f11 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:40:34.117124 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac1ba13-5de1-4918-bbf1-ba460ab09f4e admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:40:34.153994 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 807/1633] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:40:33 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 14:40:34.163184 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899a8110-c39d-4923-a839-baba9b8c3dbe None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:40:34.221670 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac1ba13-5de1-4918-bbf1-ba460ab09f4e admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:40:34.232205 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2449c9f-57c7-4cfe-b2b7-059d371b3914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:40:34.233020 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2449c9f-57c7-4cfe-b2b7-059d371b3914 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:34.233647 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2449c9f-57c7-4cfe-b2b7-059d371b3914 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:34.234122 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2449c9f-57c7-4cfe-b2b7-059d371b3914 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:34.235333 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2449c9f-57c7-4cfe-b2b7-059d371b3914 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:40:34.237485 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2449c9f-57c7-4cfe-b2b7-059d371b3914 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:40:34.253097 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 827/1634] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:40:34 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 07 14:40:34.254861 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdce558-f8b5-48db-8451-ab1b6dda7c7d None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:34.255737 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdce558-f8b5-48db-8451-ab1b6dda7c7d None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:34.255911 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdce558-f8b5-48db-8451-ab1b6dda7c7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:34.267062 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899a8110-c39d-4923-a839-baba9b8c3dbe None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:40:34.330381 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-abdce558-f8b5-48db-8451-ab1b6dda7c7d None None] MFA Rules not processed for user `d71f4ee8182f48cdae6870a6e3be97e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:40:34.331293 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-abdce558-f8b5-48db-8451-ab1b6dda7c7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:40:34.334353 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a6c5f2-8c56-418d-b315-c22e8d48a180 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af5a95620a4b43538abfe09eed4bf115', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:40:34.335191 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a6c5f2-8c56-418d-b315-c22e8d48a180 service cinder] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:34.336600 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a6c5f2-8c56-418d-b315-c22e8d48a180 service cinder] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:34.337000 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a6c5f2-8c56-418d-b315-c22e8d48a180 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:34.435271 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 828/1635] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:40:34 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:40:34.436270 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdce558-f8b5-48db-8451-ab1b6dda7c7d None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:40:34.448936 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdce558-f8b5-48db-8451-ab1b6dda7c7d None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:40:34.454483 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a90c02-49f0-42c0-a3da-b395fb843351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:40:34.455698 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a90c02-49f0-42c0-a3da-b395fb843351 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:34.456086 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a90c02-49f0-42c0-a3da-b395fb843351 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:34.456580 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a90c02-49f0-42c0-a3da-b395fb843351 admin admin] PATH_INFO: `/v3/projects/fcb003527af746e689a46e9bb3bf1a7b/users/d556424cebdd47859f5604e068eca81f/roles/e3bf6239f5bf477b965704b086786f11` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:34.458879 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a90c02-49f0-42c0-a3da-b395fb843351 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcb003527af746e689a46e9bb3bf1a7b, user_id=d556424cebdd47859f5604e068eca81f, role_id=e3bf6239f5bf477b965704b086786f11)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:40:34.461791 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a90c02-49f0-42c0-a3da-b395fb843351 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:40:34.475853 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a6c5f2-8c56-418d-b315-c22e8d48a180 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:40:34.485243 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 829/1636] 10.222.0.86 () {60 vars in 1482 bytes} [Tue Jun 7 14:40:34 2022] PUT /identity/v3/projects/fcb003527af746e689a46e9bb3bf1a7b/users/d556424cebdd47859f5604e068eca81f/roles/e3bf6239f5bf477b965704b086786f11 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:40:34.485243 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbca00e-02e7-4941-959d-b912abf3f279 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:34.485243 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbca00e-02e7-4941-959d-b912abf3f279 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:34.485243 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbca00e-02e7-4941-959d-b912abf3f279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:34.485805 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a6c5f2-8c56-418d-b315-c22e8d48a180 service cinder] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:40:34.505519 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-8fbca00e-02e7-4941-959d-b912abf3f279 None None] MFA Rules not processed for user `d71f4ee8182f48cdae6870a6e3be97e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:40:34.505519 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-8fbca00e-02e7-4941-959d-b912abf3f279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:40:34.515346 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 808/1637] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:40:34 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 14:40:34.517363 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962faf5e-d00d-4246-9eee-c73dc467e7ec None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:34.517714 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962faf5e-d00d-4246-9eee-c73dc467e7ec None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:34.518138 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962faf5e-d00d-4246-9eee-c73dc467e7ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:34.560198 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-962faf5e-d00d-4246-9eee-c73dc467e7ec None None] MFA Rules not processed for user `d556424cebdd47859f5604e068eca81f`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:40:34.561912 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-962faf5e-d00d-4246-9eee-c73dc467e7ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:40:34.570459 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 830/1638] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:40:34 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:40:34.600372 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f73ab30-8401-47cf-b517-cf3cc448072f None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:34.601143 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f73ab30-8401-47cf-b517-cf3cc448072f None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:34.601507 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f73ab30-8401-47cf-b517-cf3cc448072f None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:34.603274 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 831/1639] 10.222.0.86 () {54 vars in 961 bytes} [Tue Jun 7 14:40:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 07 14:40:34.611404 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf1c66a-459a-4049-ae76-0793e439a754 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:34.612007 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf1c66a-459a-4049-ae76-0793e439a754 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:34.612567 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf1c66a-459a-4049-ae76-0793e439a754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:34.648914 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-8bf1c66a-459a-4049-ae76-0793e439a754 None None] MFA Rules not processed for user `b99cfb70f54c45c8870369359da20378`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:40:34.651240 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-8bf1c66a-459a-4049-ae76-0793e439a754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:40:34.682743 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 809/1640] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:40:34 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:40:34.754499 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:40:34.774815 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962faf5e-d00d-4246-9eee-c73dc467e7ec None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:40:34.798921 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 832/1641] 10.222.0.86 () {58 vars in 1058 bytes} [Tue Jun 7 14:40:34 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 14:40:34.800006 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf1c66a-459a-4049-ae76-0793e439a754 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:40:34.818598 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf1c66a-459a-4049-ae76-0793e439a754 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:40:34.825634 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32fbe5b-a02c-4e74-8a36-b94ab3047686 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99cfb70f54c45c8870369359da20378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:40:34.826410 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32fbe5b-a02c-4e74-8a36-b94ab3047686 service nova] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:34.826801 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32fbe5b-a02c-4e74-8a36-b94ab3047686 service nova] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:34.827318 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32fbe5b-a02c-4e74-8a36-b94ab3047686 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:34.841527 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32fbe5b-a02c-4e74-8a36-b94ab3047686 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:40:34.843154 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32fbe5b-a02c-4e74-8a36-b94ab3047686 service nova] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:40:34.862998 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 833/1642] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:40:34 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:40:34.901679 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962faf5e-d00d-4246-9eee-c73dc467e7ec None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:40:34.911294 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20c9dae-a382-4689-b329-997c3a60accf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af5a95620a4b43538abfe09eed4bf115', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:40:34.912216 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20c9dae-a382-4689-b329-997c3a60accf service cinder] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:34.912984 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20c9dae-a382-4689-b329-997c3a60accf service cinder] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:34.913713 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20c9dae-a382-4689-b329-997c3a60accf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:34.930161 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32fbe5b-a02c-4e74-8a36-b94ab3047686 service nova] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:40:34.936348 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20c9dae-a382-4689-b329-997c3a60accf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:40:34.937776 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20c9dae-a382-4689-b329-997c3a60accf service cinder] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:40:34.947523 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:40:34.954591 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32fbe5b-a02c-4e74-8a36-b94ab3047686 service nova] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:40:34.962561 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 810/1643] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:40:34 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:40:34.966183 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d422fddb-df93-4e82-ac48-5a34ef06003b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af5a95620a4b43538abfe09eed4bf115', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:40:34.966863 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d422fddb-df93-4e82-ac48-5a34ef06003b service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:34.967152 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d422fddb-df93-4e82-ac48-5a34ef06003b service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:34.967432 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d422fddb-df93-4e82-ac48-5a34ef06003b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:35.082384 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d422fddb-df93-4e82-ac48-5a34ef06003b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:40:35.082384 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d422fddb-df93-4e82-ac48-5a34ef06003b service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:40:35.094076 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 834/1644] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:40:34 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:40:35.216941 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b4d88b-bd63-458f-9b6c-a6e5f6b4dd37 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:35.217253 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b4d88b-bd63-458f-9b6c-a6e5f6b4dd37 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:35.217504 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b4d88b-bd63-458f-9b6c-a6e5f6b4dd37 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:35.220911 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 811/1645] 10.222.0.86 () {54 vars in 912 bytes} [Tue Jun 7 14:40:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:40:35.226881 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eefa911-9f9e-477f-8ae9-0cbc31c42ed9 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:35.227197 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eefa911-9f9e-477f-8ae9-0cbc31c42ed9 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:35.227918 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eefa911-9f9e-477f-8ae9-0cbc31c42ed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:35.259118 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-8eefa911-9f9e-477f-8ae9-0cbc31c42ed9 None None] MFA Rules not processed for user `b99cfb70f54c45c8870369359da20378`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:40:35.261224 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-8eefa911-9f9e-477f-8ae9-0cbc31c42ed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:40:35.275996 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 835/1646] 10.222.0.86 () {58 vars in 1009 bytes} [Tue Jun 7 14:40:35 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:40:35.299044 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b4d88b-bd63-458f-9b6c-a6e5f6b4dd37 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:40:35.301648 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-82b4d88b-bd63-458f-9b6c-a6e5f6b4dd37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:40:35.362126 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b4d88b-bd63-458f-9b6c-a6e5f6b4dd37 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:40:35.365836 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9213c23b-9bd5-4d9f-a401-23797a2884f5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b910435e5585436996ba5b5aeb7184bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:40:35.366482 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9213c23b-9bd5-4d9f-a401-23797a2884f5 service glance] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:35.366769 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9213c23b-9bd5-4d9f-a401-23797a2884f5 service glance] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:35.367047 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9213c23b-9bd5-4d9f-a401-23797a2884f5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:35.377741 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9213c23b-9bd5-4d9f-a401-23797a2884f5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:40:35.379063 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9213c23b-9bd5-4d9f-a401-23797a2884f5 service glance] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:40:35.393528 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 812/1647] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:40:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:40:35.441417 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eefa911-9f9e-477f-8ae9-0cbc31c42ed9 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:40:35.457632 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eefa911-9f9e-477f-8ae9-0cbc31c42ed9 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:40:35.462691 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc886c5d-9643-4d44-afff-1685509295c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af5a95620a4b43538abfe09eed4bf115', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:40:35.468049 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc886c5d-9643-4d44-afff-1685509295c7 service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:35.468049 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc886c5d-9643-4d44-afff-1685509295c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:35.468049 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc886c5d-9643-4d44-afff-1685509295c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:35.551598 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc886c5d-9643-4d44-afff-1685509295c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:40:35.553099 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc886c5d-9643-4d44-afff-1685509295c7 service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:40:35.565856 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 836/1648] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:40:35 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:40:35.832518 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b16600b-f6b3-4bd7-a43f-0604873358d0 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:35.832518 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b16600b-f6b3-4bd7-a43f-0604873358d0 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:35.832518 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b16600b-f6b3-4bd7-a43f-0604873358d0 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:35.832518 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 813/1649] 10.222.0.86 () {54 vars in 912 bytes} [Tue Jun 7 14:40:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:40:35.838059 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c76d052-cdbf-4c77-ba2b-c78bc1a68e2e None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:35.838059 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c76d052-cdbf-4c77-ba2b-c78bc1a68e2e None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:35.838059 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c76d052-cdbf-4c77-ba2b-c78bc1a68e2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:35.895548 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-2c76d052-cdbf-4c77-ba2b-c78bc1a68e2e None None] MFA Rules not processed for user `dda603ec5517460a83c333db2af804d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:40:35.897440 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-2c76d052-cdbf-4c77-ba2b-c78bc1a68e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:40:35.954758 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 837/1650] 10.222.0.86 () {58 vars in 1009 bytes} [Tue Jun 7 14:40:35 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:40:35.966523 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b16600b-f6b3-4bd7-a43f-0604873358d0 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:40:35.977721 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b16600b-f6b3-4bd7-a43f-0604873358d0 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:40:35.983325 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4ab285-b133-4c32-9bea-074c391358a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dda603ec5517460a83c333db2af804d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:40:35.984741 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4ab285-b133-4c32-9bea-074c391358a7 service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:35.984741 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4ab285-b133-4c32-9bea-074c391358a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:35.984741 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4ab285-b133-4c32-9bea-074c391358a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:35.993158 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4ab285-b133-4c32-9bea-074c391358a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:40:35.995830 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4ab285-b133-4c32-9bea-074c391358a7 service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:40:36.011902 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 814/1651] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:40:35 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:40:36.674623 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:40:36.939572 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4631a8f3-810e-48c1-bbc1-6adbe3630130 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:36.940227 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4631a8f3-810e-48c1-bbc1-6adbe3630130 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:36.940227 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4631a8f3-810e-48c1-bbc1-6adbe3630130 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:36.941861 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 838/1652] 10.222.0.86 () {54 vars in 960 bytes} [Tue Jun 7 14:40:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:40:36.950465 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f110505-8d91-44df-bbc0-3026fefa2431 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:36.950978 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f110505-8d91-44df-bbc0-3026fefa2431 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:36.951330 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f110505-8d91-44df-bbc0-3026fefa2431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:36.977695 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-6f110505-8d91-44df-bbc0-3026fefa2431 None None] MFA Rules not processed for user `7e042f9d4a9345bb947e6a30f64a59ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:40:36.979907 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-6f110505-8d91-44df-bbc0-3026fefa2431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:40:37.011447 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:40:37.095054 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4631a8f3-810e-48c1-bbc1-6adbe3630130 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:40:37.110461 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 815/1653] 10.222.0.86 () {58 vars in 1057 bytes} [Tue Jun 7 14:40:36 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 14:40:37.117525 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4631a8f3-810e-48c1-bbc1-6adbe3630130 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:40:37.124561 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3052aed-40b0-4252-a1f8-92aa1da11325 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e042f9d4a9345bb947e6a30f64a59ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:40:37.125227 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3052aed-40b0-4252-a1f8-92aa1da11325 service placement] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:37.125568 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3052aed-40b0-4252-a1f8-92aa1da11325 service placement] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:37.129282 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3052aed-40b0-4252-a1f8-92aa1da11325 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:37.129851 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-f3052aed-40b0-4252-a1f8-92aa1da11325 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:40:37.174211 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3052aed-40b0-4252-a1f8-92aa1da11325 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:40:37.178559 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3052aed-40b0-4252-a1f8-92aa1da11325 service placement] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:40:37.220787 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 839/1654] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:40:37 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 14:40:39.476022 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f110505-8d91-44df-bbc0-3026fefa2431 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:40:39.713634 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f110505-8d91-44df-bbc0-3026fefa2431 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:40:39.737765 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af02237c-e05b-4f09-9f33-747b6adede5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:40:39.738866 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af02237c-e05b-4f09-9f33-747b6adede5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:39.739296 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af02237c-e05b-4f09-9f33-747b6adede5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:39.739845 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af02237c-e05b-4f09-9f33-747b6adede5c admin admin] PATH_INFO: `/v3/users/d3e940e2c333442384f9217e79573981` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:39.743256 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af02237c-e05b-4f09-9f33-747b6adede5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3e940e2c333442384f9217e79573981)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:40:39.744567 dv-cinder-844974-1-smb devstack@keystone.service[80418]: WARNING py.warnings [None req-af02237c-e05b-4f09-9f33-747b6adede5c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 07 14:40:39.744567 dv-cinder-844974-1-smb devstack@keystone.service[80418]: warnings.warn(msg) Jun 07 14:40:39.744567 dv-cinder-844974-1-smb devstack@keystone.service[80418]: Jun 07 14:40:39.746123 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af02237c-e05b-4f09-9f33-747b6adede5c admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:40:40.096937 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-af02237c-e05b-4f09-9f33-747b6adede5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3e940e2c333442384f9217e79573981'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:40:40.151414 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-af02237c-e05b-4f09-9f33-747b6adede5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3e940e2c333442384f9217e79573981'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:40:40.154788 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-af02237c-e05b-4f09-9f33-747b6adede5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3e940e2c333442384f9217e79573981'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:40:40.223515 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-af02237c-e05b-4f09-9f33-747b6adede5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3e940e2c333442384f9217e79573981'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:40:40.227137 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-af02237c-e05b-4f09-9f33-747b6adede5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3e940e2c333442384f9217e79573981'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:40:40.356475 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 816/1655] 10.222.0.86 () {58 vars in 1223 bytes} [Tue Jun 7 14:40:39 2022] DELETE /identity/v3/users/d3e940e2c333442384f9217e79573981 => generated 0 bytes in 882 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 14:40:40.362782 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7a9d15-a270-4770-a135-c234d5ec98f9 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:40.362782 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7a9d15-a270-4770-a135-c234d5ec98f9 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:40.362782 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7a9d15-a270-4770-a135-c234d5ec98f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:40.428699 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-2f7a9d15-a270-4770-a135-c234d5ec98f9 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:40:40.434600 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-2f7a9d15-a270-4770-a135-c234d5ec98f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:40:40.715632 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 840/1656] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:40:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:40:40.758189 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af02237c-e05b-4f09-9f33-747b6adede5c admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:40:40.760855 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-af02237c-e05b-4f09-9f33-747b6adede5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:40:40.974702 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:40:40.986527 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af02237c-e05b-4f09-9f33-747b6adede5c admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:40:41.000802 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa352ae3-51d8-4c6d-af83-6d2bb6377e88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dda603ec5517460a83c333db2af804d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:40:41.005102 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa352ae3-51d8-4c6d-af83-6d2bb6377e88 service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:41.005102 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa352ae3-51d8-4c6d-af83-6d2bb6377e88 service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:41.005102 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa352ae3-51d8-4c6d-af83-6d2bb6377e88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:41.023454 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa352ae3-51d8-4c6d-af83-6d2bb6377e88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:40:41.025107 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa352ae3-51d8-4c6d-af83-6d2bb6377e88 service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:40:41.038201 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7a9d15-a270-4770-a135-c234d5ec98f9 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:40:41.039623 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-2f7a9d15-a270-4770-a135-c234d5ec98f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:40:41.073893 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7a9d15-a270-4770-a135-c234d5ec98f9 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:40:41.078974 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 817/1657] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:40:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:40:41.088254 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdd63a0-2f40-4303-8921-8d09cc603d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:40:41.089164 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdd63a0-2f40-4303-8921-8d09cc603d6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:41.089449 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdd63a0-2f40-4303-8921-8d09cc603d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:41.089699 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdd63a0-2f40-4303-8921-8d09cc603d6f admin admin] PATH_INFO: `/v3/users/828ba267fd494266a7b4c22cb852fbd6` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:41.094289 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdd63a0-2f40-4303-8921-8d09cc603d6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=828ba267fd494266a7b4c22cb852fbd6)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:40:41.103175 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdd63a0-2f40-4303-8921-8d09cc603d6f admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:40:41.469623 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-5fdd63a0-2f40-4303-8921-8d09cc603d6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '828ba267fd494266a7b4c22cb852fbd6'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:40:41.471951 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-5fdd63a0-2f40-4303-8921-8d09cc603d6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '828ba267fd494266a7b4c22cb852fbd6'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:40:41.504513 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-5fdd63a0-2f40-4303-8921-8d09cc603d6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '828ba267fd494266a7b4c22cb852fbd6'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:40:41.533744 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-5fdd63a0-2f40-4303-8921-8d09cc603d6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '828ba267fd494266a7b4c22cb852fbd6'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:40:41.535356 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-5fdd63a0-2f40-4303-8921-8d09cc603d6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '828ba267fd494266a7b4c22cb852fbd6'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:40:41.654451 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 841/1658] 10.222.0.86 () {58 vars in 1223 bytes} [Tue Jun 7 14:40:41 2022] DELETE /identity/v3/users/828ba267fd494266a7b4c22cb852fbd6 => generated 0 bytes in 617 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:40:41.658989 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f39464f-f638-43f7-98d7-acf544d25ad0 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:41.659458 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f39464f-f638-43f7-98d7-acf544d25ad0 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:41.659903 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f39464f-f638-43f7-98d7-acf544d25ad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:41.689724 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-8f39464f-f638-43f7-98d7-acf544d25ad0 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:40:41.692430 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-8f39464f-f638-43f7-98d7-acf544d25ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:40:41.836305 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 818/1659] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:40:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:40:41.913497 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdd63a0-2f40-4303-8921-8d09cc603d6f admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:40:41.916898 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-5fdd63a0-2f40-4303-8921-8d09cc603d6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:40:41.965658 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:40:42.060202 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdd63a0-2f40-4303-8921-8d09cc603d6f admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:40:42.071646 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83037410-5014-42fe-bfcf-c1a8fdcbd6fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dda603ec5517460a83c333db2af804d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:40:42.074185 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83037410-5014-42fe-bfcf-c1a8fdcbd6fa service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:42.075457 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83037410-5014-42fe-bfcf-c1a8fdcbd6fa service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:42.076753 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83037410-5014-42fe-bfcf-c1a8fdcbd6fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:42.103003 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83037410-5014-42fe-bfcf-c1a8fdcbd6fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:40:42.106064 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83037410-5014-42fe-bfcf-c1a8fdcbd6fa service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:40:42.128142 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 842/1660] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:40:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:40:42.494368 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be3acd5-e99d-46cb-aad6-d1f92a1e727c None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:42.494859 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be3acd5-e99d-46cb-aad6-d1f92a1e727c None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:42.495303 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be3acd5-e99d-46cb-aad6-d1f92a1e727c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:42.517446 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-8be3acd5-e99d-46cb-aad6-d1f92a1e727c None None] MFA Rules not processed for user `d7b598c6a3f642ef9edc971ad3ebbe31`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:40:42.519099 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-8be3acd5-e99d-46cb-aad6-d1f92a1e727c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:40:42.623366 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 819/1661] 10.222.0.86 () {58 vars in 1009 bytes} [Tue Jun 7 14:40:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 14:40:43.009419 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83037410-5014-42fe-bfcf-c1a8fdcbd6fa service neutron] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:40:43.012078 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-83037410-5014-42fe-bfcf-c1a8fdcbd6fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:40:43.036505 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83037410-5014-42fe-bfcf-c1a8fdcbd6fa service neutron] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:40:43.050714 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85e5379-4d83-4bd6-98bf-95ab947d5da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:40:43.051831 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85e5379-4d83-4bd6-98bf-95ab947d5da2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:43.054440 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85e5379-4d83-4bd6-98bf-95ab947d5da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:43.054923 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85e5379-4d83-4bd6-98bf-95ab947d5da2 admin admin] PATH_INFO: `/v3/projects/e59e1d05b81b453198df47d3978d2f2d` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:43.058405 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85e5379-4d83-4bd6-98bf-95ab947d5da2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e59e1d05b81b453198df47d3978d2f2d)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:40:43.059626 dv-cinder-844974-1-smb devstack@keystone.service[80419]: WARNING py.warnings [None req-d85e5379-4d83-4bd6-98bf-95ab947d5da2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 07 14:40:43.059626 dv-cinder-844974-1-smb devstack@keystone.service[80419]: warnings.warn(msg) Jun 07 14:40:43.059626 dv-cinder-844974-1-smb devstack@keystone.service[80419]: Jun 07 14:40:43.063927 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85e5379-4d83-4bd6-98bf-95ab947d5da2 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:40:43.229673 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be3acd5-e99d-46cb-aad6-d1f92a1e727c None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:40:43.232451 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-8be3acd5-e99d-46cb-aad6-d1f92a1e727c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:40:43.383562 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-d85e5379-4d83-4bd6-98bf-95ab947d5da2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e59e1d05b81b453198df47d3978d2f2d', 'request_id': 'req-d85e5379-4d83-4bd6-98bf-95ab947d5da2'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:40:43.427496 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-d85e5379-4d83-4bd6-98bf-95ab947d5da2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e59e1d05b81b453198df47d3978d2f2d', 'request_id': 'req-d85e5379-4d83-4bd6-98bf-95ab947d5da2'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:40:43.436570 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be3acd5-e99d-46cb-aad6-d1f92a1e727c None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:40:43.488232 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:40:43.528168 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792840ee-c577-411c-8736-74089372a026 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9774349dd2b4ec092ef04c3df050a7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:40:43.528844 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792840ee-c577-411c-8736-74089372a026 service swift] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:43.529158 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792840ee-c577-411c-8736-74089372a026 service swift] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:43.529492 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792840ee-c577-411c-8736-74089372a026 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:43.537202 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-d85e5379-4d83-4bd6-98bf-95ab947d5da2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e59e1d05b81b453198df47d3978d2f2d', 'request_id': 'req-d85e5379-4d83-4bd6-98bf-95ab947d5da2'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:40:43.554874 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-d85e5379-4d83-4bd6-98bf-95ab947d5da2 admin admin] The token cache is being invalidate because project e59e1d05b81b453198df47d3978d2f2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:40:43.555251 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-d85e5379-4d83-4bd6-98bf-95ab947d5da2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:40:43.557799 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-d85e5379-4d83-4bd6-98bf-95ab947d5da2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:40:43.561245 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 843/1662] 10.222.0.86 () {58 vars in 1232 bytes} [Tue Jun 7 14:40:43 2022] DELETE /identity/v3/projects/e59e1d05b81b453198df47d3978d2f2d => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:40:43.566402 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08ad1fa-6fb9-4a1f-bb6b-04946e407f41 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:43.566815 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08ad1fa-6fb9-4a1f-bb6b-04946e407f41 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:43.570474 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08ad1fa-6fb9-4a1f-bb6b-04946e407f41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:43.608504 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792840ee-c577-411c-8736-74089372a026 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:40:43.610358 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792840ee-c577-411c-8736-74089372a026 service swift] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:40:43.615488 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-f08ad1fa-6fb9-4a1f-bb6b-04946e407f41 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:40:43.620080 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-f08ad1fa-6fb9-4a1f-bb6b-04946e407f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:40:43.622034 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 820/1663] 10.222.0.86 () {60 vars in 1384 bytes} [Tue Jun 7 14:40:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 07 14:40:43.743821 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 844/1664] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:40:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:40:43.749028 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c2b5a9-3248-4f0c-b484-7f5cadaf096e None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:43.749842 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c2b5a9-3248-4f0c-b484-7f5cadaf096e None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:43.750632 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c2b5a9-3248-4f0c-b484-7f5cadaf096e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:43.797839 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-a6c2b5a9-3248-4f0c-b484-7f5cadaf096e None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:40:43.800606 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-a6c2b5a9-3248-4f0c-b484-7f5cadaf096e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:40:43.827568 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 821/1665] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:40:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:40:43.829198 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08ad1fa-6fb9-4a1f-bb6b-04946e407f41 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:40:43.844840 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08ad1fa-6fb9-4a1f-bb6b-04946e407f41 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:40:43.870871 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4dea6f-7a00-4d4a-a13c-f5f260e94225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:40:43.871583 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4dea6f-7a00-4d4a-a13c-f5f260e94225 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:43.871909 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4dea6f-7a00-4d4a-a13c-f5f260e94225 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:43.872189 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4dea6f-7a00-4d4a-a13c-f5f260e94225 admin admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:43.882811 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4dea6f-7a00-4d4a-a13c-f5f260e94225 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:40:43.885327 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4dea6f-7a00-4d4a-a13c-f5f260e94225 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:40:43.897131 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4dea6f-7a00-4d4a-a13c-f5f260e94225 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:40:43.983154 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 845/1666] 10.222.0.86 () {58 vars in 1152 bytes} [Tue Jun 7 14:40:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:40:43.984751 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c2b5a9-3248-4f0c-b484-7f5cadaf096e None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:40:43.998504 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c2b5a9-3248-4f0c-b484-7f5cadaf096e None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:40:44.029494 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cebb6ad-6fac-43f8-8691-b7911b6bbe78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:40:44.030331 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cebb6ad-6fac-43f8-8691-b7911b6bbe78 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:44.030640 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cebb6ad-6fac-43f8-8691-b7911b6bbe78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:44.030887 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cebb6ad-6fac-43f8-8691-b7911b6bbe78 admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:44.031637 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cebb6ad-6fac-43f8-8691-b7911b6bbe78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:40:44.033700 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cebb6ad-6fac-43f8-8691-b7911b6bbe78 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:40:44.225065 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4dea6f-7a00-4d4a-a13c-f5f260e94225 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:40:44.227009 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 822/1667] 10.222.0.86 () {60 vars in 1152 bytes} [Tue Jun 7 14:40:43 2022] POST /identity/v3/projects => generated 365 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 14:40:44.244430 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4dea6f-7a00-4d4a-a13c-f5f260e94225 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:40:44.348004 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:40:44.504260 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a9a304-cea7-442c-a46d-cc2359e039a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:40:44.506103 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a9a304-cea7-442c-a46d-cc2359e039a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:44.509981 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a9a304-cea7-442c-a46d-cc2359e039a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:44.510290 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a9a304-cea7-442c-a46d-cc2359e039a9 admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:44.515134 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a9a304-cea7-442c-a46d-cc2359e039a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:40:44.532773 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a9a304-cea7-442c-a46d-cc2359e039a9 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:40:44.676692 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 846/1668] 10.222.0.86 () {60 vars in 1143 bytes} [Tue Jun 7 14:40:44 2022] POST /identity/v3/users => generated 283 bytes in 452 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:40:44.680787 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cebb6ad-6fac-43f8-8691-b7911b6bbe78 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:40:44.707100 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cebb6ad-6fac-43f8-8691-b7911b6bbe78 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:40:44.743185 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce01c1fe-cc0f-4d77-b0bb-d4a0784183dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:40:44.750806 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce01c1fe-cc0f-4d77-b0bb-d4a0784183dd admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:44.752862 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce01c1fe-cc0f-4d77-b0bb-d4a0784183dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:44.754620 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce01c1fe-cc0f-4d77-b0bb-d4a0784183dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:44.758259 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce01c1fe-cc0f-4d77-b0bb-d4a0784183dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:40:44.773854 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce01c1fe-cc0f-4d77-b0bb-d4a0784183dd admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:40:44.822068 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 823/1669] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:40:44 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:40:44.828501 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a9a304-cea7-442c-a46d-cc2359e039a9 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:40:44.850866 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a9a304-cea7-442c-a46d-cc2359e039a9 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:40:44.873604 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cab259-2fcd-4d29-9e45-715cd102f786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:40:44.874481 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cab259-2fcd-4d29-9e45-715cd102f786 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:44.874914 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cab259-2fcd-4d29-9e45-715cd102f786 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:44.875329 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cab259-2fcd-4d29-9e45-715cd102f786 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:44.877756 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cab259-2fcd-4d29-9e45-715cd102f786 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:40:44.879630 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cab259-2fcd-4d29-9e45-715cd102f786 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:40:44.934602 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 847/1670] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:40:44 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:40:44.937172 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce01c1fe-cc0f-4d77-b0bb-d4a0784183dd admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:40:44.953412 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce01c1fe-cc0f-4d77-b0bb-d4a0784183dd admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:40:44.974215 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cede9653-7aef-4879-bdd3-24bbe8ef04c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:40:44.976158 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cede9653-7aef-4879-bdd3-24bbe8ef04c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:44.989004 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cede9653-7aef-4879-bdd3-24bbe8ef04c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:44.989561 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cede9653-7aef-4879-bdd3-24bbe8ef04c4 admin admin] PATH_INFO: `/v3/projects/6a377f4b17534c0ea7e77c9128335739/users/378a38f2d8424dd5a296ebc77043841b/roles/c17acc2a8bb348f59ba7edd22fcf0c47` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:45.035748 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cede9653-7aef-4879-bdd3-24bbe8ef04c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a377f4b17534c0ea7e77c9128335739, user_id=378a38f2d8424dd5a296ebc77043841b, role_id=c17acc2a8bb348f59ba7edd22fcf0c47)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:40:45.044270 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cede9653-7aef-4879-bdd3-24bbe8ef04c4 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:40:45.172238 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 824/1671] 10.222.0.86 () {60 vars in 1482 bytes} [Tue Jun 7 14:40:44 2022] PUT /identity/v3/projects/6a377f4b17534c0ea7e77c9128335739/users/378a38f2d8424dd5a296ebc77043841b/roles/c17acc2a8bb348f59ba7edd22fcf0c47 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:40:45.174143 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d372c20-75a4-44d7-a04e-d5980b0abe3d None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:45.174517 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d372c20-75a4-44d7-a04e-d5980b0abe3d None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:45.174791 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d372c20-75a4-44d7-a04e-d5980b0abe3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:45.390894 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-2d372c20-75a4-44d7-a04e-d5980b0abe3d None None] MFA Rules not processed for user `378a38f2d8424dd5a296ebc77043841b`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:40:45.390894 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-2d372c20-75a4-44d7-a04e-d5980b0abe3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:40:45.390894 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 848/1672] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:40:45 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:40:45.408905 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cede9653-7aef-4879-bdd3-24bbe8ef04c4 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:40:45.662628 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cede9653-7aef-4879-bdd3-24bbe8ef04c4 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:40:45.671745 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f8da23-a4fd-4c70-9025-31cbfe849bf6 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:45.672066 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f8da23-a4fd-4c70-9025-31cbfe849bf6 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:45.672339 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f8da23-a4fd-4c70-9025-31cbfe849bf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:45.696486 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016f77a1-3081-4d51-9f06-4e776b5ee121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:40:45.697759 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016f77a1-3081-4d51-9f06-4e776b5ee121 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:45.700624 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016f77a1-3081-4d51-9f06-4e776b5ee121 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:45.705769 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016f77a1-3081-4d51-9f06-4e776b5ee121 admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:45.706807 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016f77a1-3081-4d51-9f06-4e776b5ee121 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:40:45.718636 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016f77a1-3081-4d51-9f06-4e776b5ee121 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:40:45.758270 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-33f8da23-a4fd-4c70-9025-31cbfe849bf6 None None] MFA Rules not processed for user `65552520abca41ab8728a75046dc94d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:40:45.763028 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-33f8da23-a4fd-4c70-9025-31cbfe849bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:40:45.852691 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:40:45.861782 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 825/1673] 10.222.0.86 () {60 vars in 1152 bytes} [Tue Jun 7 14:40:45 2022] POST /identity/v3/projects => generated 365 bytes in 467 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:40:45.865457 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016f77a1-3081-4d51-9f06-4e776b5ee121 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:40:46.077832 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 849/1674] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:40:45 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 407 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:40:46.100888 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f8da23-a4fd-4c70-9025-31cbfe849bf6 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:40:46.106951 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-33f8da23-a4fd-4c70-9025-31cbfe849bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:40:46.209117 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016f77a1-3081-4d51-9f06-4e776b5ee121 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:40:46.223731 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31f85a5-7d89-41c9-a323-7f8c59c62b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:40:46.224569 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31f85a5-7d89-41c9-a323-7f8c59c62b90 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:46.225273 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31f85a5-7d89-41c9-a323-7f8c59c62b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:46.225573 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31f85a5-7d89-41c9-a323-7f8c59c62b90 admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:46.226360 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31f85a5-7d89-41c9-a323-7f8c59c62b90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:40:46.233370 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31f85a5-7d89-41c9-a323-7f8c59c62b90 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:40:46.355128 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f8da23-a4fd-4c70-9025-31cbfe849bf6 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:40:46.390750 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 826/1675] 10.222.0.86 () {60 vars in 1143 bytes} [Tue Jun 7 14:40:45 2022] POST /identity/v3/users => generated 289 bytes in 526 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:40:46.400661 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:40:46.401160 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31f85a5-7d89-41c9-a323-7f8c59c62b90 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:40:46.441583 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31f85a5-7d89-41c9-a323-7f8c59c62b90 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:40:46.457406 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdddaf81-d214-4ec9-a8db-a9bc7838f69e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:40:46.460605 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdddaf81-d214-4ec9-a8db-a9bc7838f69e admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:46.460976 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdddaf81-d214-4ec9-a8db-a9bc7838f69e admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:46.461330 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdddaf81-d214-4ec9-a8db-a9bc7838f69e admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:46.462161 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdddaf81-d214-4ec9-a8db-a9bc7838f69e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:40:46.471450 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdddaf81-d214-4ec9-a8db-a9bc7838f69e admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:40:46.499299 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 827/1676] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:40:46 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 07 14:40:46.500443 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdddaf81-d214-4ec9-a8db-a9bc7838f69e admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:40:46.520144 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdddaf81-d214-4ec9-a8db-a9bc7838f69e admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:40:46.534284 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e763c693-3d4a-4625-8786-ae77d7943cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:40:46.549805 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e763c693-3d4a-4625-8786-ae77d7943cbd admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:46.550251 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e763c693-3d4a-4625-8786-ae77d7943cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:46.551146 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e763c693-3d4a-4625-8786-ae77d7943cbd admin admin] PATH_INFO: `/v3/projects/9de1970058f14fc8a51a4f991b13d2ee/users/9c55fbddf1d441aca800f1c5238288ac/roles/e3bf6239f5bf477b965704b086786f11` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:46.556878 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2463618b-d570-4a57-8588-ee69a0b475da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99cfb70f54c45c8870369359da20378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:40:46.557550 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2463618b-d570-4a57-8588-ee69a0b475da service nova] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:46.557833 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2463618b-d570-4a57-8588-ee69a0b475da service nova] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:46.558100 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2463618b-d570-4a57-8588-ee69a0b475da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:46.597778 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e763c693-3d4a-4625-8786-ae77d7943cbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=9de1970058f14fc8a51a4f991b13d2ee, user_id=9c55fbddf1d441aca800f1c5238288ac, role_id=e3bf6239f5bf477b965704b086786f11)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:40:46.607546 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e763c693-3d4a-4625-8786-ae77d7943cbd admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:40:46.688269 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2463618b-d570-4a57-8588-ee69a0b475da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:40:46.690479 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 828/1677] 10.222.0.86 () {60 vars in 1482 bytes} [Tue Jun 7 14:40:46 2022] PUT /identity/v3/projects/9de1970058f14fc8a51a4f991b13d2ee/users/9c55fbddf1d441aca800f1c5238288ac/roles/e3bf6239f5bf477b965704b086786f11 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:40:46.690920 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2463618b-d570-4a57-8588-ee69a0b475da service nova] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:40:46.692052 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0375afe6-152b-48b6-bdbf-e7b63be610b7 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:46.692350 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0375afe6-152b-48b6-bdbf-e7b63be610b7 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:46.692634 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0375afe6-152b-48b6-bdbf-e7b63be610b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:46.723199 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 850/1678] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:40:46 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 622 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:40:46.725573 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2463618b-d570-4a57-8588-ee69a0b475da service nova] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:40:46.741068 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-0375afe6-152b-48b6-bdbf-e7b63be610b7 None None] MFA Rules not processed for user `dda603ec5517460a83c333db2af804d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:40:46.748002 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-0375afe6-152b-48b6-bdbf-e7b63be610b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:40:46.750920 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2463618b-d570-4a57-8588-ee69a0b475da service nova] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:40:46.892927 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e6bcfa-1aa1-44c1-bc53-ad28f8fc3537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:40:46.893616 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e6bcfa-1aa1-44c1-bc53-ad28f8fc3537 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:46.893898 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e6bcfa-1aa1-44c1-bc53-ad28f8fc3537 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:46.894174 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e6bcfa-1aa1-44c1-bc53-ad28f8fc3537 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:46.894906 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e6bcfa-1aa1-44c1-bc53-ad28f8fc3537 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:40:46.899603 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e6bcfa-1aa1-44c1-bc53-ad28f8fc3537 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:40:46.905273 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 829/1679] 10.222.0.15 () {58 vars in 1015 bytes} [Tue Jun 7 14:40:46 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:40:46.918120 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0375afe6-152b-48b6-bdbf-e7b63be610b7 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:40:46.920193 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-0375afe6-152b-48b6-bdbf-e7b63be610b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:40:46.937591 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0375afe6-152b-48b6-bdbf-e7b63be610b7 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:40:46.942460 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 851/1680] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:40:46 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:40:46.943817 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e444b1c-6daa-4198-9465-ffc6a1565a65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dda603ec5517460a83c333db2af804d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:40:46.944238 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e6bcfa-1aa1-44c1-bc53-ad28f8fc3537 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:40:46.944538 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e444b1c-6daa-4198-9465-ffc6a1565a65 service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:46.945299 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e444b1c-6daa-4198-9465-ffc6a1565a65 service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:46.945734 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e444b1c-6daa-4198-9465-ffc6a1565a65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:46.968883 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e6bcfa-1aa1-44c1-bc53-ad28f8fc3537 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:40:46.975942 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e444b1c-6daa-4198-9465-ffc6a1565a65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:40:46.978550 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e444b1c-6daa-4198-9465-ffc6a1565a65 service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:40:46.982435 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d367a3-5ade-4efa-b60f-ad355e2b92cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:40:46.983307 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d367a3-5ade-4efa-b60f-ad355e2b92cb admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:46.983593 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d367a3-5ade-4efa-b60f-ad355e2b92cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:46.984129 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d367a3-5ade-4efa-b60f-ad355e2b92cb admin admin] PATH_INFO: `/v3/projects/9de1970058f14fc8a51a4f991b13d2ee/users/9c55fbddf1d441aca800f1c5238288ac/roles/e3bf6239f5bf477b965704b086786f11` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:46.992468 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d367a3-5ade-4efa-b60f-ad355e2b92cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=9de1970058f14fc8a51a4f991b13d2ee, user_id=9c55fbddf1d441aca800f1c5238288ac, role_id=e3bf6239f5bf477b965704b086786f11)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:40:46.995286 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 830/1681] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:40:46 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:40:47.005196 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d367a3-5ade-4efa-b60f-ad355e2b92cb admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:40:47.035801 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 852/1682] 10.222.0.86 () {60 vars in 1482 bytes} [Tue Jun 7 14:40:46 2022] PUT /identity/v3/projects/9de1970058f14fc8a51a4f991b13d2ee/users/9c55fbddf1d441aca800f1c5238288ac/roles/e3bf6239f5bf477b965704b086786f11 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:40:47.043286 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752adb4a-47ac-451d-8422-7526a836bc0c None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:47.043620 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752adb4a-47ac-451d-8422-7526a836bc0c None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:47.043911 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752adb4a-47ac-451d-8422-7526a836bc0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:47.095321 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-752adb4a-47ac-451d-8422-7526a836bc0c None None] MFA Rules not processed for user `9c55fbddf1d441aca800f1c5238288ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:40:47.098332 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-752adb4a-47ac-451d-8422-7526a836bc0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:40:47.129979 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d367a3-5ade-4efa-b60f-ad355e2b92cb admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:40:47.132409 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-37d367a3-5ade-4efa-b60f-ad355e2b92cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:40:47.218701 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:40:47.285253 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d367a3-5ade-4efa-b60f-ad355e2b92cb admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:40:47.295817 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8dfff1-d88e-46c9-ae1b-518041720bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:40:47.295817 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8dfff1-d88e-46c9-ae1b-518041720bc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:47.295817 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8dfff1-d88e-46c9-ae1b-518041720bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:47.306036 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8dfff1-d88e-46c9-ae1b-518041720bc2 admin admin] PATH_INFO: `/v3/projects/a312f7d64da543c29266f37cbc9719be` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:47.311331 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8dfff1-d88e-46c9-ae1b-518041720bc2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a312f7d64da543c29266f37cbc9719be)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:40:47.314622 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8dfff1-d88e-46c9-ae1b-518041720bc2 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:40:47.357072 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 831/1683] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:40:47 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:40:47.369753 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752adb4a-47ac-451d-8422-7526a836bc0c None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:40:47.372300 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-752adb4a-47ac-451d-8422-7526a836bc0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:40:47.547123 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752adb4a-47ac-451d-8422-7526a836bc0c None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:40:47.556855 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-8b8dfff1-d88e-46c9-ae1b-518041720bc2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a312f7d64da543c29266f37cbc9719be', 'request_id': 'req-8b8dfff1-d88e-46c9-ae1b-518041720bc2'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:40:47.570747 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-8b8dfff1-d88e-46c9-ae1b-518041720bc2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a312f7d64da543c29266f37cbc9719be', 'request_id': 'req-8b8dfff1-d88e-46c9-ae1b-518041720bc2'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:40:47.641801 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-8b8dfff1-d88e-46c9-ae1b-518041720bc2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a312f7d64da543c29266f37cbc9719be', 'request_id': 'req-8b8dfff1-d88e-46c9-ae1b-518041720bc2'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:40:47.660678 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-8b8dfff1-d88e-46c9-ae1b-518041720bc2 admin admin] The token cache is being invalidate because project a312f7d64da543c29266f37cbc9719be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:40:47.661262 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-8b8dfff1-d88e-46c9-ae1b-518041720bc2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:40:47.662195 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-8b8dfff1-d88e-46c9-ae1b-518041720bc2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:40:47.671566 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 853/1684] 10.222.0.86 () {58 vars in 1232 bytes} [Tue Jun 7 14:40:47 2022] DELETE /identity/v3/projects/a312f7d64da543c29266f37cbc9719be => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:40:47.672977 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8dfff1-d88e-46c9-ae1b-518041720bc2 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:40:47.676601 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-8b8dfff1-d88e-46c9-ae1b-518041720bc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:40:47.705448 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7e8506-54da-4159-ac34-e139f51bb766 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af5a95620a4b43538abfe09eed4bf115', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:40:47.705448 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7e8506-54da-4159-ac34-e139f51bb766 service cinder] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:47.709346 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7e8506-54da-4159-ac34-e139f51bb766 service cinder] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:47.709346 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7e8506-54da-4159-ac34-e139f51bb766 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:47.709346 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-2f7e8506-54da-4159-ac34-e139f51bb766 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:40:47.814726 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7e8506-54da-4159-ac34-e139f51bb766 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:40:47.817610 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7e8506-54da-4159-ac34-e139f51bb766 service cinder] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:40:47.842108 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 832/1685] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:40:47 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 14:40:47.869451 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8dfff1-d88e-46c9-ae1b-518041720bc2 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:40:47.881669 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:40:47.883469 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9d8178-9f17-46f3-80d6-2bfa4b61bca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:40:47.885023 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9d8178-9f17-46f3-80d6-2bfa4b61bca0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:47.885325 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9d8178-9f17-46f3-80d6-2bfa4b61bca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:47.912001 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9d8178-9f17-46f3-80d6-2bfa4b61bca0 admin admin] PATH_INFO: `/v3/users/d556424cebdd47859f5604e068eca81f` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:47.912001 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9d8178-9f17-46f3-80d6-2bfa4b61bca0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d556424cebdd47859f5604e068eca81f)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:40:47.912001 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9d8178-9f17-46f3-80d6-2bfa4b61bca0 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:40:48.170457 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-2f9d8178-9f17-46f3-80d6-2bfa4b61bca0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd556424cebdd47859f5604e068eca81f'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:40:48.171137 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-2f9d8178-9f17-46f3-80d6-2bfa4b61bca0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd556424cebdd47859f5604e068eca81f'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:40:48.171318 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7e8506-54da-4159-ac34-e139f51bb766 service cinder] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:40:48.173210 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-2f7e8506-54da-4159-ac34-e139f51bb766 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:40:48.189086 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-2f9d8178-9f17-46f3-80d6-2bfa4b61bca0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd556424cebdd47859f5604e068eca81f'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:40:48.236414 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-2f9d8178-9f17-46f3-80d6-2bfa4b61bca0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd556424cebdd47859f5604e068eca81f'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:40:48.240664 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-2f9d8178-9f17-46f3-80d6-2bfa4b61bca0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd556424cebdd47859f5604e068eca81f'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:40:48.240765 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7e8506-54da-4159-ac34-e139f51bb766 service cinder] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:40:48.262642 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821a2333-a38d-493d-abfc-243fffc72764 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af5a95620a4b43538abfe09eed4bf115', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:40:48.267034 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821a2333-a38d-493d-abfc-243fffc72764 service cinder] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:48.271147 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821a2333-a38d-493d-abfc-243fffc72764 service cinder] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:48.272551 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821a2333-a38d-493d-abfc-243fffc72764 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:48.279925 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-821a2333-a38d-493d-abfc-243fffc72764 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:40:48.359741 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 854/1686] 10.222.0.86 () {58 vars in 1223 bytes} [Tue Jun 7 14:40:47 2022] DELETE /identity/v3/users/d556424cebdd47859f5604e068eca81f => generated 0 bytes in 687 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:40:48.422835 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:40:48.445873 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:40:48.489376 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821a2333-a38d-493d-abfc-243fffc72764 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:40:48.494918 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821a2333-a38d-493d-abfc-243fffc72764 service cinder] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:40:48.550708 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 833/1687] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:40:48 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:40:50.700932 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b585605a-8fdf-42f0-a778-a38a5250e278 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:50.701421 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b585605a-8fdf-42f0-a778-a38a5250e278 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:50.701507 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b585605a-8fdf-42f0-a778-a38a5250e278 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:50.703061 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 855/1688] 10.222.0.86 () {54 vars in 921 bytes} [Tue Jun 7 14:40:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:40:50.776269 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c22245c-610b-412e-94dd-91d20a1f848b None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:50.778415 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c22245c-610b-412e-94dd-91d20a1f848b None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:50.778765 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c22245c-610b-412e-94dd-91d20a1f848b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:50.898362 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-1c22245c-610b-412e-94dd-91d20a1f848b None None] MFA Rules not processed for user `b99cfb70f54c45c8870369359da20378`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:40:50.898362 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-1c22245c-610b-412e-94dd-91d20a1f848b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:40:51.220430 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 834/1689] 10.222.0.86 () {58 vars in 1018 bytes} [Tue Jun 7 14:40:50 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 446 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 14:40:51.269823 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b585605a-8fdf-42f0-a778-a38a5250e278 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:40:51.269823 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-b585605a-8fdf-42f0-a778-a38a5250e278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:40:51.305431 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b585605a-8fdf-42f0-a778-a38a5250e278 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:40:51.326167 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bf1add-bcb4-43e7-bf04-2061432748d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99cfb70f54c45c8870369359da20378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:40:51.326855 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bf1add-bcb4-43e7-bf04-2061432748d7 service nova] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:51.327139 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bf1add-bcb4-43e7-bf04-2061432748d7 service nova] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:51.327424 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bf1add-bcb4-43e7-bf04-2061432748d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:51.350849 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bf1add-bcb4-43e7-bf04-2061432748d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:40:51.356042 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bf1add-bcb4-43e7-bf04-2061432748d7 service nova] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:40:51.413315 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 856/1690] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:40:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:40:51.595858 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c22245c-610b-412e-94dd-91d20a1f848b None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:40:51.598548 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-1c22245c-610b-412e-94dd-91d20a1f848b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:40:51.812461 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c22245c-610b-412e-94dd-91d20a1f848b None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:40:51.819579 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ed552d-7b79-40b6-b8c2-cb951d1efa06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:40:51.820862 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ed552d-7b79-40b6-b8c2-cb951d1efa06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:51.821322 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ed552d-7b79-40b6-b8c2-cb951d1efa06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:51.822557 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ed552d-7b79-40b6-b8c2-cb951d1efa06 admin admin] PATH_INFO: `/v3/projects/fcb003527af746e689a46e9bb3bf1a7b` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:51.824110 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ed552d-7b79-40b6-b8c2-cb951d1efa06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fcb003527af746e689a46e9bb3bf1a7b)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:40:51.827226 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ed552d-7b79-40b6-b8c2-cb951d1efa06 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:40:52.066022 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-19ed552d-7b79-40b6-b8c2-cb951d1efa06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fcb003527af746e689a46e9bb3bf1a7b', 'request_id': 'req-19ed552d-7b79-40b6-b8c2-cb951d1efa06'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:40:52.125797 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-19ed552d-7b79-40b6-b8c2-cb951d1efa06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fcb003527af746e689a46e9bb3bf1a7b', 'request_id': 'req-19ed552d-7b79-40b6-b8c2-cb951d1efa06'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:40:52.207072 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-19ed552d-7b79-40b6-b8c2-cb951d1efa06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fcb003527af746e689a46e9bb3bf1a7b', 'request_id': 'req-19ed552d-7b79-40b6-b8c2-cb951d1efa06'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:40:52.252549 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-19ed552d-7b79-40b6-b8c2-cb951d1efa06 admin admin] The token cache is being invalidate because project fcb003527af746e689a46e9bb3bf1a7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:40:52.252832 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-19ed552d-7b79-40b6-b8c2-cb951d1efa06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:40:52.253990 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-19ed552d-7b79-40b6-b8c2-cb951d1efa06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:40:52.258737 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 835/1691] 10.222.0.86 () {58 vars in 1232 bytes} [Tue Jun 7 14:40:51 2022] DELETE /identity/v3/projects/fcb003527af746e689a46e9bb3bf1a7b => generated 0 bytes in 664 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:40:52.264513 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41da136-e796-4d98-8c40-b5cc6756a797 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:52.265053 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41da136-e796-4d98-8c40-b5cc6756a797 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:52.265053 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41da136-e796-4d98-8c40-b5cc6756a797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:52.318166 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-e41da136-e796-4d98-8c40-b5cc6756a797 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:40:52.319568 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-e41da136-e796-4d98-8c40-b5cc6756a797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:40:52.497811 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 857/1692] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:40:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:40:52.503652 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb93881-82dd-4307-b3c9-68ad2e9cdede None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:52.503978 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb93881-82dd-4307-b3c9-68ad2e9cdede None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:52.504364 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb93881-82dd-4307-b3c9-68ad2e9cdede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:52.520212 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:40:52.567028 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-0cb93881-82dd-4307-b3c9-68ad2e9cdede None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:40:52.570500 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-0cb93881-82dd-4307-b3c9-68ad2e9cdede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:40:52.585170 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 836/1693] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:40:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:40:52.589565 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41da136-e796-4d98-8c40-b5cc6756a797 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:40:52.605630 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41da136-e796-4d98-8c40-b5cc6756a797 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:40:52.614942 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b20b91-6c95-4356-8572-2689253d4b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:40:52.616257 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b20b91-6c95-4356-8572-2689253d4b6e admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:52.617041 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b20b91-6c95-4356-8572-2689253d4b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:52.617542 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b20b91-6c95-4356-8572-2689253d4b6e admin admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:52.618592 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b20b91-6c95-4356-8572-2689253d4b6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:40:52.619370 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b20b91-6c95-4356-8572-2689253d4b6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:40:52.626755 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b20b91-6c95-4356-8572-2689253d4b6e admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:40:52.709801 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 858/1694] 10.222.0.86 () {58 vars in 1152 bytes} [Tue Jun 7 14:40:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:40:52.712644 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb93881-82dd-4307-b3c9-68ad2e9cdede None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:40:52.733277 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb93881-82dd-4307-b3c9-68ad2e9cdede None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:40:52.754848 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9eca10-ccba-4e24-88fd-e12e4baa388f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:40:52.757523 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9eca10-ccba-4e24-88fd-e12e4baa388f admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:52.757830 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9eca10-ccba-4e24-88fd-e12e4baa388f admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:52.760921 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9eca10-ccba-4e24-88fd-e12e4baa388f admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:52.763550 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9eca10-ccba-4e24-88fd-e12e4baa388f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:40:52.768651 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9eca10-ccba-4e24-88fd-e12e4baa388f admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:40:52.926818 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 837/1695] 10.222.0.86 () {60 vars in 1152 bytes} [Tue Jun 7 14:40:52 2022] POST /identity/v3/projects => generated 385 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:40:52.931671 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b20b91-6c95-4356-8572-2689253d4b6e admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:40:52.970610 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b20b91-6c95-4356-8572-2689253d4b6e admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:40:53.218995 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5ac646-d4ce-4af3-9c87-ea323836fca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:40:53.221391 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5ac646-d4ce-4af3-9c87-ea323836fca7 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:53.221700 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5ac646-d4ce-4af3-9c87-ea323836fca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:53.222488 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5ac646-d4ce-4af3-9c87-ea323836fca7 admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:53.225299 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5ac646-d4ce-4af3-9c87-ea323836fca7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:40:53.229198 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5ac646-d4ce-4af3-9c87-ea323836fca7 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:40:53.367422 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:40:53.379718 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 859/1696] 10.222.0.86 () {60 vars in 1143 bytes} [Tue Jun 7 14:40:52 2022] POST /identity/v3/users => generated 293 bytes in 449 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:40:53.380825 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9eca10-ccba-4e24-88fd-e12e4baa388f admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:40:53.408040 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9eca10-ccba-4e24-88fd-e12e4baa388f admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:40:53.426874 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eccd74-8c36-46bd-9d29-12b60e27786f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:40:53.432084 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eccd74-8c36-46bd-9d29-12b60e27786f admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:53.433030 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eccd74-8c36-46bd-9d29-12b60e27786f admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:53.433557 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eccd74-8c36-46bd-9d29-12b60e27786f admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:53.435597 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87eccd74-8c36-46bd-9d29-12b60e27786f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:40:53.443631 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87eccd74-8c36-46bd-9d29-12b60e27786f admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:40:53.492274 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5ac646-d4ce-4af3-9c87-ea323836fca7 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:40:53.492555 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 838/1697] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:40:53 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:40:53.511222 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5ac646-d4ce-4af3-9c87-ea323836fca7 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:40:53.531583 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df5a920-4890-42a2-ae58-8b6ae878284d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:40:53.532563 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df5a920-4890-42a2-ae58-8b6ae878284d admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:53.533116 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df5a920-4890-42a2-ae58-8b6ae878284d admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:53.533535 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df5a920-4890-42a2-ae58-8b6ae878284d admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:53.534453 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df5a920-4890-42a2-ae58-8b6ae878284d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:40:53.536744 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df5a920-4890-42a2-ae58-8b6ae878284d admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:40:53.552633 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 860/1698] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:40:53 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:40:53.557063 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eccd74-8c36-46bd-9d29-12b60e27786f admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:40:53.571596 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eccd74-8c36-46bd-9d29-12b60e27786f admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:40:53.593646 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a64f8b-5aab-40c5-8a98-578b9ee37fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:40:53.597718 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a64f8b-5aab-40c5-8a98-578b9ee37fa7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:53.597718 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a64f8b-5aab-40c5-8a98-578b9ee37fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:53.597718 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a64f8b-5aab-40c5-8a98-578b9ee37fa7 admin admin] PATH_INFO: `/v3/projects/8dd164aa4334410d9409309a568495ba/users/d2c8a2963c454b78b3b8c4e6ba902313/roles/c17acc2a8bb348f59ba7edd22fcf0c47` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:53.636154 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a64f8b-5aab-40c5-8a98-578b9ee37fa7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dd164aa4334410d9409309a568495ba, user_id=d2c8a2963c454b78b3b8c4e6ba902313, role_id=c17acc2a8bb348f59ba7edd22fcf0c47)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:40:53.643557 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a64f8b-5aab-40c5-8a98-578b9ee37fa7 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:40:53.761428 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 839/1699] 10.222.0.86 () {60 vars in 1482 bytes} [Tue Jun 7 14:40:53 2022] PUT /identity/v3/projects/8dd164aa4334410d9409309a568495ba/users/d2c8a2963c454b78b3b8c4e6ba902313/roles/c17acc2a8bb348f59ba7edd22fcf0c47 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 14:40:53.782943 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc12079-dfd4-4036-9a61-49785ce4b47b None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:53.783125 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc12079-dfd4-4036-9a61-49785ce4b47b None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:53.783406 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc12079-dfd4-4036-9a61-49785ce4b47b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:53.842604 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-4dc12079-dfd4-4036-9a61-49785ce4b47b None None] MFA Rules not processed for user `d2c8a2963c454b78b3b8c4e6ba902313`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:40:53.849245 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-4dc12079-dfd4-4036-9a61-49785ce4b47b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:40:54.094251 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 861/1700] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:40:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:40:54.095492 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a64f8b-5aab-40c5-8a98-578b9ee37fa7 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:40:54.283579 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a64f8b-5aab-40c5-8a98-578b9ee37fa7 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:40:54.299889 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2f507e-dedb-4e0b-8caa-f49f661b9460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:40:54.312540 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2f507e-dedb-4e0b-8caa-f49f661b9460 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:54.313134 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2f507e-dedb-4e0b-8caa-f49f661b9460 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:54.314147 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2f507e-dedb-4e0b-8caa-f49f661b9460 admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:54.315891 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2f507e-dedb-4e0b-8caa-f49f661b9460 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:40:54.322402 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2f507e-dedb-4e0b-8caa-f49f661b9460 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:40:54.504302 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 840/1701] 10.222.0.86 () {60 vars in 1152 bytes} [Tue Jun 7 14:40:54 2022] POST /identity/v3/projects => generated 387 bytes in 409 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:40:54.508639 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc12079-dfd4-4036-9a61-49785ce4b47b None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:40:54.535895 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc12079-dfd4-4036-9a61-49785ce4b47b None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:40:54.681584 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449e5bd1-475d-4d5a-a454-2afa012169ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:40:54.682980 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449e5bd1-475d-4d5a-a454-2afa012169ed admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:54.683489 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449e5bd1-475d-4d5a-a454-2afa012169ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:54.683994 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449e5bd1-475d-4d5a-a454-2afa012169ed admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:54.687321 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449e5bd1-475d-4d5a-a454-2afa012169ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:40:54.689778 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449e5bd1-475d-4d5a-a454-2afa012169ed admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:40:54.803790 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 862/1702] 10.222.0.86 () {60 vars in 1143 bytes} [Tue Jun 7 14:40:54 2022] POST /identity/v3/users => generated 300 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:40:54.808546 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2f507e-dedb-4e0b-8caa-f49f661b9460 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:40:54.834260 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2f507e-dedb-4e0b-8caa-f49f661b9460 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:40:54.860385 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf46bb0a-7931-4c2f-b8b2-a8348c537378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:40:54.860385 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf46bb0a-7931-4c2f-b8b2-a8348c537378 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:54.860385 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf46bb0a-7931-4c2f-b8b2-a8348c537378 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:54.860385 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf46bb0a-7931-4c2f-b8b2-a8348c537378 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:54.860699 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf46bb0a-7931-4c2f-b8b2-a8348c537378 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:40:54.866766 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf46bb0a-7931-4c2f-b8b2-a8348c537378 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:40:54.916502 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 841/1703] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:40:54 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:40:54.917974 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449e5bd1-475d-4d5a-a454-2afa012169ed admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:40:54.931827 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449e5bd1-475d-4d5a-a454-2afa012169ed admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:40:54.967055 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def5c075-ab4b-4f1a-83a1-30179766f19d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:40:54.971152 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def5c075-ab4b-4f1a-83a1-30179766f19d admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:54.974021 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def5c075-ab4b-4f1a-83a1-30179766f19d admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:54.976725 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def5c075-ab4b-4f1a-83a1-30179766f19d admin admin] PATH_INFO: `/v3/projects/1823ffdd1fd74a798e31fe7fb9c9c6d3/users/0b38c00bc61f447896f0a0ba1a416a6d/roles/e3bf6239f5bf477b965704b086786f11` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:55.047512 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def5c075-ab4b-4f1a-83a1-30179766f19d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1823ffdd1fd74a798e31fe7fb9c9c6d3, user_id=0b38c00bc61f447896f0a0ba1a416a6d, role_id=e3bf6239f5bf477b965704b086786f11)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:40:55.050314 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def5c075-ab4b-4f1a-83a1-30179766f19d admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:40:55.143953 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 863/1704] 10.222.0.86 () {60 vars in 1482 bytes} [Tue Jun 7 14:40:54 2022] PUT /identity/v3/projects/1823ffdd1fd74a798e31fe7fb9c9c6d3/users/0b38c00bc61f447896f0a0ba1a416a6d/roles/e3bf6239f5bf477b965704b086786f11 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 14:40:55.158325 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf46bb0a-7931-4c2f-b8b2-a8348c537378 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:40:55.185908 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf46bb0a-7931-4c2f-b8b2-a8348c537378 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:40:55.308174 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6850074-6f19-4546-863d-c251add84f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:40:55.308973 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6850074-6f19-4546-863d-c251add84f71 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:55.309212 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6850074-6f19-4546-863d-c251add84f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:55.309646 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6850074-6f19-4546-863d-c251add84f71 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:55.310582 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6850074-6f19-4546-863d-c251add84f71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:40:55.312268 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6850074-6f19-4546-863d-c251add84f71 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:40:55.330904 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 842/1705] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:40:55 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:40:55.335260 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def5c075-ab4b-4f1a-83a1-30179766f19d admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:40:55.363241 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def5c075-ab4b-4f1a-83a1-30179766f19d admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:40:55.378355 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46b6e0d-6222-41be-a946-9f3b7c7b0c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:40:55.379624 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46b6e0d-6222-41be-a946-9f3b7c7b0c59 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:55.380160 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46b6e0d-6222-41be-a946-9f3b7c7b0c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:55.380817 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46b6e0d-6222-41be-a946-9f3b7c7b0c59 admin admin] PATH_INFO: `/v3/projects/1823ffdd1fd74a798e31fe7fb9c9c6d3/users/0b38c00bc61f447896f0a0ba1a416a6d/roles/e3bf6239f5bf477b965704b086786f11` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:55.383514 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46b6e0d-6222-41be-a946-9f3b7c7b0c59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1823ffdd1fd74a798e31fe7fb9c9c6d3, user_id=0b38c00bc61f447896f0a0ba1a416a6d, role_id=e3bf6239f5bf477b965704b086786f11)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:40:55.387643 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46b6e0d-6222-41be-a946-9f3b7c7b0c59 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:40:55.411207 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 864/1706] 10.222.0.86 () {60 vars in 1482 bytes} [Tue Jun 7 14:40:55 2022] PUT /identity/v3/projects/1823ffdd1fd74a798e31fe7fb9c9c6d3/users/0b38c00bc61f447896f0a0ba1a416a6d/roles/e3bf6239f5bf477b965704b086786f11 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:40:55.422464 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9674bba8-c106-409b-8b48-4a715e2fca13 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:55.423187 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9674bba8-c106-409b-8b48-4a715e2fca13 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:55.423520 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9674bba8-c106-409b-8b48-4a715e2fca13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:55.479778 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-9674bba8-c106-409b-8b48-4a715e2fca13 None None] MFA Rules not processed for user `0b38c00bc61f447896f0a0ba1a416a6d`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:40:55.485331 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-9674bba8-c106-409b-8b48-4a715e2fca13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:40:55.610816 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 843/1707] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:40:55 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:40:55.630661 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46b6e0d-6222-41be-a946-9f3b7c7b0c59 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:40:55.637660 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-e46b6e0d-6222-41be-a946-9f3b7c7b0c59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:40:55.724955 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:40:55.775335 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46b6e0d-6222-41be-a946-9f3b7c7b0c59 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:40:55.780033 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe10b758-f58c-4389-ae3a-60cfe8a87c04 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af5a95620a4b43538abfe09eed4bf115', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:40:55.780968 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe10b758-f58c-4389-ae3a-60cfe8a87c04 service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:55.781471 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe10b758-f58c-4389-ae3a-60cfe8a87c04 service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:55.782154 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe10b758-f58c-4389-ae3a-60cfe8a87c04 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:55.799906 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe10b758-f58c-4389-ae3a-60cfe8a87c04 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:40:55.801741 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe10b758-f58c-4389-ae3a-60cfe8a87c04 service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:40:55.815150 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 865/1708] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:40:55 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:40:55.889233 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9674bba8-c106-409b-8b48-4a715e2fca13 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:40:56.028711 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9674bba8-c106-409b-8b48-4a715e2fca13 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:40:56.041692 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ad9e7a-a1c8-4782-9f7e-ec3b3d9a2af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:40:56.042537 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ad9e7a-a1c8-4782-9f7e-ec3b3d9a2af9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:56.042862 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ad9e7a-a1c8-4782-9f7e-ec3b3d9a2af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:56.043084 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ad9e7a-a1c8-4782-9f7e-ec3b3d9a2af9 admin admin] PATH_INFO: `/v3/users/d2c8a2963c454b78b3b8c4e6ba902313` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:56.044527 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ad9e7a-a1c8-4782-9f7e-ec3b3d9a2af9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2c8a2963c454b78b3b8c4e6ba902313)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:40:56.046758 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ad9e7a-a1c8-4782-9f7e-ec3b3d9a2af9 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:40:56.058791 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:40:56.320802 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-e5ad9e7a-a1c8-4782-9f7e-ec3b3d9a2af9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2c8a2963c454b78b3b8c4e6ba902313'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:40:56.345040 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-e5ad9e7a-a1c8-4782-9f7e-ec3b3d9a2af9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2c8a2963c454b78b3b8c4e6ba902313'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:40:56.347199 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-e5ad9e7a-a1c8-4782-9f7e-ec3b3d9a2af9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2c8a2963c454b78b3b8c4e6ba902313'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:40:56.386149 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-e5ad9e7a-a1c8-4782-9f7e-ec3b3d9a2af9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2c8a2963c454b78b3b8c4e6ba902313'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:40:56.387196 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-e5ad9e7a-a1c8-4782-9f7e-ec3b3d9a2af9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2c8a2963c454b78b3b8c4e6ba902313'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:40:56.485493 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 844/1709] 10.222.0.86 () {58 vars in 1223 bytes} [Tue Jun 7 14:40:55 2022] DELETE /identity/v3/users/d2c8a2963c454b78b3b8c4e6ba902313 => generated 0 bytes in 605 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:40:56.489751 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2346674-ecf7-4884-ad7f-d7438df787f9 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:56.490412 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2346674-ecf7-4884-ad7f-d7438df787f9 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:56.490858 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2346674-ecf7-4884-ad7f-d7438df787f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:56.526365 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-c2346674-ecf7-4884-ad7f-d7438df787f9 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:40:56.530580 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-c2346674-ecf7-4884-ad7f-d7438df787f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:40:56.613408 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 866/1710] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:40:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:40:56.630541 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ad9e7a-a1c8-4782-9f7e-ec3b3d9a2af9 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:40:56.632394 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-e5ad9e7a-a1c8-4782-9f7e-ec3b3d9a2af9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:40:56.674221 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46980d70-2864-4410-958f-fa093186a975 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:56.674784 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46980d70-2864-4410-958f-fa093186a975 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:56.674951 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46980d70-2864-4410-958f-fa093186a975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:56.792196 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-46980d70-2864-4410-958f-fa093186a975 None None] MFA Rules not processed for user `3d5a010550bb4bf783a3cf75153d7e9f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:40:56.797208 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-46980d70-2864-4410-958f-fa093186a975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:40:56.832112 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ad9e7a-a1c8-4782-9f7e-ec3b3d9a2af9 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:40:56.846391 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc7878a-d1e8-4930-ae03-8f2aa6a88050 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dda603ec5517460a83c333db2af804d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:40:56.847309 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc7878a-d1e8-4930-ae03-8f2aa6a88050 service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:56.847606 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc7878a-d1e8-4930-ae03-8f2aa6a88050 service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:56.847947 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc7878a-d1e8-4930-ae03-8f2aa6a88050 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:56.880109 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc7878a-d1e8-4930-ae03-8f2aa6a88050 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:40:56.881700 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc7878a-d1e8-4930-ae03-8f2aa6a88050 service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:40:56.919421 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 845/1711] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:40:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:40:56.922593 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5a3b02-9ff5-4372-a27b-36ae96b8b0b1 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:56.922890 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5a3b02-9ff5-4372-a27b-36ae96b8b0b1 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:56.923175 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5a3b02-9ff5-4372-a27b-36ae96b8b0b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:56.938949 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:40:57.006557 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-8e5a3b02-9ff5-4372-a27b-36ae96b8b0b1 None None] MFA Rules not processed for user `bd70563183ab43d68df41f1be27cadc3`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:40:57.009635 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-8e5a3b02-9ff5-4372-a27b-36ae96b8b0b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:40:57.078317 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 867/1712] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:40:56 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 405 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 14:40:57.094895 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46980d70-2864-4410-958f-fa093186a975 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:40:57.097142 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-46980d70-2864-4410-958f-fa093186a975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:40:57.225103 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 846/1713] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:40:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:40:57.349501 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46980d70-2864-4410-958f-fa093186a975 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:40:57.369122 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec336f2-bcce-4d7b-859b-21d09e5f4255 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99cfb70f54c45c8870369359da20378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:40:57.369803 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec336f2-bcce-4d7b-859b-21d09e5f4255 service nova] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:57.382338 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec336f2-bcce-4d7b-859b-21d09e5f4255 service nova] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:57.390918 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec336f2-bcce-4d7b-859b-21d09e5f4255 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:57.394464 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:40:57.422084 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec336f2-bcce-4d7b-859b-21d09e5f4255 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:40:57.430064 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec336f2-bcce-4d7b-859b-21d09e5f4255 service nova] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:40:57.487709 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 868/1714] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:40:57 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:40:57.993510 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5a3b02-9ff5-4372-a27b-36ae96b8b0b1 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:40:58.020325 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5a3b02-9ff5-4372-a27b-36ae96b8b0b1 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:40:58.031530 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec336f2-bcce-4d7b-859b-21d09e5f4255 service nova] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:40:58.035732 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-cec336f2-bcce-4d7b-859b-21d09e5f4255 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:40:58.039795 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba64508d-dfc9-452d-9b9a-80a376f08977 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99cfb70f54c45c8870369359da20378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:40:58.041000 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba64508d-dfc9-452d-9b9a-80a376f08977 service nova] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:58.041513 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba64508d-dfc9-452d-9b9a-80a376f08977 service nova] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:58.042003 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba64508d-dfc9-452d-9b9a-80a376f08977 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:58.068622 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba64508d-dfc9-452d-9b9a-80a376f08977 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:40:58.071893 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba64508d-dfc9-452d-9b9a-80a376f08977 service nova] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:40:58.092623 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 847/1715] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:40:57 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:40:58.106102 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec336f2-bcce-4d7b-859b-21d09e5f4255 service nova] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:40:58.131690 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b761df-1d96-440e-9fd2-fe206c43e607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:40:58.131690 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b761df-1d96-440e-9fd2-fe206c43e607 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:58.131690 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b761df-1d96-440e-9fd2-fe206c43e607 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:58.131690 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b761df-1d96-440e-9fd2-fe206c43e607 admin admin] PATH_INFO: `/v3/projects/8dd164aa4334410d9409309a568495ba` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:58.137216 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b761df-1d96-440e-9fd2-fe206c43e607 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8dd164aa4334410d9409309a568495ba)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:40:58.140616 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b761df-1d96-440e-9fd2-fe206c43e607 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:40:58.372050 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-30b761df-1d96-440e-9fd2-fe206c43e607 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8dd164aa4334410d9409309a568495ba', 'request_id': 'req-30b761df-1d96-440e-9fd2-fe206c43e607'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:40:58.383269 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-30b761df-1d96-440e-9fd2-fe206c43e607 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8dd164aa4334410d9409309a568495ba', 'request_id': 'req-30b761df-1d96-440e-9fd2-fe206c43e607'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:40:58.494198 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-30b761df-1d96-440e-9fd2-fe206c43e607 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8dd164aa4334410d9409309a568495ba', 'request_id': 'req-30b761df-1d96-440e-9fd2-fe206c43e607'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:40:58.529274 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-30b761df-1d96-440e-9fd2-fe206c43e607 admin admin] The token cache is being invalidate because project 8dd164aa4334410d9409309a568495ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:40:58.529957 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-30b761df-1d96-440e-9fd2-fe206c43e607 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:40:58.531885 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-30b761df-1d96-440e-9fd2-fe206c43e607 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:40:58.535926 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 869/1716] 10.222.0.86 () {58 vars in 1232 bytes} [Tue Jun 7 14:40:58 2022] DELETE /identity/v3/projects/8dd164aa4334410d9409309a568495ba => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:40:58.540938 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba64508d-dfc9-452d-9b9a-80a376f08977 service nova] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:40:58.562898 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba64508d-dfc9-452d-9b9a-80a376f08977 service nova] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:40:58.730507 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28e6bef-5ceb-4b6b-a217-79605a4b746d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:40:58.732448 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28e6bef-5ceb-4b6b-a217-79605a4b746d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:58.732807 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28e6bef-5ceb-4b6b-a217-79605a4b746d admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:58.735356 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28e6bef-5ceb-4b6b-a217-79605a4b746d admin admin] PATH_INFO: `/v3/users/0b38c00bc61f447896f0a0ba1a416a6d` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:58.744339 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28e6bef-5ceb-4b6b-a217-79605a4b746d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b38c00bc61f447896f0a0ba1a416a6d)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:40:58.746461 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28e6bef-5ceb-4b6b-a217-79605a4b746d admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:40:59.013566 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:40:59.053050 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-e28e6bef-5ceb-4b6b-a217-79605a4b746d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b38c00bc61f447896f0a0ba1a416a6d'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:40:59.073458 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-e28e6bef-5ceb-4b6b-a217-79605a4b746d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b38c00bc61f447896f0a0ba1a416a6d'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:40:59.076215 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-e28e6bef-5ceb-4b6b-a217-79605a4b746d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b38c00bc61f447896f0a0ba1a416a6d'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:40:59.122241 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-e28e6bef-5ceb-4b6b-a217-79605a4b746d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b38c00bc61f447896f0a0ba1a416a6d'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:40:59.123009 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-e28e6bef-5ceb-4b6b-a217-79605a4b746d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b38c00bc61f447896f0a0ba1a416a6d'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:40:59.246201 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c213af1e-ec90-4c0e-9288-e9d13a1f89c6 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:59.246725 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c213af1e-ec90-4c0e-9288-e9d13a1f89c6 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:59.247026 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c213af1e-ec90-4c0e-9288-e9d13a1f89c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:59.325846 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 848/1717] 10.222.0.86 () {58 vars in 1223 bytes} [Tue Jun 7 14:40:58 2022] DELETE /identity/v3/users/0b38c00bc61f447896f0a0ba1a416a6d => generated 0 bytes in 786 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:40:59.327708 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-c213af1e-ec90-4c0e-9288-e9d13a1f89c6 None None] MFA Rules not processed for user `68698bf3cf7a4dee9daa865e9d6454ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:40:59.329709 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-c213af1e-ec90-4c0e-9288-e9d13a1f89c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:40:59.498413 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 870/1718] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:40:59 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 14:40:59.504692 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9112c482-9b2d-44d0-8336-3586847714d3 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:59.505086 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9112c482-9b2d-44d0-8336-3586847714d3 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:59.505569 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9112c482-9b2d-44d0-8336-3586847714d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:59.541041 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-9112c482-9b2d-44d0-8336-3586847714d3 None None] MFA Rules not processed for user `68698bf3cf7a4dee9daa865e9d6454ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:40:59.542668 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-9112c482-9b2d-44d0-8336-3586847714d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:40:59.573893 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 849/1719] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:40:59 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:40:59.575121 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c213af1e-ec90-4c0e-9288-e9d13a1f89c6 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:40:59.576652 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-c213af1e-ec90-4c0e-9288-e9d13a1f89c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:40:59.799689 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:40:59.857143 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c213af1e-ec90-4c0e-9288-e9d13a1f89c6 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:40:59.873757 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df775d8-7b14-468e-b773-39f9855b18b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99cfb70f54c45c8870369359da20378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:40:59.874613 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df775d8-7b14-468e-b773-39f9855b18b5 service nova] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:59.875101 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df775d8-7b14-468e-b773-39f9855b18b5 service nova] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:59.875524 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df775d8-7b14-468e-b773-39f9855b18b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:59.911662 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df775d8-7b14-468e-b773-39f9855b18b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:40:59.913361 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df775d8-7b14-468e-b773-39f9855b18b5 service nova] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:40:59.939663 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 871/1720] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:40:59 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 14:40:59.951499 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db76840d-bfc3-4b8e-8d0e-2491c888a210 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:40:59.951499 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db76840d-bfc3-4b8e-8d0e-2491c888a210 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:40:59.951499 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db76840d-bfc3-4b8e-8d0e-2491c888a210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:40:59.986185 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-db76840d-bfc3-4b8e-8d0e-2491c888a210 None None] MFA Rules not processed for user `65552520abca41ab8728a75046dc94d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:40:59.989446 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-db76840d-bfc3-4b8e-8d0e-2491c888a210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:41:00.256719 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 850/1721] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:40:59 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 14:41:00.886272 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df775d8-7b14-468e-b773-39f9855b18b5 service nova] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:00.886996 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-1df775d8-7b14-468e-b773-39f9855b18b5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:41:01.048553 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df775d8-7b14-468e-b773-39f9855b18b5 service nova] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:01.054201 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06199ee2-bd42-4cb8-b06e-632e16e1b1db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:01.055211 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06199ee2-bd42-4cb8-b06e-632e16e1b1db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:01.055387 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06199ee2-bd42-4cb8-b06e-632e16e1b1db admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:01.056258 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06199ee2-bd42-4cb8-b06e-632e16e1b1db admin admin] PATH_INFO: `/v3/projects/1823ffdd1fd74a798e31fe7fb9c9c6d3` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:01.068802 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06199ee2-bd42-4cb8-b06e-632e16e1b1db admin admin] RBAC: Authorizing `identity:delete_project(project_id=1823ffdd1fd74a798e31fe7fb9c9c6d3)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:01.078192 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06199ee2-bd42-4cb8-b06e-632e16e1b1db admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:01.250196 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-06199ee2-bd42-4cb8-b06e-632e16e1b1db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1823ffdd1fd74a798e31fe7fb9c9c6d3', 'request_id': 'req-06199ee2-bd42-4cb8-b06e-632e16e1b1db'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:01.272656 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-06199ee2-bd42-4cb8-b06e-632e16e1b1db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1823ffdd1fd74a798e31fe7fb9c9c6d3', 'request_id': 'req-06199ee2-bd42-4cb8-b06e-632e16e1b1db'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:01.388060 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-06199ee2-bd42-4cb8-b06e-632e16e1b1db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1823ffdd1fd74a798e31fe7fb9c9c6d3', 'request_id': 'req-06199ee2-bd42-4cb8-b06e-632e16e1b1db'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:01.421313 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-06199ee2-bd42-4cb8-b06e-632e16e1b1db admin admin] The token cache is being invalidate because project 1823ffdd1fd74a798e31fe7fb9c9c6d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:41:01.421759 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-06199ee2-bd42-4cb8-b06e-632e16e1b1db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:01.422821 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-06199ee2-bd42-4cb8-b06e-632e16e1b1db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:01.425877 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 872/1722] 10.222.0.86 () {58 vars in 1232 bytes} [Tue Jun 7 14:41:00 2022] DELETE /identity/v3/projects/1823ffdd1fd74a798e31fe7fb9c9c6d3 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:41:01.431087 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb182bc6-4b6a-4b3f-a62d-80a4967f702b None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:01.431585 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb182bc6-4b6a-4b3f-a62d-80a4967f702b None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:01.431881 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb182bc6-4b6a-4b3f-a62d-80a4967f702b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:01.452566 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-eb182bc6-4b6a-4b3f-a62d-80a4967f702b None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:41:01.454114 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-eb182bc6-4b6a-4b3f-a62d-80a4967f702b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:41:01.581281 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 851/1723] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:41:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:41:01.597654 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb35774-b202-4125-bc08-2924fe234374 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:01.597959 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb35774-b202-4125-bc08-2924fe234374 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:01.598258 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb35774-b202-4125-bc08-2924fe234374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:01.645893 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-dcb35774-b202-4125-bc08-2924fe234374 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:41:01.648201 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-dcb35774-b202-4125-bc08-2924fe234374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:41:01.674763 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa2af7e-bc46-439b-8634-756f62be932c None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:01.675425 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa2af7e-bc46-439b-8634-756f62be932c None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:01.675899 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa2af7e-bc46-439b-8634-756f62be932c None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:01.677896 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 852/1724] 10.222.0.86 () {54 vars in 912 bytes} [Tue Jun 7 14:41:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:41:01.680121 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 873/1725] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:41:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 14:41:01.684068 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa2af7e-bc46-439b-8634-756f62be932c None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:01.687503 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6d9a67-e12c-45df-b9f9-82eb59d64f8a None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:01.688009 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6d9a67-e12c-45df-b9f9-82eb59d64f8a None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:01.688568 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6d9a67-e12c-45df-b9f9-82eb59d64f8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:01.723992 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa2af7e-bc46-439b-8634-756f62be932c None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:01.729416 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-6e6d9a67-e12c-45df-b9f9-82eb59d64f8a None None] MFA Rules not processed for user `dda603ec5517460a83c333db2af804d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:41:01.730697 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-6e6d9a67-e12c-45df-b9f9-82eb59d64f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:41:01.733683 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ece7ce-12be-403d-b8fd-e1b49c365f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:01.735937 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ece7ce-12be-403d-b8fd-e1b49c365f18 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:01.736837 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ece7ce-12be-403d-b8fd-e1b49c365f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:01.737497 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ece7ce-12be-403d-b8fd-e1b49c365f18 admin admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:01.751064 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ece7ce-12be-403d-b8fd-e1b49c365f18 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:41:01.751064 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ece7ce-12be-403d-b8fd-e1b49c365f18 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:01.765580 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ece7ce-12be-403d-b8fd-e1b49c365f18 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:01.807938 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 853/1726] 10.222.0.86 () {58 vars in 1152 bytes} [Tue Jun 7 14:41:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:41:01.809617 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f03a8-a031-46f6-b5bd-1ea4d45ba2b0 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:01.810029 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f03a8-a031-46f6-b5bd-1ea4d45ba2b0 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:01.810686 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f03a8-a031-46f6-b5bd-1ea4d45ba2b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:01.869466 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-059f03a8-a031-46f6-b5bd-1ea4d45ba2b0 None None] MFA Rules not processed for user `68698bf3cf7a4dee9daa865e9d6454ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:41:01.871376 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-059f03a8-a031-46f6-b5bd-1ea4d45ba2b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:41:01.915492 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 874/1727] 10.222.0.86 () {58 vars in 1009 bytes} [Tue Jun 7 14:41:01 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:41:01.916490 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6d9a67-e12c-45df-b9f9-82eb59d64f8a None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:01.944305 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6d9a67-e12c-45df-b9f9-82eb59d64f8a None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:01.959795 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02039616-dc36-4870-9399-d3e48c31dd54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:01.960482 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02039616-dc36-4870-9399-d3e48c31dd54 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:01.960770 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02039616-dc36-4870-9399-d3e48c31dd54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:01.961049 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02039616-dc36-4870-9399-d3e48c31dd54 admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:01.961790 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02039616-dc36-4870-9399-d3e48c31dd54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:01.963723 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02039616-dc36-4870-9399-d3e48c31dd54 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:01.986191 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:41:02.036831 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 854/1728] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:41:01 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:41:02.037986 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059f03a8-a031-46f6-b5bd-1ea4d45ba2b0 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:02.039487 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-059f03a8-a031-46f6-b5bd-1ea4d45ba2b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:41:02.054372 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059f03a8-a031-46f6-b5bd-1ea4d45ba2b0 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:02.065741 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21102a48-2ab9-4c6a-8210-3792e69f0586 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dda603ec5517460a83c333db2af804d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:02.066538 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21102a48-2ab9-4c6a-8210-3792e69f0586 service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:02.066903 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21102a48-2ab9-4c6a-8210-3792e69f0586 service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:02.067256 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21102a48-2ab9-4c6a-8210-3792e69f0586 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:02.081753 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 875/1729] 10.222.0.86 () {60 vars in 1152 bytes} [Tue Jun 7 14:41:01 2022] POST /identity/v3/projects => generated 389 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:41:02.085580 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02039616-dc36-4870-9399-d3e48c31dd54 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:02.091672 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21102a48-2ab9-4c6a-8210-3792e69f0586 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:02.094547 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21102a48-2ab9-4c6a-8210-3792e69f0586 service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:02.117352 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 855/1730] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:41:02 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:41:02.189776 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02039616-dc36-4870-9399-d3e48c31dd54 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:02.194841 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81654767-c05d-4bf4-a6b3-f4f6e2e559d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:02.195955 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81654767-c05d-4bf4-a6b3-f4f6e2e559d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:02.196373 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81654767-c05d-4bf4-a6b3-f4f6e2e559d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:02.202474 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81654767-c05d-4bf4-a6b3-f4f6e2e559d2 admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:02.202474 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81654767-c05d-4bf4-a6b3-f4f6e2e559d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:02.202474 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81654767-c05d-4bf4-a6b3-f4f6e2e559d2 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:02.291303 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:41:02.305099 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 876/1731] 10.222.0.86 () {60 vars in 1143 bytes} [Tue Jun 7 14:41:02 2022] POST /identity/v3/users => generated 295 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 14:41:02.309447 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21102a48-2ab9-4c6a-8210-3792e69f0586 service neutron] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:02.323581 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21102a48-2ab9-4c6a-8210-3792e69f0586 service neutron] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:02.334788 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7449cc-1f39-486d-b1fd-388564918886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:02.335356 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7449cc-1f39-486d-b1fd-388564918886 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:02.335645 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7449cc-1f39-486d-b1fd-388564918886 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:02.336054 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7449cc-1f39-486d-b1fd-388564918886 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:02.337516 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7449cc-1f39-486d-b1fd-388564918886 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:02.339147 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7449cc-1f39-486d-b1fd-388564918886 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:02.363462 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 856/1732] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:41:02 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:41:02.365427 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81654767-c05d-4bf4-a6b3-f4f6e2e559d2 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:02.378750 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81654767-c05d-4bf4-a6b3-f4f6e2e559d2 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:02.385946 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b350c8-18c9-419a-9771-1f5263cce126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:02.392017 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b350c8-18c9-419a-9771-1f5263cce126 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:02.392017 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b350c8-18c9-419a-9771-1f5263cce126 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:02.392017 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b350c8-18c9-419a-9771-1f5263cce126 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:02.392017 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b350c8-18c9-419a-9771-1f5263cce126 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:02.392017 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b350c8-18c9-419a-9771-1f5263cce126 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:02.406923 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 877/1733] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:41:02 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:41:02.410886 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7449cc-1f39-486d-b1fd-388564918886 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:02.428109 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7449cc-1f39-486d-b1fd-388564918886 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:02.440564 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa445a62-b9b5-4f8e-b601-042b414c1094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:02.441483 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa445a62-b9b5-4f8e-b601-042b414c1094 admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:02.441767 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa445a62-b9b5-4f8e-b601-042b414c1094 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:02.444585 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa445a62-b9b5-4f8e-b601-042b414c1094 admin admin] PATH_INFO: `/v3/projects/eed1e4659f5b48879ae3218130023b24/users/4d9ef04b37f042b284134eb2de8fc772/roles/c17acc2a8bb348f59ba7edd22fcf0c47` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:02.492695 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa445a62-b9b5-4f8e-b601-042b414c1094 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eed1e4659f5b48879ae3218130023b24, user_id=4d9ef04b37f042b284134eb2de8fc772, role_id=c17acc2a8bb348f59ba7edd22fcf0c47)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:02.496342 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa445a62-b9b5-4f8e-b601-042b414c1094 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:02.703993 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 857/1734] 10.222.0.86 () {60 vars in 1482 bytes} [Tue Jun 7 14:41:02 2022] PUT /identity/v3/projects/eed1e4659f5b48879ae3218130023b24/users/4d9ef04b37f042b284134eb2de8fc772/roles/c17acc2a8bb348f59ba7edd22fcf0c47 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:41:02.718221 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebbbdac-4fe9-43e7-86e0-616c5d857b7d None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:02.718742 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebbbdac-4fe9-43e7-86e0-616c5d857b7d None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:02.719191 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebbbdac-4fe9-43e7-86e0-616c5d857b7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:02.773022 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-3ebbbdac-4fe9-43e7-86e0-616c5d857b7d None None] MFA Rules not processed for user `4d9ef04b37f042b284134eb2de8fc772`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:41:02.775451 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-3ebbbdac-4fe9-43e7-86e0-616c5d857b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:41:02.926444 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 878/1735] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:41:02 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:41:02.942669 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa445a62-b9b5-4f8e-b601-042b414c1094 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:03.250940 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa445a62-b9b5-4f8e-b601-042b414c1094 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:03.257094 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98456046-7e1f-493a-adf0-4339b7650cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:03.262613 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98456046-7e1f-493a-adf0-4339b7650cec admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:03.262973 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98456046-7e1f-493a-adf0-4339b7650cec admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:03.263263 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98456046-7e1f-493a-adf0-4339b7650cec admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:03.264146 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98456046-7e1f-493a-adf0-4339b7650cec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:03.266395 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98456046-7e1f-493a-adf0-4339b7650cec admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:03.308821 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebbbdac-4fe9-43e7-86e0-616c5d857b7d None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:03.314014 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-3ebbbdac-4fe9-43e7-86e0-616c5d857b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:41:03.328457 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebbbdac-4fe9-43e7-86e0-616c5d857b7d None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:03.336912 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f729c0-bcd9-4bc2-8c15-7e99282d3493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:03.338188 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f729c0-bcd9-4bc2-8c15-7e99282d3493 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:03.338624 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f729c0-bcd9-4bc2-8c15-7e99282d3493 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:03.342576 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f729c0-bcd9-4bc2-8c15-7e99282d3493 admin admin] PATH_INFO: `/v3/users/378a38f2d8424dd5a296ebc77043841b` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:03.342576 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f729c0-bcd9-4bc2-8c15-7e99282d3493 admin admin] RBAC: Authorizing `identity:delete_user(user_id=378a38f2d8424dd5a296ebc77043841b)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:03.343122 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f729c0-bcd9-4bc2-8c15-7e99282d3493 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:03.429405 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 858/1736] 10.222.0.86 () {60 vars in 1152 bytes} [Tue Jun 7 14:41:02 2022] POST /identity/v3/projects => generated 389 bytes in 487 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:41:03.445789 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98456046-7e1f-493a-adf0-4339b7650cec admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:03.548741 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98456046-7e1f-493a-adf0-4339b7650cec admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:03.554312 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb6c043-9777-49c4-a882-dfcfe48d3a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:03.556132 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb6c043-9777-49c4-a882-dfcfe48d3a96 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:03.556632 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb6c043-9777-49c4-a882-dfcfe48d3a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:03.557134 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb6c043-9777-49c4-a882-dfcfe48d3a96 admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:03.558053 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb6c043-9777-49c4-a882-dfcfe48d3a96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:03.560790 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb6c043-9777-49c4-a882-dfcfe48d3a96 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:03.630964 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-11f729c0-bcd9-4bc2-8c15-7e99282d3493 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '378a38f2d8424dd5a296ebc77043841b'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:03.632482 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-11f729c0-bcd9-4bc2-8c15-7e99282d3493 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '378a38f2d8424dd5a296ebc77043841b'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:03.657927 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-11f729c0-bcd9-4bc2-8c15-7e99282d3493 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '378a38f2d8424dd5a296ebc77043841b'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:03.676007 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 859/1737] 10.222.0.86 () {60 vars in 1143 bytes} [Tue Jun 7 14:41:03 2022] POST /identity/v3/users => generated 301 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 14:41:03.680819 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb6c043-9777-49c4-a882-dfcfe48d3a96 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:03.686156 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-11f729c0-bcd9-4bc2-8c15-7e99282d3493 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '378a38f2d8424dd5a296ebc77043841b'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:03.691586 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-11f729c0-bcd9-4bc2-8c15-7e99282d3493 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '378a38f2d8424dd5a296ebc77043841b'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:03.720591 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb6c043-9777-49c4-a882-dfcfe48d3a96 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:03.731489 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed47758-897f-4de7-8cbc-015c6f9254d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:03.732597 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed47758-897f-4de7-8cbc-015c6f9254d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:03.734624 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed47758-897f-4de7-8cbc-015c6f9254d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:03.734968 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed47758-897f-4de7-8cbc-015c6f9254d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:03.735839 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed47758-897f-4de7-8cbc-015c6f9254d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:03.737598 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed47758-897f-4de7-8cbc-015c6f9254d9 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:03.750340 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 860/1738] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:41:03 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:41:03.754331 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed47758-897f-4de7-8cbc-015c6f9254d9 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:03.764082 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-9ed47758-897f-4de7-8cbc-015c6f9254d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:41:03.773980 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed47758-897f-4de7-8cbc-015c6f9254d9 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:03.780877 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6198fa-17a3-488f-bea7-36dedcfaca0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:03.796995 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 879/1739] 10.222.0.86 () {58 vars in 1223 bytes} [Tue Jun 7 14:41:03 2022] DELETE /identity/v3/users/378a38f2d8424dd5a296ebc77043841b => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:41:03.798083 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6198fa-17a3-488f-bea7-36dedcfaca0c admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:03.798609 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6198fa-17a3-488f-bea7-36dedcfaca0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:03.799186 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6198fa-17a3-488f-bea7-36dedcfaca0c admin admin] PATH_INFO: `/v3/projects/c2422ae6c1e8467a9e11e7c44b9ade93/users/28c8ce3efbaf4341950348a2130e46a9/roles/e3bf6239f5bf477b965704b086786f11` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:03.803638 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d37c93-71b8-4373-a65c-28e41dad60fc None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:03.804176 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d37c93-71b8-4373-a65c-28e41dad60fc None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:03.804662 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d37c93-71b8-4373-a65c-28e41dad60fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:03.845482 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6198fa-17a3-488f-bea7-36dedcfaca0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2422ae6c1e8467a9e11e7c44b9ade93, user_id=28c8ce3efbaf4341950348a2130e46a9, role_id=e3bf6239f5bf477b965704b086786f11)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:03.848237 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-d3d37c93-71b8-4373-a65c-28e41dad60fc None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:41:03.849963 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6198fa-17a3-488f-bea7-36dedcfaca0c admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:03.853992 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-d3d37c93-71b8-4373-a65c-28e41dad60fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:41:03.983987 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 861/1740] 10.222.0.86 () {60 vars in 1482 bytes} [Tue Jun 7 14:41:03 2022] PUT /identity/v3/projects/c2422ae6c1e8467a9e11e7c44b9ade93/users/28c8ce3efbaf4341950348a2130e46a9/roles/e3bf6239f5bf477b965704b086786f11 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:41:03.984450 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 880/1741] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:41:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:41:03.984889 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6198fa-17a3-488f-bea7-36dedcfaca0c admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:04.002375 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d37c93-71b8-4373-a65c-28e41dad60fc None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:04.003937 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-d3d37c93-71b8-4373-a65c-28e41dad60fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:41:04.109535 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:41:04.145871 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d37c93-71b8-4373-a65c-28e41dad60fc None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:04.239724 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6198fa-17a3-488f-bea7-36dedcfaca0c admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:04.261522 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8643ef-8522-49ac-a97a-3e826396441a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:04.275612 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8643ef-8522-49ac-a97a-3e826396441a admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:04.275612 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8643ef-8522-49ac-a97a-3e826396441a admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:04.275612 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8643ef-8522-49ac-a97a-3e826396441a admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:04.275612 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8643ef-8522-49ac-a97a-3e826396441a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:04.275612 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8643ef-8522-49ac-a97a-3e826396441a admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:04.278105 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f6d5d2-2d09-4acd-b808-2d730d1b227a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dda603ec5517460a83c333db2af804d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:04.278905 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f6d5d2-2d09-4acd-b808-2d730d1b227a service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:04.279265 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f6d5d2-2d09-4acd-b808-2d730d1b227a service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:04.279616 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f6d5d2-2d09-4acd-b808-2d730d1b227a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:04.285836 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 862/1742] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:41:03 2022] GET /identity/v3/roles => generated 1420 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:41:04.290497 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8643ef-8522-49ac-a97a-3e826396441a admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:04.303547 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f6d5d2-2d09-4acd-b808-2d730d1b227a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:04.320836 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8643ef-8522-49ac-a97a-3e826396441a admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:04.321257 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f6d5d2-2d09-4acd-b808-2d730d1b227a service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:04.349176 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 881/1743] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:41:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:41:04.378211 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c6f10f-b79e-4d73-bd7a-350f1edf9011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:04.389350 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c6f10f-b79e-4d73-bd7a-350f1edf9011 admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:04.389651 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c6f10f-b79e-4d73-bd7a-350f1edf9011 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:04.389940 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c6f10f-b79e-4d73-bd7a-350f1edf9011 admin admin] PATH_INFO: `/v3/projects/c2422ae6c1e8467a9e11e7c44b9ade93/users/28c8ce3efbaf4341950348a2130e46a9/roles/e3bf6239f5bf477b965704b086786f11` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:04.394826 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c6f10f-b79e-4d73-bd7a-350f1edf9011 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2422ae6c1e8467a9e11e7c44b9ade93, user_id=28c8ce3efbaf4341950348a2130e46a9, role_id=e3bf6239f5bf477b965704b086786f11)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:04.409648 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c6f10f-b79e-4d73-bd7a-350f1edf9011 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:04.453563 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 863/1744] 10.222.0.86 () {60 vars in 1482 bytes} [Tue Jun 7 14:41:04 2022] PUT /identity/v3/projects/c2422ae6c1e8467a9e11e7c44b9ade93/users/28c8ce3efbaf4341950348a2130e46a9/roles/e3bf6239f5bf477b965704b086786f11 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:41:04.464634 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6007fa67-ec62-462f-8a81-e4402df62daf None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:04.465646 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6007fa67-ec62-462f-8a81-e4402df62daf None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:04.466007 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6007fa67-ec62-462f-8a81-e4402df62daf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:04.536258 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-6007fa67-ec62-462f-8a81-e4402df62daf None None] MFA Rules not processed for user `28c8ce3efbaf4341950348a2130e46a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:41:04.545589 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-6007fa67-ec62-462f-8a81-e4402df62daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:41:04.668121 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 882/1745] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:41:04 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:41:04.676948 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c6f10f-b79e-4d73-bd7a-350f1edf9011 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:04.681670 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-42c6f10f-b79e-4d73-bd7a-350f1edf9011 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:41:04.765823 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c6f10f-b79e-4d73-bd7a-350f1edf9011 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:04.771274 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b4e0a3-48fc-4283-b1e0-bb15fef15773 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af5a95620a4b43538abfe09eed4bf115', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:04.772305 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b4e0a3-48fc-4283-b1e0-bb15fef15773 service cinder] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:04.772785 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b4e0a3-48fc-4283-b1e0-bb15fef15773 service cinder] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:04.773400 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b4e0a3-48fc-4283-b1e0-bb15fef15773 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:04.785226 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b4e0a3-48fc-4283-b1e0-bb15fef15773 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:04.786849 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b4e0a3-48fc-4283-b1e0-bb15fef15773 service cinder] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:04.810833 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 864/1746] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:41:04 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:41:05.040752 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6007fa67-ec62-462f-8a81-e4402df62daf None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:05.144834 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6007fa67-ec62-462f-8a81-e4402df62daf None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:05.152088 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a789e9-b864-459b-a306-ae1398c91d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:05.153159 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a789e9-b864-459b-a306-ae1398c91d04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:05.153528 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a789e9-b864-459b-a306-ae1398c91d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:05.153913 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a789e9-b864-459b-a306-ae1398c91d04 admin admin] PATH_INFO: `/v3/users/4d9ef04b37f042b284134eb2de8fc772` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:05.155196 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a789e9-b864-459b-a306-ae1398c91d04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d9ef04b37f042b284134eb2de8fc772)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:05.157328 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a789e9-b864-459b-a306-ae1398c91d04 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:05.787645 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-19a789e9-b864-459b-a306-ae1398c91d04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d9ef04b37f042b284134eb2de8fc772'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:05.791914 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-19a789e9-b864-459b-a306-ae1398c91d04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d9ef04b37f042b284134eb2de8fc772'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:05.796353 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-19a789e9-b864-459b-a306-ae1398c91d04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d9ef04b37f042b284134eb2de8fc772'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:05.814167 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-19a789e9-b864-459b-a306-ae1398c91d04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d9ef04b37f042b284134eb2de8fc772'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:05.814941 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-19a789e9-b864-459b-a306-ae1398c91d04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d9ef04b37f042b284134eb2de8fc772'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:05.858149 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b1aea4-506b-49ce-b30a-a8bdc9593c18 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:05.858633 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b1aea4-506b-49ce-b30a-a8bdc9593c18 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:05.858719 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b1aea4-506b-49ce-b30a-a8bdc9593c18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:05.904784 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-f7b1aea4-506b-49ce-b30a-a8bdc9593c18 None None] MFA Rules not processed for user `3d5a010550bb4bf783a3cf75153d7e9f`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:41:05.923586 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-f7b1aea4-506b-49ce-b30a-a8bdc9593c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:41:05.952144 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 883/1747] 10.222.0.86 () {58 vars in 1223 bytes} [Tue Jun 7 14:41:05 2022] DELETE /identity/v3/users/4d9ef04b37f042b284134eb2de8fc772 => generated 0 bytes in 911 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:41:05.955125 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a789e9-b864-459b-a306-ae1398c91d04 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:05.956523 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-19a789e9-b864-459b-a306-ae1398c91d04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:41:06.013594 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 865/1748] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:41:05 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 14:41:06.014720 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e958b94-133c-4ce6-9208-23de6ca47917 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:06.015017 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e958b94-133c-4ce6-9208-23de6ca47917 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:06.015300 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e958b94-133c-4ce6-9208-23de6ca47917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:06.045758 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-6e958b94-133c-4ce6-9208-23de6ca47917 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:41:06.047258 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-6e958b94-133c-4ce6-9208-23de6ca47917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:41:06.069981 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 866/1749] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:41:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:41:06.076862 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a789e9-b864-459b-a306-ae1398c91d04 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:06.079675 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e958b94-133c-4ce6-9208-23de6ca47917 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:06.084921 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-6e958b94-133c-4ce6-9208-23de6ca47917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:41:06.086604 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:41:06.088659 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e706a0f5-1bb7-44bd-b235-89d3ddbf52c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:06.089549 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e706a0f5-1bb7-44bd-b235-89d3ddbf52c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:06.089839 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e706a0f5-1bb7-44bd-b235-89d3ddbf52c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:06.090118 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e706a0f5-1bb7-44bd-b235-89d3ddbf52c1 admin admin] PATH_INFO: `/v3/projects/6a377f4b17534c0ea7e77c9128335739` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:06.091402 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e706a0f5-1bb7-44bd-b235-89d3ddbf52c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a377f4b17534c0ea7e77c9128335739)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:06.093750 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e706a0f5-1bb7-44bd-b235-89d3ddbf52c1 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:06.185733 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e958b94-133c-4ce6-9208-23de6ca47917 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:06.190288 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8226dd-11b6-4117-8ffb-62ab2d974229 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dda603ec5517460a83c333db2af804d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:06.191676 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8226dd-11b6-4117-8ffb-62ab2d974229 service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:06.191676 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8226dd-11b6-4117-8ffb-62ab2d974229 service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:06.191676 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8226dd-11b6-4117-8ffb-62ab2d974229 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:06.203389 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8226dd-11b6-4117-8ffb-62ab2d974229 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:06.204927 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8226dd-11b6-4117-8ffb-62ab2d974229 service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:06.221894 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 867/1750] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:41:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:41:06.253380 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa6e05d-f434-4218-b223-3d9915e54642 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:06.253921 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa6e05d-f434-4218-b223-3d9915e54642 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:06.254205 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa6e05d-f434-4218-b223-3d9915e54642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:06.275989 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-2aa6e05d-f434-4218-b223-3d9915e54642 None None] MFA Rules not processed for user `bd70563183ab43d68df41f1be27cadc3`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:41:06.278312 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-2aa6e05d-f434-4218-b223-3d9915e54642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:41:06.296983 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-e706a0f5-1bb7-44bd-b235-89d3ddbf52c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a377f4b17534c0ea7e77c9128335739', 'request_id': 'req-e706a0f5-1bb7-44bd-b235-89d3ddbf52c1'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:06.308258 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-e706a0f5-1bb7-44bd-b235-89d3ddbf52c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a377f4b17534c0ea7e77c9128335739', 'request_id': 'req-e706a0f5-1bb7-44bd-b235-89d3ddbf52c1'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:06.359530 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 868/1751] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:41:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:41:06.448039 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-e706a0f5-1bb7-44bd-b235-89d3ddbf52c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a377f4b17534c0ea7e77c9128335739', 'request_id': 'req-e706a0f5-1bb7-44bd-b235-89d3ddbf52c1'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:06.461601 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-e706a0f5-1bb7-44bd-b235-89d3ddbf52c1 admin admin] The token cache is being invalidate because project 6a377f4b17534c0ea7e77c9128335739 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:41:06.461905 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-e706a0f5-1bb7-44bd-b235-89d3ddbf52c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:06.462743 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-e706a0f5-1bb7-44bd-b235-89d3ddbf52c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:06.464612 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 884/1752] 10.222.0.86 () {58 vars in 1232 bytes} [Tue Jun 7 14:41:05 2022] DELETE /identity/v3/projects/6a377f4b17534c0ea7e77c9128335739 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:41:06.468819 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa6e05d-f434-4218-b223-3d9915e54642 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:06.558213 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa6e05d-f434-4218-b223-3d9915e54642 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:06.565631 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6086eed-1b8f-4a29-8be7-7ea247b5d436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:06.566714 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6086eed-1b8f-4a29-8be7-7ea247b5d436 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:06.567006 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6086eed-1b8f-4a29-8be7-7ea247b5d436 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:06.567283 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6086eed-1b8f-4a29-8be7-7ea247b5d436 admin admin] PATH_INFO: `/v3/users/9c55fbddf1d441aca800f1c5238288ac` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:06.568547 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6086eed-1b8f-4a29-8be7-7ea247b5d436 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c55fbddf1d441aca800f1c5238288ac)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:06.570473 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6086eed-1b8f-4a29-8be7-7ea247b5d436 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:06.878800 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-d6086eed-1b8f-4a29-8be7-7ea247b5d436 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c55fbddf1d441aca800f1c5238288ac'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:06.894636 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-d6086eed-1b8f-4a29-8be7-7ea247b5d436 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c55fbddf1d441aca800f1c5238288ac'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:06.895663 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-d6086eed-1b8f-4a29-8be7-7ea247b5d436 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c55fbddf1d441aca800f1c5238288ac'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:06.915878 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-d6086eed-1b8f-4a29-8be7-7ea247b5d436 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c55fbddf1d441aca800f1c5238288ac'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:06.917625 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-d6086eed-1b8f-4a29-8be7-7ea247b5d436 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c55fbddf1d441aca800f1c5238288ac'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:07.032337 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 869/1753] 10.222.0.86 () {58 vars in 1223 bytes} [Tue Jun 7 14:41:06 2022] DELETE /identity/v3/users/9c55fbddf1d441aca800f1c5238288ac => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:41:07.038839 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e706a0f5-1bb7-44bd-b235-89d3ddbf52c1 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:07.046728 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-e706a0f5-1bb7-44bd-b235-89d3ddbf52c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:41:07.140513 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e706a0f5-1bb7-44bd-b235-89d3ddbf52c1 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:07.287167 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3713c1a6-633c-4bc8-9ca4-9c2ab002debc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:07.287167 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3713c1a6-633c-4bc8-9ca4-9c2ab002debc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:07.287167 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3713c1a6-633c-4bc8-9ca4-9c2ab002debc admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:07.287531 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3713c1a6-633c-4bc8-9ca4-9c2ab002debc admin admin] PATH_INFO: `/v3/projects/eed1e4659f5b48879ae3218130023b24` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:07.289084 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3713c1a6-633c-4bc8-9ca4-9c2ab002debc admin admin] RBAC: Authorizing `identity:delete_project(project_id=eed1e4659f5b48879ae3218130023b24)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:07.291960 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3713c1a6-633c-4bc8-9ca4-9c2ab002debc admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:07.508975 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-3713c1a6-633c-4bc8-9ca4-9c2ab002debc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eed1e4659f5b48879ae3218130023b24', 'request_id': 'req-3713c1a6-633c-4bc8-9ca4-9c2ab002debc'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:07.523036 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-3713c1a6-633c-4bc8-9ca4-9c2ab002debc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eed1e4659f5b48879ae3218130023b24', 'request_id': 'req-3713c1a6-633c-4bc8-9ca4-9c2ab002debc'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:07.524595 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:41:07.624006 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-3713c1a6-633c-4bc8-9ca4-9c2ab002debc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eed1e4659f5b48879ae3218130023b24', 'request_id': 'req-3713c1a6-633c-4bc8-9ca4-9c2ab002debc'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:07.642270 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-3713c1a6-633c-4bc8-9ca4-9c2ab002debc admin admin] The token cache is being invalidate because project eed1e4659f5b48879ae3218130023b24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:41:07.642890 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-3713c1a6-633c-4bc8-9ca4-9c2ab002debc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:07.648335 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-3713c1a6-633c-4bc8-9ca4-9c2ab002debc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:07.650641 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 885/1754] 10.222.0.86 () {58 vars in 1232 bytes} [Tue Jun 7 14:41:07 2022] DELETE /identity/v3/projects/eed1e4659f5b48879ae3218130023b24 => generated 0 bytes in 613 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:41:07.655036 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6086eed-1b8f-4a29-8be7-7ea247b5d436 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:07.656672 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-d6086eed-1b8f-4a29-8be7-7ea247b5d436 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:41:07.681346 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6086eed-1b8f-4a29-8be7-7ea247b5d436 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:07.881896 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3182a592-41d0-46b1-8cf8-ee09c6f6ebe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:07.884261 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3182a592-41d0-46b1-8cf8-ee09c6f6ebe3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:07.887669 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3182a592-41d0-46b1-8cf8-ee09c6f6ebe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:07.887669 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3182a592-41d0-46b1-8cf8-ee09c6f6ebe3 admin admin] PATH_INFO: `/v3/users/28c8ce3efbaf4341950348a2130e46a9` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:07.887936 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3182a592-41d0-46b1-8cf8-ee09c6f6ebe3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28c8ce3efbaf4341950348a2130e46a9)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:07.891087 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3182a592-41d0-46b1-8cf8-ee09c6f6ebe3 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:08.243928 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-3182a592-41d0-46b1-8cf8-ee09c6f6ebe3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28c8ce3efbaf4341950348a2130e46a9'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:08.253212 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-3182a592-41d0-46b1-8cf8-ee09c6f6ebe3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28c8ce3efbaf4341950348a2130e46a9'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:08.254689 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-3182a592-41d0-46b1-8cf8-ee09c6f6ebe3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28c8ce3efbaf4341950348a2130e46a9'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:08.270731 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-3182a592-41d0-46b1-8cf8-ee09c6f6ebe3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28c8ce3efbaf4341950348a2130e46a9'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:08.271475 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-3182a592-41d0-46b1-8cf8-ee09c6f6ebe3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28c8ce3efbaf4341950348a2130e46a9'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:08.442621 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 870/1755] 10.222.0.86 () {58 vars in 1223 bytes} [Tue Jun 7 14:41:07 2022] DELETE /identity/v3/users/28c8ce3efbaf4341950348a2130e46a9 => generated 0 bytes in 788 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:41:08.547254 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3713c1a6-633c-4bc8-9ca4-9c2ab002debc admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:08.549458 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-3713c1a6-633c-4bc8-9ca4-9c2ab002debc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:41:08.568638 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3713c1a6-633c-4bc8-9ca4-9c2ab002debc admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:08.658966 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bdf551-3a4d-4eaf-b051-669e21424f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:08.660728 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bdf551-3a4d-4eaf-b051-669e21424f2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:08.661175 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bdf551-3a4d-4eaf-b051-669e21424f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:08.661660 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bdf551-3a4d-4eaf-b051-669e21424f2f admin admin] PATH_INFO: `/v3/projects/9de1970058f14fc8a51a4f991b13d2ee` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:08.663137 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bdf551-3a4d-4eaf-b051-669e21424f2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9de1970058f14fc8a51a4f991b13d2ee)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:08.666100 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bdf551-3a4d-4eaf-b051-669e21424f2f admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:08.813428 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-b2bdf551-3a4d-4eaf-b051-669e21424f2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9de1970058f14fc8a51a4f991b13d2ee', 'request_id': 'req-b2bdf551-3a4d-4eaf-b051-669e21424f2f'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:08.825654 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-b2bdf551-3a4d-4eaf-b051-669e21424f2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9de1970058f14fc8a51a4f991b13d2ee', 'request_id': 'req-b2bdf551-3a4d-4eaf-b051-669e21424f2f'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:08.928362 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-b2bdf551-3a4d-4eaf-b051-669e21424f2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9de1970058f14fc8a51a4f991b13d2ee', 'request_id': 'req-b2bdf551-3a4d-4eaf-b051-669e21424f2f'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:08.947852 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-b2bdf551-3a4d-4eaf-b051-669e21424f2f admin admin] The token cache is being invalidate because project 9de1970058f14fc8a51a4f991b13d2ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:41:08.948914 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-b2bdf551-3a4d-4eaf-b051-669e21424f2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:08.949889 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-b2bdf551-3a4d-4eaf-b051-669e21424f2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:08.952746 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 886/1756] 10.222.0.86 () {58 vars in 1232 bytes} [Tue Jun 7 14:41:08 2022] DELETE /identity/v3/projects/9de1970058f14fc8a51a4f991b13d2ee => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:41:08.958143 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ce794c-2a8d-46c6-8aef-88dfd5fe3367 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:08.961540 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ce794c-2a8d-46c6-8aef-88dfd5fe3367 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:08.962060 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ce794c-2a8d-46c6-8aef-88dfd5fe3367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:08.989911 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-f2ce794c-2a8d-46c6-8aef-88dfd5fe3367 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:41:08.991996 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-f2ce794c-2a8d-46c6-8aef-88dfd5fe3367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:41:09.129911 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1b4f52-7604-4862-9aaa-dd4c8267ca7c None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:09.130306 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1b4f52-7604-4862-9aaa-dd4c8267ca7c None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:09.130524 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1b4f52-7604-4862-9aaa-dd4c8267ca7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:09.143261 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 871/1757] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:41:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:41:09.169613 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-2e1b4f52-7604-4862-9aaa-dd4c8267ca7c None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:41:09.171022 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-2e1b4f52-7604-4862-9aaa-dd4c8267ca7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:41:09.181867 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 887/1758] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:41:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 14:41:09.185392 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ce794c-2a8d-46c6-8aef-88dfd5fe3367 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:09.199330 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ce794c-2a8d-46c6-8aef-88dfd5fe3367 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:09.232132 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f08e44-098c-48e4-8651-555ea516252b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:09.232132 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f08e44-098c-48e4-8651-555ea516252b admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:09.232132 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f08e44-098c-48e4-8651-555ea516252b admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:09.232132 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f08e44-098c-48e4-8651-555ea516252b admin admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:09.236543 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f08e44-098c-48e4-8651-555ea516252b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:41:09.237143 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f08e44-098c-48e4-8651-555ea516252b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:09.252746 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f08e44-098c-48e4-8651-555ea516252b admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:09.292519 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 872/1759] 10.222.0.86 () {58 vars in 1152 bytes} [Tue Jun 7 14:41:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:41:09.297161 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1b4f52-7604-4862-9aaa-dd4c8267ca7c None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:09.309513 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1b4f52-7604-4862-9aaa-dd4c8267ca7c None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:09.316618 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17efbc13-8652-4c16-bac1-a0d2c1fd14ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:09.318061 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17efbc13-8652-4c16-bac1-a0d2c1fd14ea admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:09.318413 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17efbc13-8652-4c16-bac1-a0d2c1fd14ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:09.318707 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17efbc13-8652-4c16-bac1-a0d2c1fd14ea admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:09.319463 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17efbc13-8652-4c16-bac1-a0d2c1fd14ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:09.322152 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17efbc13-8652-4c16-bac1-a0d2c1fd14ea admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:09.435639 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 888/1760] 10.222.0.86 () {60 vars in 1152 bytes} [Tue Jun 7 14:41:09 2022] POST /identity/v3/projects => generated 385 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:41:09.437476 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f08e44-098c-48e4-8651-555ea516252b admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:09.452938 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f08e44-098c-48e4-8651-555ea516252b admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:09.470931 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949792dc-fb65-48f2-b089-4336a8da69bf None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:09.471234 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949792dc-fb65-48f2-b089-4336a8da69bf None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:09.471521 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949792dc-fb65-48f2-b089-4336a8da69bf None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:09.472938 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 889/1761] 10.222.0.86 () {54 vars in 921 bytes} [Tue Jun 7 14:41:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 07 14:41:09.485029 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85beefd3-dd52-4ffb-9817-6e1d3ef13f48 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:09.485331 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85beefd3-dd52-4ffb-9817-6e1d3ef13f48 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:09.485722 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85beefd3-dd52-4ffb-9817-6e1d3ef13f48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:09.530179 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-85beefd3-dd52-4ffb-9817-6e1d3ef13f48 None None] MFA Rules not processed for user `b99cfb70f54c45c8870369359da20378`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:41:09.532195 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-85beefd3-dd52-4ffb-9817-6e1d3ef13f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:41:09.576466 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a6b553-8f1c-4044-9def-9c6814b07afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:09.577489 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a6b553-8f1c-4044-9def-9c6814b07afb admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:09.587043 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a6b553-8f1c-4044-9def-9c6814b07afb admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:09.587043 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a6b553-8f1c-4044-9def-9c6814b07afb admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:09.587043 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a6b553-8f1c-4044-9def-9c6814b07afb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:09.587043 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a6b553-8f1c-4044-9def-9c6814b07afb admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:09.666075 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 890/1762] 10.222.0.86 () {58 vars in 1018 bytes} [Tue Jun 7 14:41:09 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 14:41:09.718986 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 873/1763] 10.222.0.86 () {60 vars in 1143 bytes} [Tue Jun 7 14:41:09 2022] POST /identity/v3/users => generated 293 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:41:09.739459 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85beefd3-dd52-4ffb-9817-6e1d3ef13f48 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:09.759841 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85beefd3-dd52-4ffb-9817-6e1d3ef13f48 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:09.773515 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe855c3-edb4-4b6f-84bf-ab2b24312c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:09.775012 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe855c3-edb4-4b6f-84bf-ab2b24312c4c admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:09.775305 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe855c3-edb4-4b6f-84bf-ab2b24312c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:09.775579 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe855c3-edb4-4b6f-84bf-ab2b24312c4c admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:09.778410 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe855c3-edb4-4b6f-84bf-ab2b24312c4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:09.780246 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe855c3-edb4-4b6f-84bf-ab2b24312c4c admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:09.815115 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 891/1764] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:41:09 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:41:09.819773 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a6b553-8f1c-4044-9def-9c6814b07afb admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:09.838058 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a6b553-8f1c-4044-9def-9c6814b07afb admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:09.857353 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1d50c5-47d3-4875-8a0c-c09541125d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:09.858681 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1d50c5-47d3-4875-8a0c-c09541125d6f admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:09.859119 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1d50c5-47d3-4875-8a0c-c09541125d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:09.859569 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1d50c5-47d3-4875-8a0c-c09541125d6f admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:09.860363 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1d50c5-47d3-4875-8a0c-c09541125d6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:09.862024 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1d50c5-47d3-4875-8a0c-c09541125d6f admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:09.879900 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 874/1765] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:41:09 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:41:09.910714 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe855c3-edb4-4b6f-84bf-ab2b24312c4c admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:09.910714 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe855c3-edb4-4b6f-84bf-ab2b24312c4c admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:09.910867 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1d50c5-47d3-4875-8a0c-c09541125d6f admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:09.913543 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-fe1d50c5-47d3-4875-8a0c-c09541125d6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:41:09.920081 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dca5790-e5f6-45b6-84c0-b48ad046bedf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:09.922125 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dca5790-e5f6-45b6-84c0-b48ad046bedf admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:09.922599 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dca5790-e5f6-45b6-84c0-b48ad046bedf admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:09.924520 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dca5790-e5f6-45b6-84c0-b48ad046bedf admin admin] PATH_INFO: `/v3/projects/a2db4df84f6f42299c7391a5ccc976ba/users/9b6bee90073e4ccc95eba7e19eab7268/roles/c17acc2a8bb348f59ba7edd22fcf0c47` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:09.955899 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1d50c5-47d3-4875-8a0c-c09541125d6f admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:09.956687 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dca5790-e5f6-45b6-84c0-b48ad046bedf admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2db4df84f6f42299c7391a5ccc976ba, user_id=9b6bee90073e4ccc95eba7e19eab7268, role_id=c17acc2a8bb348f59ba7edd22fcf0c47)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:09.959950 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dca5790-e5f6-45b6-84c0-b48ad046bedf admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:09.962836 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921b65f6-7b14-48ab-b449-8d767e8f4344 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99cfb70f54c45c8870369359da20378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:09.963482 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921b65f6-7b14-48ab-b449-8d767e8f4344 service nova] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:09.963574 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921b65f6-7b14-48ab-b449-8d767e8f4344 service nova] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:09.963813 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921b65f6-7b14-48ab-b449-8d767e8f4344 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:09.973226 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921b65f6-7b14-48ab-b449-8d767e8f4344 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:09.974971 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921b65f6-7b14-48ab-b449-8d767e8f4344 service nova] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:09.987807 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 875/1766] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:41:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 14:41:09.988778 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921b65f6-7b14-48ab-b449-8d767e8f4344 service nova] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:09.990153 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-921b65f6-7b14-48ab-b449-8d767e8f4344 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:41:10.005009 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921b65f6-7b14-48ab-b449-8d767e8f4344 service nova] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:10.009874 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:41:10.010358 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0556ea-2359-4aa6-a05d-8837ad7154a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:10.011312 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0556ea-2359-4aa6-a05d-8837ad7154a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:10.011705 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0556ea-2359-4aa6-a05d-8837ad7154a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:10.012083 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0556ea-2359-4aa6-a05d-8837ad7154a3 admin admin] PATH_INFO: `/v3/projects/c2422ae6c1e8467a9e11e7c44b9ade93` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:10.017355 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0556ea-2359-4aa6-a05d-8837ad7154a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2422ae6c1e8467a9e11e7c44b9ade93)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:10.017355 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0556ea-2359-4aa6-a05d-8837ad7154a3 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:10.083917 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 892/1767] 10.222.0.86 () {60 vars in 1482 bytes} [Tue Jun 7 14:41:09 2022] PUT /identity/v3/projects/a2db4df84f6f42299c7391a5ccc976ba/users/9b6bee90073e4ccc95eba7e19eab7268/roles/c17acc2a8bb348f59ba7edd22fcf0c47 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 14:41:10.085990 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb161de9-1d6e-44ef-b88d-193751e8a5d8 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:10.087041 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb161de9-1d6e-44ef-b88d-193751e8a5d8 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:10.087849 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb161de9-1d6e-44ef-b88d-193751e8a5d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:10.138202 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-cb161de9-1d6e-44ef-b88d-193751e8a5d8 None None] MFA Rules not processed for user `9b6bee90073e4ccc95eba7e19eab7268`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:41:10.146904 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-cb161de9-1d6e-44ef-b88d-193751e8a5d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:41:10.173446 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-1a0556ea-2359-4aa6-a05d-8837ad7154a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2422ae6c1e8467a9e11e7c44b9ade93', 'request_id': 'req-1a0556ea-2359-4aa6-a05d-8837ad7154a3'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:10.192722 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-1a0556ea-2359-4aa6-a05d-8837ad7154a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2422ae6c1e8467a9e11e7c44b9ade93', 'request_id': 'req-1a0556ea-2359-4aa6-a05d-8837ad7154a3'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:10.241713 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:41:10.336902 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 893/1768] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:41:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:41:10.337000 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-1a0556ea-2359-4aa6-a05d-8837ad7154a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2422ae6c1e8467a9e11e7c44b9ade93', 'request_id': 'req-1a0556ea-2359-4aa6-a05d-8837ad7154a3'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:10.338892 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb161de9-1d6e-44ef-b88d-193751e8a5d8 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:10.350044 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-1a0556ea-2359-4aa6-a05d-8837ad7154a3 admin admin] The token cache is being invalidate because project c2422ae6c1e8467a9e11e7c44b9ade93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:41:10.350346 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-1a0556ea-2359-4aa6-a05d-8837ad7154a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:10.351110 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-1a0556ea-2359-4aa6-a05d-8837ad7154a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:10.357982 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 876/1769] 10.222.0.86 () {58 vars in 1232 bytes} [Tue Jun 7 14:41:09 2022] DELETE /identity/v3/projects/c2422ae6c1e8467a9e11e7c44b9ade93 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:41:10.362084 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8888b52-9e1d-48f8-9741-3e4fd85f104c None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:10.362502 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8888b52-9e1d-48f8-9741-3e4fd85f104c None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:10.364943 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8888b52-9e1d-48f8-9741-3e4fd85f104c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:10.429667 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-d8888b52-9e1d-48f8-9741-3e4fd85f104c None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:41:10.431463 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-d8888b52-9e1d-48f8-9741-3e4fd85f104c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:41:10.438659 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb161de9-1d6e-44ef-b88d-193751e8a5d8 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:10.443872 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca125d90-2846-461d-bb97-26957e78168b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:10.455053 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca125d90-2846-461d-bb97-26957e78168b admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:10.455472 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca125d90-2846-461d-bb97-26957e78168b admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:10.456882 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca125d90-2846-461d-bb97-26957e78168b admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:10.458670 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca125d90-2846-461d-bb97-26957e78168b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:10.465078 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca125d90-2846-461d-bb97-26957e78168b admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:10.466138 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 877/1770] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:41:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:41:10.474312 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d01386-63a2-4922-a270-d78f7955b1b8 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:10.474609 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d01386-63a2-4922-a270-d78f7955b1b8 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:10.474893 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d01386-63a2-4922-a270-d78f7955b1b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:10.515663 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-87d01386-63a2-4922-a270-d78f7955b1b8 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:41:10.518750 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-87d01386-63a2-4922-a270-d78f7955b1b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:41:10.548797 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 878/1771] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:41:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 14:41:10.553291 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d01386-63a2-4922-a270-d78f7955b1b8 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:10.565545 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d01386-63a2-4922-a270-d78f7955b1b8 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:10.585207 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d251c02-78b5-47bf-ac29-9159c6e94d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:10.585994 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d251c02-78b5-47bf-ac29-9159c6e94d8b admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:10.587557 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d251c02-78b5-47bf-ac29-9159c6e94d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:10.587938 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d251c02-78b5-47bf-ac29-9159c6e94d8b admin admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:10.588699 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d251c02-78b5-47bf-ac29-9159c6e94d8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:41:10.589034 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d251c02-78b5-47bf-ac29-9159c6e94d8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:10.590885 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d251c02-78b5-47bf-ac29-9159c6e94d8b admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:10.612953 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 879/1772] 10.222.0.86 () {58 vars in 1152 bytes} [Tue Jun 7 14:41:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:41:10.617316 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d251c02-78b5-47bf-ac29-9159c6e94d8b admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:10.634083 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d251c02-78b5-47bf-ac29-9159c6e94d8b admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:10.638289 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 894/1773] 10.222.0.86 () {60 vars in 1152 bytes} [Tue Jun 7 14:41:10 2022] POST /identity/v3/projects => generated 385 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:41:10.642158 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca125d90-2846-461d-bb97-26957e78168b admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:10.644117 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-ca125d90-2846-461d-bb97-26957e78168b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:41:10.656222 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3f324e-c489-4472-b077-63969819be9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:10.657341 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3f324e-c489-4472-b077-63969819be9d admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:10.657684 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3f324e-c489-4472-b077-63969819be9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:10.657899 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3f324e-c489-4472-b077-63969819be9d admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:10.658621 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3f324e-c489-4472-b077-63969819be9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:10.660569 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3f324e-c489-4472-b077-63969819be9d admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:10.727863 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca125d90-2846-461d-bb97-26957e78168b admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:10.733707 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4930815-e73e-48b6-acf4-db3ff5d41f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:10.734498 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4930815-e73e-48b6-acf4-db3ff5d41f3d admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:10.734788 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4930815-e73e-48b6-acf4-db3ff5d41f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:10.735068 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4930815-e73e-48b6-acf4-db3ff5d41f3d admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:10.735960 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4930815-e73e-48b6-acf4-db3ff5d41f3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:10.741343 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4930815-e73e-48b6-acf4-db3ff5d41f3d admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:10.835694 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 880/1774] 10.222.0.86 () {60 vars in 1152 bytes} [Tue Jun 7 14:41:10 2022] POST /identity/v3/projects => generated 375 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 14:41:10.847289 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3f324e-c489-4472-b077-63969819be9d admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:10.869464 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 895/1775] 10.222.0.86 () {60 vars in 1143 bytes} [Tue Jun 7 14:41:10 2022] POST /identity/v3/users => generated 293 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 14:41:10.870592 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4930815-e73e-48b6-acf4-db3ff5d41f3d admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:10.889674 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4930815-e73e-48b6-acf4-db3ff5d41f3d admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:11.009716 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9b3e22-37a4-4c32-80a1-3c256d12a3d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:11.012157 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9b3e22-37a4-4c32-80a1-3c256d12a3d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:11.012515 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9b3e22-37a4-4c32-80a1-3c256d12a3d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:11.012806 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9b3e22-37a4-4c32-80a1-3c256d12a3d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:11.013623 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9b3e22-37a4-4c32-80a1-3c256d12a3d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:11.015919 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9b3e22-37a4-4c32-80a1-3c256d12a3d1 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:11.061882 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 896/1776] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:41:10 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:41:11.062388 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9b3e22-37a4-4c32-80a1-3c256d12a3d1 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:11.065292 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3f324e-c489-4472-b077-63969819be9d admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:11.084507 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6ea81b-9849-45a8-97bb-1a2f699e9cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:11.085909 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6ea81b-9849-45a8-97bb-1a2f699e9cdb admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:11.086147 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6ea81b-9849-45a8-97bb-1a2f699e9cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:11.086466 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6ea81b-9849-45a8-97bb-1a2f699e9cdb admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:11.087382 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6ea81b-9849-45a8-97bb-1a2f699e9cdb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:11.093498 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6ea81b-9849-45a8-97bb-1a2f699e9cdb admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:11.101076 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9b3e22-37a4-4c32-80a1-3c256d12a3d1 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:11.111451 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b066c7e-51b9-4bf1-a92d-2eef34fdb694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:11.113168 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b066c7e-51b9-4bf1-a92d-2eef34fdb694 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:11.113448 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b066c7e-51b9-4bf1-a92d-2eef34fdb694 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:11.114995 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b066c7e-51b9-4bf1-a92d-2eef34fdb694 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:11.116991 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b066c7e-51b9-4bf1-a92d-2eef34fdb694 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:11.122700 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b066c7e-51b9-4bf1-a92d-2eef34fdb694 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:11.153506 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 897/1777] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:41:11 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:41:11.154526 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b066c7e-51b9-4bf1-a92d-2eef34fdb694 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:11.172250 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b066c7e-51b9-4bf1-a92d-2eef34fdb694 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:11.177399 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263ec94a-2045-4478-8bd7-3452ae2c97ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:11.178509 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263ec94a-2045-4478-8bd7-3452ae2c97ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:11.178797 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263ec94a-2045-4478-8bd7-3452ae2c97ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:11.179077 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263ec94a-2045-4478-8bd7-3452ae2c97ad admin admin] PATH_INFO: `/v3/projects/6d8987981f584e878a8732e3240fee3d/users/7720d71c4be34576801a831a1ac17fd3/roles/c17acc2a8bb348f59ba7edd22fcf0c47` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:11.204032 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263ec94a-2045-4478-8bd7-3452ae2c97ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d8987981f584e878a8732e3240fee3d, user_id=7720d71c4be34576801a831a1ac17fd3, role_id=c17acc2a8bb348f59ba7edd22fcf0c47)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:11.210050 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263ec94a-2045-4478-8bd7-3452ae2c97ad admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:11.213267 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 881/1778] 10.222.0.86 () {60 vars in 1143 bytes} [Tue Jun 7 14:41:10 2022] POST /identity/v3/users => generated 288 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:41:11.217936 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6ea81b-9849-45a8-97bb-1a2f699e9cdb admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:11.237322 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6ea81b-9849-45a8-97bb-1a2f699e9cdb admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:11.244514 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbc7475-f359-40b9-8a09-e6de85335a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:11.246646 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbc7475-f359-40b9-8a09-e6de85335a3b admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:11.246646 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbc7475-f359-40b9-8a09-e6de85335a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:11.246646 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbc7475-f359-40b9-8a09-e6de85335a3b admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:11.246646 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbc7475-f359-40b9-8a09-e6de85335a3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:11.248696 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbc7475-f359-40b9-8a09-e6de85335a3b admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:11.262939 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 882/1779] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:41:11 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 07 14:41:11.267296 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbc7475-f359-40b9-8a09-e6de85335a3b admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:11.279395 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbc7475-f359-40b9-8a09-e6de85335a3b admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:11.285490 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cbe0dd-2a59-455e-87e1-43949d001c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:11.286184 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cbe0dd-2a59-455e-87e1-43949d001c57 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:11.286474 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cbe0dd-2a59-455e-87e1-43949d001c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:11.286754 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cbe0dd-2a59-455e-87e1-43949d001c57 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:11.287509 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cbe0dd-2a59-455e-87e1-43949d001c57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:11.289178 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cbe0dd-2a59-455e-87e1-43949d001c57 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:11.321565 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 898/1780] 10.222.0.86 () {60 vars in 1482 bytes} [Tue Jun 7 14:41:11 2022] PUT /identity/v3/projects/6d8987981f584e878a8732e3240fee3d/users/7720d71c4be34576801a831a1ac17fd3/roles/c17acc2a8bb348f59ba7edd22fcf0c47 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:41:11.321565 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263ec94a-2045-4478-8bd7-3452ae2c97ad admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:11.329656 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 883/1781] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:41:11 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:41:11.331248 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acec2e57-e0dd-4db2-8c06-b45930531966 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:11.331540 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acec2e57-e0dd-4db2-8c06-b45930531966 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:11.331846 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acec2e57-e0dd-4db2-8c06-b45930531966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:11.376735 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-acec2e57-e0dd-4db2-8c06-b45930531966 None None] MFA Rules not processed for user `7720d71c4be34576801a831a1ac17fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:41:11.378520 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-acec2e57-e0dd-4db2-8c06-b45930531966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:41:11.533730 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263ec94a-2045-4478-8bd7-3452ae2c97ad admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:11.541069 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840452e4-bf25-4e41-bbfc-0b87bcdcf376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:11.545239 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840452e4-bf25-4e41-bbfc-0b87bcdcf376 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:11.545239 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840452e4-bf25-4e41-bbfc-0b87bcdcf376 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:11.545239 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840452e4-bf25-4e41-bbfc-0b87bcdcf376 admin admin] PATH_INFO: `/v3/projects/1b04f1c528a2458ba55cf13f289f4059/users/7fe8ada9d38243d09e2d4afb106cd913/roles/c17acc2a8bb348f59ba7edd22fcf0c47` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:11.567386 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 884/1782] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:41:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:41:11.572877 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acec2e57-e0dd-4db2-8c06-b45930531966 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:11.590907 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840452e4-bf25-4e41-bbfc-0b87bcdcf376 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b04f1c528a2458ba55cf13f289f4059, user_id=7fe8ada9d38243d09e2d4afb106cd913, role_id=c17acc2a8bb348f59ba7edd22fcf0c47)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:11.593653 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840452e4-bf25-4e41-bbfc-0b87bcdcf376 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:11.603902 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acec2e57-e0dd-4db2-8c06-b45930531966 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:11.609490 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135c3104-257d-4248-b587-54c89eba557c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:11.609877 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135c3104-257d-4248-b587-54c89eba557c admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:11.610153 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135c3104-257d-4248-b587-54c89eba557c admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:11.610535 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135c3104-257d-4248-b587-54c89eba557c admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:11.611166 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135c3104-257d-4248-b587-54c89eba557c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:11.613203 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135c3104-257d-4248-b587-54c89eba557c admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:11.682748 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 899/1783] 10.222.0.86 () {60 vars in 1482 bytes} [Tue Jun 7 14:41:11 2022] PUT /identity/v3/projects/1b04f1c528a2458ba55cf13f289f4059/users/7fe8ada9d38243d09e2d4afb106cd913/roles/c17acc2a8bb348f59ba7edd22fcf0c47 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:41:11.693980 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f004b3d-c23b-4ea0-a4e5-5a77c5c4f363 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:11.695583 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f004b3d-c23b-4ea0-a4e5-5a77c5c4f363 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:11.696705 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f004b3d-c23b-4ea0-a4e5-5a77c5c4f363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:11.744673 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 885/1784] 10.222.0.86 () {60 vars in 1152 bytes} [Tue Jun 7 14:41:11 2022] POST /identity/v3/projects => generated 385 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 14:41:11.748590 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-1f004b3d-c23b-4ea0-a4e5-5a77c5c4f363 None None] MFA Rules not processed for user `7fe8ada9d38243d09e2d4afb106cd913`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:41:11.749064 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135c3104-257d-4248-b587-54c89eba557c admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:11.749975 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-1f004b3d-c23b-4ea0-a4e5-5a77c5c4f363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:41:11.842778 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135c3104-257d-4248-b587-54c89eba557c admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:11.850348 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319fe924-2b21-411a-b4bb-3c97fb9051dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:11.851951 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319fe924-2b21-411a-b4bb-3c97fb9051dd admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:11.852244 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319fe924-2b21-411a-b4bb-3c97fb9051dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:11.852528 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319fe924-2b21-411a-b4bb-3c97fb9051dd admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:11.853243 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319fe924-2b21-411a-b4bb-3c97fb9051dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:11.855576 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319fe924-2b21-411a-b4bb-3c97fb9051dd admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:11.881386 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 900/1785] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:41:11 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:41:11.893086 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f004b3d-c23b-4ea0-a4e5-5a77c5c4f363 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:11.895497 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-1f004b3d-c23b-4ea0-a4e5-5a77c5c4f363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:41:11.968410 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 886/1786] 10.222.0.86 () {60 vars in 1143 bytes} [Tue Jun 7 14:41:11 2022] POST /identity/v3/users => generated 299 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:41:11.972514 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319fe924-2b21-411a-b4bb-3c97fb9051dd admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:12.003698 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319fe924-2b21-411a-b4bb-3c97fb9051dd admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:12.017648 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaff37b-324d-49c9-bf9f-f91393825f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:12.029027 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaff37b-324d-49c9-bf9f-f91393825f1e admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:12.029538 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaff37b-324d-49c9-bf9f-f91393825f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:12.029926 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaff37b-324d-49c9-bf9f-f91393825f1e admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:12.030623 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f004b3d-c23b-4ea0-a4e5-5a77c5c4f363 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:12.031630 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaff37b-324d-49c9-bf9f-f91393825f1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:12.035783 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eb239a-733d-4e91-bd76-8aaac4cad106 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af5a95620a4b43538abfe09eed4bf115', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:12.036447 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eb239a-733d-4e91-bd76-8aaac4cad106 service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:12.036789 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eb239a-733d-4e91-bd76-8aaac4cad106 service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:12.036894 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaff37b-324d-49c9-bf9f-f91393825f1e admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:12.037079 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eb239a-733d-4e91-bd76-8aaac4cad106 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:12.052404 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77eb239a-733d-4e91-bd76-8aaac4cad106 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:12.054041 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77eb239a-733d-4e91-bd76-8aaac4cad106 service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:12.068553 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 887/1787] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:41:11 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 07 14:41:12.070339 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaff37b-324d-49c9-bf9f-f91393825f1e admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:12.098657 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaff37b-324d-49c9-bf9f-f91393825f1e admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:12.099383 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 901/1788] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:41:11 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:41:12.136815 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32488de4-4c19-46a1-8647-96b8c9355274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:12.137733 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32488de4-4c19-46a1-8647-96b8c9355274 admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:12.138022 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32488de4-4c19-46a1-8647-96b8c9355274 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:12.138296 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32488de4-4c19-46a1-8647-96b8c9355274 admin admin] PATH_INFO: `/v3/projects/04e5bf7e2cf0456dba5e20228d10994b/users/55576466e6b74050868c7d10ad97e1fd/roles/e3bf6239f5bf477b965704b086786f11` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:12.178303 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32488de4-4c19-46a1-8647-96b8c9355274 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04e5bf7e2cf0456dba5e20228d10994b, user_id=55576466e6b74050868c7d10ad97e1fd, role_id=e3bf6239f5bf477b965704b086786f11)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:12.187142 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32488de4-4c19-46a1-8647-96b8c9355274 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:12.336906 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 888/1789] 10.222.0.86 () {60 vars in 1482 bytes} [Tue Jun 7 14:41:12 2022] PUT /identity/v3/projects/04e5bf7e2cf0456dba5e20228d10994b/users/55576466e6b74050868c7d10ad97e1fd/roles/e3bf6239f5bf477b965704b086786f11 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 14:41:12.341505 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eb239a-733d-4e91-bd76-8aaac4cad106 service cinder] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:12.355907 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eb239a-733d-4e91-bd76-8aaac4cad106 service cinder] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:12.441987 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0997d37-9752-47dc-9951-23565127f212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:12.442656 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0997d37-9752-47dc-9951-23565127f212 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:12.443921 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0997d37-9752-47dc-9951-23565127f212 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:12.443921 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0997d37-9752-47dc-9951-23565127f212 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:12.444549 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0997d37-9752-47dc-9951-23565127f212 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:12.446251 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0997d37-9752-47dc-9951-23565127f212 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:12.462391 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 902/1790] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:41:12 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:41:12.466216 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32488de4-4c19-46a1-8647-96b8c9355274 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:12.477863 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32488de4-4c19-46a1-8647-96b8c9355274 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:12.484383 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a8ee51-e77d-4b63-b46d-33b24d7b63b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:12.491560 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a8ee51-e77d-4b63-b46d-33b24d7b63b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:12.491560 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a8ee51-e77d-4b63-b46d-33b24d7b63b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:12.491560 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a8ee51-e77d-4b63-b46d-33b24d7b63b9 admin admin] PATH_INFO: `/v3/projects/04e5bf7e2cf0456dba5e20228d10994b/users/55576466e6b74050868c7d10ad97e1fd/roles/e3bf6239f5bf477b965704b086786f11` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:12.491560 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a8ee51-e77d-4b63-b46d-33b24d7b63b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04e5bf7e2cf0456dba5e20228d10994b, user_id=55576466e6b74050868c7d10ad97e1fd, role_id=e3bf6239f5bf477b965704b086786f11)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:12.491560 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a8ee51-e77d-4b63-b46d-33b24d7b63b9 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:12.511246 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 889/1791] 10.222.0.86 () {60 vars in 1482 bytes} [Tue Jun 7 14:41:12 2022] PUT /identity/v3/projects/04e5bf7e2cf0456dba5e20228d10994b/users/55576466e6b74050868c7d10ad97e1fd/roles/e3bf6239f5bf477b965704b086786f11 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:41:12.513219 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31801f47-3ebf-4b41-9488-82a2673020d6 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:12.513531 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31801f47-3ebf-4b41-9488-82a2673020d6 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:12.513821 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31801f47-3ebf-4b41-9488-82a2673020d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:12.544212 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-31801f47-3ebf-4b41-9488-82a2673020d6 None None] MFA Rules not processed for user `55576466e6b74050868c7d10ad97e1fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:41:12.545462 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-31801f47-3ebf-4b41-9488-82a2673020d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:41:12.642732 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 903/1792] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:41:12 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 14:41:12.654437 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a8ee51-e77d-4b63-b46d-33b24d7b63b9 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:12.656191 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-89a8ee51-e77d-4b63-b46d-33b24d7b63b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:41:12.668040 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:41:12.738306 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a8ee51-e77d-4b63-b46d-33b24d7b63b9 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:12.751283 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b6d8f8-e046-4f2e-9a18-9f283ce8f801 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af5a95620a4b43538abfe09eed4bf115', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:12.751283 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b6d8f8-e046-4f2e-9a18-9f283ce8f801 service cinder] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:12.751283 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b6d8f8-e046-4f2e-9a18-9f283ce8f801 service cinder] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:12.751283 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b6d8f8-e046-4f2e-9a18-9f283ce8f801 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:12.765182 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b6d8f8-e046-4f2e-9a18-9f283ce8f801 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:12.767253 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b6d8f8-e046-4f2e-9a18-9f283ce8f801 service cinder] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:12.784554 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 890/1793] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:41:12 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:41:13.452513 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b14c48-a364-4b29-b0a0-3c9735723117 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:13.452984 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b14c48-a364-4b29-b0a0-3c9735723117 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:13.453059 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b14c48-a364-4b29-b0a0-3c9735723117 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:13.460471 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 904/1794] 10.222.0.86 () {54 vars in 921 bytes} [Tue Jun 7 14:41:13 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:41:13.566919 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9870a690-05be-4759-a6dc-21aea3ff524b None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:13.567465 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9870a690-05be-4759-a6dc-21aea3ff524b None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:13.567908 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9870a690-05be-4759-a6dc-21aea3ff524b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:13.605119 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-9870a690-05be-4759-a6dc-21aea3ff524b None None] MFA Rules not processed for user `b99cfb70f54c45c8870369359da20378`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:41:13.606340 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-9870a690-05be-4759-a6dc-21aea3ff524b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:41:13.731675 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:41:13.769083 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 891/1795] 10.222.0.86 () {58 vars in 1018 bytes} [Tue Jun 7 14:41:13 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:41:14.025343 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b14c48-a364-4b29-b0a0-3c9735723117 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:14.027651 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-f5b14c48-a364-4b29-b0a0-3c9735723117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:41:14.056527 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b14c48-a364-4b29-b0a0-3c9735723117 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:14.066138 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d7d71b-fb39-425d-8ca6-6818b622c216 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99cfb70f54c45c8870369359da20378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:14.068012 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d7d71b-fb39-425d-8ca6-6818b622c216 service nova] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:14.068491 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d7d71b-fb39-425d-8ca6-6818b622c216 service nova] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:14.068785 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d7d71b-fb39-425d-8ca6-6818b622c216 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:14.081102 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d7d71b-fb39-425d-8ca6-6818b622c216 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:14.082931 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d7d71b-fb39-425d-8ca6-6818b622c216 service nova] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:14.099819 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 905/1796] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:41:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:41:14.489692 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9870a690-05be-4759-a6dc-21aea3ff524b None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:14.505372 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9870a690-05be-4759-a6dc-21aea3ff524b None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:14.511959 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cffad72-afbb-4e6e-8b73-d609c61fc889 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af5a95620a4b43538abfe09eed4bf115', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:14.512993 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cffad72-afbb-4e6e-8b73-d609c61fc889 service cinder] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:14.513603 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cffad72-afbb-4e6e-8b73-d609c61fc889 service cinder] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:14.514177 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cffad72-afbb-4e6e-8b73-d609c61fc889 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:14.516395 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-5cffad72-afbb-4e6e-8b73-d609c61fc889 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:41:14.725495 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cffad72-afbb-4e6e-8b73-d609c61fc889 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:14.743384 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cffad72-afbb-4e6e-8b73-d609c61fc889 service cinder] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:14.758181 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 892/1797] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:41:14 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:41:15.175833 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:41:15.847359 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:41:17.541498 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:41:17.903065 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:41:18.009720 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d7d71b-fb39-425d-8ca6-6818b622c216 service nova] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:18.091132 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d7d71b-fb39-425d-8ca6-6818b622c216 service nova] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:18.109333 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff643307-425b-4020-b140-422c4418e235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:18.111005 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff643307-425b-4020-b140-422c4418e235 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:18.111300 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff643307-425b-4020-b140-422c4418e235 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:18.111602 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff643307-425b-4020-b140-422c4418e235 admin admin] PATH_INFO: `/v3/users/7fe8ada9d38243d09e2d4afb106cd913` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:18.112972 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff643307-425b-4020-b140-422c4418e235 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fe8ada9d38243d09e2d4afb106cd913)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:18.114925 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff643307-425b-4020-b140-422c4418e235 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:18.402041 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-ff643307-425b-4020-b140-422c4418e235 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fe8ada9d38243d09e2d4afb106cd913'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:18.415986 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-ff643307-425b-4020-b140-422c4418e235 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fe8ada9d38243d09e2d4afb106cd913'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:18.422945 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-ff643307-425b-4020-b140-422c4418e235 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fe8ada9d38243d09e2d4afb106cd913'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:18.443866 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-ff643307-425b-4020-b140-422c4418e235 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fe8ada9d38243d09e2d4afb106cd913'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:18.445184 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-ff643307-425b-4020-b140-422c4418e235 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fe8ada9d38243d09e2d4afb106cd913'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:18.589630 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 906/1798] 10.222.0.86 () {58 vars in 1223 bytes} [Tue Jun 7 14:41:18 2022] DELETE /identity/v3/users/7fe8ada9d38243d09e2d4afb106cd913 => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:41:18.594063 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a4c0d7-1703-4765-85f5-984c98e20a64 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:18.594516 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a4c0d7-1703-4765-85f5-984c98e20a64 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:18.594838 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a4c0d7-1703-4765-85f5-984c98e20a64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:18.613706 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-c2a4c0d7-1703-4765-85f5-984c98e20a64 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:41:18.621605 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-c2a4c0d7-1703-4765-85f5-984c98e20a64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:41:18.676937 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 893/1799] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:41:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 14:41:18.686842 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff643307-425b-4020-b140-422c4418e235 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:18.688371 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-ff643307-425b-4020-b140-422c4418e235 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:41:18.745825 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff643307-425b-4020-b140-422c4418e235 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:18.749397 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811633bb-7564-4360-9068-19d2b11dc8e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dda603ec5517460a83c333db2af804d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:18.750063 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811633bb-7564-4360-9068-19d2b11dc8e1 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:18.750351 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811633bb-7564-4360-9068-19d2b11dc8e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:18.750630 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811633bb-7564-4360-9068-19d2b11dc8e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:18.761616 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811633bb-7564-4360-9068-19d2b11dc8e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:18.763093 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811633bb-7564-4360-9068-19d2b11dc8e1 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:18.774818 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 907/1800] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:41:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:41:19.149401 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:41:19.230415 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a4c0d7-1703-4765-85f5-984c98e20a64 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:19.232191 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-c2a4c0d7-1703-4765-85f5-984c98e20a64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:41:19.246797 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a4c0d7-1703-4765-85f5-984c98e20a64 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:19.260327 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88c54a9-15c9-4b18-a3a7-35398c30dccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:19.265702 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88c54a9-15c9-4b18-a3a7-35398c30dccf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:19.265702 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88c54a9-15c9-4b18-a3a7-35398c30dccf admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:19.265702 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88c54a9-15c9-4b18-a3a7-35398c30dccf admin admin] PATH_INFO: `/v3/projects/1b04f1c528a2458ba55cf13f289f4059` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:19.265702 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88c54a9-15c9-4b18-a3a7-35398c30dccf admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b04f1c528a2458ba55cf13f289f4059)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:19.265702 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88c54a9-15c9-4b18-a3a7-35398c30dccf admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:19.444444 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-e88c54a9-15c9-4b18-a3a7-35398c30dccf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b04f1c528a2458ba55cf13f289f4059', 'request_id': 'req-e88c54a9-15c9-4b18-a3a7-35398c30dccf'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:19.447441 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-e88c54a9-15c9-4b18-a3a7-35398c30dccf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b04f1c528a2458ba55cf13f289f4059', 'request_id': 'req-e88c54a9-15c9-4b18-a3a7-35398c30dccf'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:19.569531 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-e88c54a9-15c9-4b18-a3a7-35398c30dccf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b04f1c528a2458ba55cf13f289f4059', 'request_id': 'req-e88c54a9-15c9-4b18-a3a7-35398c30dccf'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:19.581293 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-e88c54a9-15c9-4b18-a3a7-35398c30dccf admin admin] The token cache is being invalidate because project 1b04f1c528a2458ba55cf13f289f4059 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:41:19.581604 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-e88c54a9-15c9-4b18-a3a7-35398c30dccf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:19.582427 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-e88c54a9-15c9-4b18-a3a7-35398c30dccf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:19.584523 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 894/1801] 10.222.0.86 () {58 vars in 1232 bytes} [Tue Jun 7 14:41:19 2022] DELETE /identity/v3/projects/1b04f1c528a2458ba55cf13f289f4059 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:41:19.589510 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c753c4b-3edd-45ce-937f-aed67fa7a384 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:19.589963 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c753c4b-3edd-45ce-937f-aed67fa7a384 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:19.590072 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c753c4b-3edd-45ce-937f-aed67fa7a384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:19.608963 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-8c753c4b-3edd-45ce-937f-aed67fa7a384 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:41:19.610266 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-8c753c4b-3edd-45ce-937f-aed67fa7a384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:41:19.686148 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 908/1802] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:41:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:41:19.693798 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91d6cdd-b4fe-416c-a6cc-5685c9cc092f None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:19.694317 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91d6cdd-b4fe-416c-a6cc-5685c9cc092f None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:19.694397 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91d6cdd-b4fe-416c-a6cc-5685c9cc092f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:19.721460 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-b91d6cdd-b4fe-416c-a6cc-5685c9cc092f None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:41:19.722899 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-b91d6cdd-b4fe-416c-a6cc-5685c9cc092f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:41:19.736015 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 895/1803] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:41:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:41:19.740121 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c753c4b-3edd-45ce-937f-aed67fa7a384 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:19.750251 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c753c4b-3edd-45ce-937f-aed67fa7a384 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:19.755184 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde8344e-955d-4453-b15f-46007ffc874c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:19.755885 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde8344e-955d-4453-b15f-46007ffc874c admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:19.756178 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde8344e-955d-4453-b15f-46007ffc874c admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:19.756493 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde8344e-955d-4453-b15f-46007ffc874c admin admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:19.757631 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde8344e-955d-4453-b15f-46007ffc874c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:41:19.758481 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde8344e-955d-4453-b15f-46007ffc874c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:19.762800 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde8344e-955d-4453-b15f-46007ffc874c admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:19.778863 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 909/1804] 10.222.0.86 () {58 vars in 1152 bytes} [Tue Jun 7 14:41:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:41:19.779963 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91d6cdd-b4fe-416c-a6cc-5685c9cc092f None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:19.790764 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91d6cdd-b4fe-416c-a6cc-5685c9cc092f None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:19.795808 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c143c23a-16be-4c34-a507-fe1f42050b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:19.796470 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c143c23a-16be-4c34-a507-fe1f42050b98 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:19.796762 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c143c23a-16be-4c34-a507-fe1f42050b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:19.797046 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c143c23a-16be-4c34-a507-fe1f42050b98 admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:19.797768 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c143c23a-16be-4c34-a507-fe1f42050b98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:19.799662 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c143c23a-16be-4c34-a507-fe1f42050b98 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:19.887073 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 896/1805] 10.222.0.86 () {60 vars in 1152 bytes} [Tue Jun 7 14:41:19 2022] POST /identity/v3/projects => generated 369 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 14:41:19.891306 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde8344e-955d-4453-b15f-46007ffc874c admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:19.902452 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde8344e-955d-4453-b15f-46007ffc874c admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:19.956893 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308d8f33-7f62-4891-b620-12720587b81d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:19.957558 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308d8f33-7f62-4891-b620-12720587b81d admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:19.957847 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308d8f33-7f62-4891-b620-12720587b81d admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:19.958147 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308d8f33-7f62-4891-b620-12720587b81d admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:19.958876 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308d8f33-7f62-4891-b620-12720587b81d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:19.961339 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308d8f33-7f62-4891-b620-12720587b81d admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:20.055560 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 910/1806] 10.222.0.86 () {60 vars in 1143 bytes} [Tue Jun 7 14:41:19 2022] POST /identity/v3/users => generated 285 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:41:20.057040 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c143c23a-16be-4c34-a507-fe1f42050b98 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:20.067676 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c143c23a-16be-4c34-a507-fe1f42050b98 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:20.072574 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b5c9ad-643d-4e9c-b7a3-abf9b0447803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:20.073274 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b5c9ad-643d-4e9c-b7a3-abf9b0447803 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:20.073591 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b5c9ad-643d-4e9c-b7a3-abf9b0447803 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:20.073875 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b5c9ad-643d-4e9c-b7a3-abf9b0447803 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:20.074758 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b5c9ad-643d-4e9c-b7a3-abf9b0447803 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:20.076396 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b5c9ad-643d-4e9c-b7a3-abf9b0447803 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:20.097322 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 897/1807] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:41:20 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:41:20.097877 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308d8f33-7f62-4891-b620-12720587b81d admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:20.113729 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308d8f33-7f62-4891-b620-12720587b81d admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:20.121340 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b6d464-fdd8-4dfb-85f8-f904323b7ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:20.122004 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b6d464-fdd8-4dfb-85f8-f904323b7ffe admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:20.122384 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b6d464-fdd8-4dfb-85f8-f904323b7ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:20.122797 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b6d464-fdd8-4dfb-85f8-f904323b7ffe admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:20.127687 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b6d464-fdd8-4dfb-85f8-f904323b7ffe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:20.127687 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b6d464-fdd8-4dfb-85f8-f904323b7ffe admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:20.145933 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 911/1808] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:41:20 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 07 14:41:20.147458 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b5c9ad-643d-4e9c-b7a3-abf9b0447803 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:20.160954 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b5c9ad-643d-4e9c-b7a3-abf9b0447803 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:20.175030 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51ee8b5-ea96-4d3d-a8d5-e882381c909a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:20.176201 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51ee8b5-ea96-4d3d-a8d5-e882381c909a admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:20.176641 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51ee8b5-ea96-4d3d-a8d5-e882381c909a admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:20.177170 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51ee8b5-ea96-4d3d-a8d5-e882381c909a admin admin] PATH_INFO: `/v3/projects/67c34e5bb0a244378a367755ae3d20ea/users/b69af0cf7bfd49f18d0a20cbd16d31a9/roles/c17acc2a8bb348f59ba7edd22fcf0c47` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:20.197295 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51ee8b5-ea96-4d3d-a8d5-e882381c909a admin admin] RBAC: Authorizing `identity:create_grant(project_id=67c34e5bb0a244378a367755ae3d20ea, user_id=b69af0cf7bfd49f18d0a20cbd16d31a9, role_id=c17acc2a8bb348f59ba7edd22fcf0c47)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:20.200081 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51ee8b5-ea96-4d3d-a8d5-e882381c909a admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:20.318863 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 898/1809] 10.222.0.86 () {60 vars in 1482 bytes} [Tue Jun 7 14:41:20 2022] PUT /identity/v3/projects/67c34e5bb0a244378a367755ae3d20ea/users/b69af0cf7bfd49f18d0a20cbd16d31a9/roles/c17acc2a8bb348f59ba7edd22fcf0c47 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:41:20.330875 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b94de4e-9e89-4208-bb9e-0d93fc9fe817 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:20.331168 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b94de4e-9e89-4208-bb9e-0d93fc9fe817 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:20.331479 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b94de4e-9e89-4208-bb9e-0d93fc9fe817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:20.359111 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-2b94de4e-9e89-4208-bb9e-0d93fc9fe817 None None] MFA Rules not processed for user `b69af0cf7bfd49f18d0a20cbd16d31a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:41:20.360352 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-2b94de4e-9e89-4208-bb9e-0d93fc9fe817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:41:20.433944 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 912/1810] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:41:20 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:41:20.446582 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51ee8b5-ea96-4d3d-a8d5-e882381c909a admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:20.448861 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-f51ee8b5-ea96-4d3d-a8d5-e882381c909a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:41:20.532604 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51ee8b5-ea96-4d3d-a8d5-e882381c909a admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:20.537321 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9c8c33-021c-47bb-b740-9c67caf2a03e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b910435e5585436996ba5b5aeb7184bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:20.538036 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9c8c33-021c-47bb-b740-9c67caf2a03e service glance] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:20.538328 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9c8c33-021c-47bb-b740-9c67caf2a03e service glance] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:20.538664 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9c8c33-021c-47bb-b740-9c67caf2a03e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:20.548891 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9c8c33-021c-47bb-b740-9c67caf2a03e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:20.550370 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9c8c33-021c-47bb-b740-9c67caf2a03e service glance] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:20.560411 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 899/1811] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:41:20 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 14:41:21.344409 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:41:21.765868 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:41:22.489758 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b94de4e-9e89-4208-bb9e-0d93fc9fe817 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:22.491264 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-2b94de4e-9e89-4208-bb9e-0d93fc9fe817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:41:22.551340 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b94de4e-9e89-4208-bb9e-0d93fc9fe817 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:22.555800 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1d281a-7606-48bd-86f4-1ff28b7fd2fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af5a95620a4b43538abfe09eed4bf115', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:22.556673 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1d281a-7606-48bd-86f4-1ff28b7fd2fa service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:22.556956 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1d281a-7606-48bd-86f4-1ff28b7fd2fa service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:22.557226 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1d281a-7606-48bd-86f4-1ff28b7fd2fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:22.559099 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-7b1d281a-7606-48bd-86f4-1ff28b7fd2fa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:41:22.639981 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1d281a-7606-48bd-86f4-1ff28b7fd2fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:22.641483 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1d281a-7606-48bd-86f4-1ff28b7fd2fa service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:22.660231 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 913/1812] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:41:22 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:41:24.303980 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:41:27.097426 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:41:28.199943 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9c8c33-021c-47bb-b740-9c67caf2a03e service glance] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:28.201954 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-6f9c8c33-021c-47bb-b740-9c67caf2a03e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:41:28.263531 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:41:28.287425 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9c8c33-021c-47bb-b740-9c67caf2a03e service glance] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:28.297519 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6c8fa7-8d05-4d05-8669-5845538c6cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:28.298511 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6c8fa7-8d05-4d05-8669-5845538c6cd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:28.298866 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6c8fa7-8d05-4d05-8669-5845538c6cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:28.299238 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6c8fa7-8d05-4d05-8669-5845538c6cd9 admin admin] PATH_INFO: `/v3/users/9b6bee90073e4ccc95eba7e19eab7268` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:28.300636 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6c8fa7-8d05-4d05-8669-5845538c6cd9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b6bee90073e4ccc95eba7e19eab7268)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:28.302703 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6c8fa7-8d05-4d05-8669-5845538c6cd9 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:28.608252 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:41:28.610441 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-cf6c8fa7-8d05-4d05-8669-5845538c6cd9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b6bee90073e4ccc95eba7e19eab7268'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:28.618589 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-cf6c8fa7-8d05-4d05-8669-5845538c6cd9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b6bee90073e4ccc95eba7e19eab7268'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:28.619492 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-cf6c8fa7-8d05-4d05-8669-5845538c6cd9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b6bee90073e4ccc95eba7e19eab7268'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:28.635543 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-cf6c8fa7-8d05-4d05-8669-5845538c6cd9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b6bee90073e4ccc95eba7e19eab7268'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:28.636212 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-cf6c8fa7-8d05-4d05-8669-5845538c6cd9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b6bee90073e4ccc95eba7e19eab7268'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:28.758297 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 900/1813] 10.222.0.86 () {58 vars in 1223 bytes} [Tue Jun 7 14:41:28 2022] DELETE /identity/v3/users/9b6bee90073e4ccc95eba7e19eab7268 => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:41:28.762639 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb131689-2d57-48a8-a85d-0b42f39da38e None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:28.762951 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb131689-2d57-48a8-a85d-0b42f39da38e None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:28.763532 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb131689-2d57-48a8-a85d-0b42f39da38e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:28.794361 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-fb131689-2d57-48a8-a85d-0b42f39da38e None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:41:28.796169 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-fb131689-2d57-48a8-a85d-0b42f39da38e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:41:28.866040 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 914/1814] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:41:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:41:28.876255 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6c8fa7-8d05-4d05-8669-5845538c6cd9 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:28.877754 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-cf6c8fa7-8d05-4d05-8669-5845538c6cd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:41:28.934612 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6c8fa7-8d05-4d05-8669-5845538c6cd9 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:28.938169 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559ded86-0409-4810-b723-eea8d795b685 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dda603ec5517460a83c333db2af804d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:28.938816 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559ded86-0409-4810-b723-eea8d795b685 service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:28.939097 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559ded86-0409-4810-b723-eea8d795b685 service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:28.939370 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559ded86-0409-4810-b723-eea8d795b685 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:28.948694 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559ded86-0409-4810-b723-eea8d795b685 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:28.950173 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559ded86-0409-4810-b723-eea8d795b685 service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:28.961165 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 901/1815] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:41:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:41:28.970962 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb131689-2d57-48a8-a85d-0b42f39da38e None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:28.972407 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-fb131689-2d57-48a8-a85d-0b42f39da38e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:41:28.985435 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb131689-2d57-48a8-a85d-0b42f39da38e None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:28.991242 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b171ff-039c-4d45-b399-572e84bd3019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:28.997181 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b171ff-039c-4d45-b399-572e84bd3019 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:28.997181 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b171ff-039c-4d45-b399-572e84bd3019 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:28.997181 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b171ff-039c-4d45-b399-572e84bd3019 admin admin] PATH_INFO: `/v3/users/4116aad0b8384cebb6be85aab26a5afe` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:28.997181 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b171ff-039c-4d45-b399-572e84bd3019 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4116aad0b8384cebb6be85aab26a5afe)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:28.997181 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b171ff-039c-4d45-b399-572e84bd3019 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:29.360196 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-f7b171ff-039c-4d45-b399-572e84bd3019 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4116aad0b8384cebb6be85aab26a5afe'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:29.360906 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-f7b171ff-039c-4d45-b399-572e84bd3019 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4116aad0b8384cebb6be85aab26a5afe'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:29.368720 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-f7b171ff-039c-4d45-b399-572e84bd3019 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4116aad0b8384cebb6be85aab26a5afe'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:29.381715 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-f7b171ff-039c-4d45-b399-572e84bd3019 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4116aad0b8384cebb6be85aab26a5afe'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:29.383204 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-f7b171ff-039c-4d45-b399-572e84bd3019 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4116aad0b8384cebb6be85aab26a5afe'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:29.470226 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559ded86-0409-4810-b723-eea8d795b685 service neutron] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:29.471866 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-559ded86-0409-4810-b723-eea8d795b685 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:41:29.481200 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 915/1816] 10.222.0.86 () {58 vars in 1223 bytes} [Tue Jun 7 14:41:28 2022] DELETE /identity/v3/users/4116aad0b8384cebb6be85aab26a5afe => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:41:29.486445 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dff8bb-a35c-41cf-becd-8855607ff6db None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:29.486722 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dff8bb-a35c-41cf-becd-8855607ff6db None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:29.487004 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dff8bb-a35c-41cf-becd-8855607ff6db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:29.490339 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559ded86-0409-4810-b723-eea8d795b685 service neutron] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:29.507284 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-e5dff8bb-a35c-41cf-becd-8855607ff6db None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:41:29.511917 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-e5dff8bb-a35c-41cf-becd-8855607ff6db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:41:29.575457 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae394d20-9d15-49d3-ba9f-9111b6c76197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:29.576530 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae394d20-9d15-49d3-ba9f-9111b6c76197 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:29.576839 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae394d20-9d15-49d3-ba9f-9111b6c76197 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:29.577120 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae394d20-9d15-49d3-ba9f-9111b6c76197 admin admin] PATH_INFO: `/v3/projects/a2db4df84f6f42299c7391a5ccc976ba` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:29.578406 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae394d20-9d15-49d3-ba9f-9111b6c76197 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2db4df84f6f42299c7391a5ccc976ba)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:29.580531 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae394d20-9d15-49d3-ba9f-9111b6c76197 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:29.584089 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 916/1817] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:41:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 14:41:29.596515 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dff8bb-a35c-41cf-becd-8855607ff6db None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:29.598490 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-e5dff8bb-a35c-41cf-becd-8855607ff6db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:41:29.680770 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dff8bb-a35c-41cf-becd-8855607ff6db None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:29.684970 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f31f788-3a8c-4f8d-8417-3099cadfa386 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dda603ec5517460a83c333db2af804d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:29.685629 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f31f788-3a8c-4f8d-8417-3099cadfa386 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:29.685912 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f31f788-3a8c-4f8d-8417-3099cadfa386 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:29.686226 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f31f788-3a8c-4f8d-8417-3099cadfa386 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:29.697127 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f31f788-3a8c-4f8d-8417-3099cadfa386 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:29.698619 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f31f788-3a8c-4f8d-8417-3099cadfa386 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:29.708806 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 917/1818] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:41:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:41:29.717709 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-ae394d20-9d15-49d3-ba9f-9111b6c76197 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2db4df84f6f42299c7391a5ccc976ba', 'request_id': 'req-ae394d20-9d15-49d3-ba9f-9111b6c76197'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:29.724284 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-ae394d20-9d15-49d3-ba9f-9111b6c76197 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2db4df84f6f42299c7391a5ccc976ba', 'request_id': 'req-ae394d20-9d15-49d3-ba9f-9111b6c76197'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:29.850036 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-ae394d20-9d15-49d3-ba9f-9111b6c76197 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2db4df84f6f42299c7391a5ccc976ba', 'request_id': 'req-ae394d20-9d15-49d3-ba9f-9111b6c76197'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:29.862274 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-ae394d20-9d15-49d3-ba9f-9111b6c76197 admin admin] The token cache is being invalidate because project a2db4df84f6f42299c7391a5ccc976ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:41:29.862568 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-ae394d20-9d15-49d3-ba9f-9111b6c76197 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:29.863229 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-ae394d20-9d15-49d3-ba9f-9111b6c76197 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:29.865155 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 902/1819] 10.222.0.86 () {58 vars in 1232 bytes} [Tue Jun 7 14:41:29 2022] DELETE /identity/v3/projects/a2db4df84f6f42299c7391a5ccc976ba => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 14:41:29.869613 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f31f788-3a8c-4f8d-8417-3099cadfa386 service neutron] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:29.871016 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-0f31f788-3a8c-4f8d-8417-3099cadfa386 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:41:29.896442 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f31f788-3a8c-4f8d-8417-3099cadfa386 service neutron] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:29.968118 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b27147-a863-4265-88ae-3c6a8afbaf39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:29.969439 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b27147-a863-4265-88ae-3c6a8afbaf39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:29.969802 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b27147-a863-4265-88ae-3c6a8afbaf39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:29.970154 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b27147-a863-4265-88ae-3c6a8afbaf39 admin admin] PATH_INFO: `/v3/users/7720d71c4be34576801a831a1ac17fd3` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:29.971467 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b27147-a863-4265-88ae-3c6a8afbaf39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7720d71c4be34576801a831a1ac17fd3)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:29.973501 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b27147-a863-4265-88ae-3c6a8afbaf39 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:30.182377 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-54b27147-a863-4265-88ae-3c6a8afbaf39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7720d71c4be34576801a831a1ac17fd3'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:30.183071 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-54b27147-a863-4265-88ae-3c6a8afbaf39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7720d71c4be34576801a831a1ac17fd3'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:30.190947 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-54b27147-a863-4265-88ae-3c6a8afbaf39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7720d71c4be34576801a831a1ac17fd3'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:30.210257 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-54b27147-a863-4265-88ae-3c6a8afbaf39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7720d71c4be34576801a831a1ac17fd3'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:30.212156 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-54b27147-a863-4265-88ae-3c6a8afbaf39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7720d71c4be34576801a831a1ac17fd3'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:30.268064 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae394d20-9d15-49d3-ba9f-9111b6c76197 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:30.268064 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-ae394d20-9d15-49d3-ba9f-9111b6c76197 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:41:30.283218 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae394d20-9d15-49d3-ba9f-9111b6c76197 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:30.301866 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 918/1820] 10.222.0.86 () {58 vars in 1223 bytes} [Tue Jun 7 14:41:29 2022] DELETE /identity/v3/users/7720d71c4be34576801a831a1ac17fd3 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 14:41:30.302012 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230a120c-d696-4553-afd4-02026108427f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:30.302012 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230a120c-d696-4553-afd4-02026108427f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:30.314554 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230a120c-d696-4553-afd4-02026108427f admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:30.315196 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230a120c-d696-4553-afd4-02026108427f admin admin] PATH_INFO: `/v3/projects/fa5a3e974e494d8a8457f49e07aefba6` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:30.317746 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230a120c-d696-4553-afd4-02026108427f admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa5a3e974e494d8a8457f49e07aefba6)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:30.321245 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230a120c-d696-4553-afd4-02026108427f admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:30.588378 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-230a120c-d696-4553-afd4-02026108427f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa5a3e974e494d8a8457f49e07aefba6', 'request_id': 'req-230a120c-d696-4553-afd4-02026108427f'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:30.594473 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-230a120c-d696-4553-afd4-02026108427f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa5a3e974e494d8a8457f49e07aefba6', 'request_id': 'req-230a120c-d696-4553-afd4-02026108427f'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:30.743406 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-230a120c-d696-4553-afd4-02026108427f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa5a3e974e494d8a8457f49e07aefba6', 'request_id': 'req-230a120c-d696-4553-afd4-02026108427f'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:30.755463 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-230a120c-d696-4553-afd4-02026108427f admin admin] The token cache is being invalidate because project fa5a3e974e494d8a8457f49e07aefba6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:41:30.755869 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-230a120c-d696-4553-afd4-02026108427f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:30.756752 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-230a120c-d696-4553-afd4-02026108427f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:30.762014 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 903/1821] 10.222.0.86 () {58 vars in 1232 bytes} [Tue Jun 7 14:41:30 2022] DELETE /identity/v3/projects/fa5a3e974e494d8a8457f49e07aefba6 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 14:41:30.763268 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b27147-a863-4265-88ae-3c6a8afbaf39 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:30.764798 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-54b27147-a863-4265-88ae-3c6a8afbaf39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:41:30.833790 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b27147-a863-4265-88ae-3c6a8afbaf39 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:30.897604 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a382ca-87fc-44a0-9a8a-7c47489baf08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:30.898553 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a382ca-87fc-44a0-9a8a-7c47489baf08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:30.898841 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a382ca-87fc-44a0-9a8a-7c47489baf08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:30.899120 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a382ca-87fc-44a0-9a8a-7c47489baf08 admin admin] PATH_INFO: `/v3/users/0fcda42fc503407cbed63bd9abe9e224` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:30.900354 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a382ca-87fc-44a0-9a8a-7c47489baf08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fcda42fc503407cbed63bd9abe9e224)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:30.902346 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a382ca-87fc-44a0-9a8a-7c47489baf08 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:30.905955 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:41:31.393533 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230a120c-d696-4553-afd4-02026108427f admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:31.394537 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-230a120c-d696-4553-afd4-02026108427f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:41:31.409165 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230a120c-d696-4553-afd4-02026108427f admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:31.414644 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cda1d6-c5ad-4577-b38b-a2e38305a9e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:31.415629 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cda1d6-c5ad-4577-b38b-a2e38305a9e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:31.415921 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cda1d6-c5ad-4577-b38b-a2e38305a9e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:31.416202 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cda1d6-c5ad-4577-b38b-a2e38305a9e6 admin admin] PATH_INFO: `/v3/projects/6d8987981f584e878a8732e3240fee3d` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:31.417471 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cda1d6-c5ad-4577-b38b-a2e38305a9e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d8987981f584e878a8732e3240fee3d)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:31.419689 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cda1d6-c5ad-4577-b38b-a2e38305a9e6 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:31.598722 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-a9a382ca-87fc-44a0-9a8a-7c47489baf08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fcda42fc503407cbed63bd9abe9e224'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:31.599334 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-a9a382ca-87fc-44a0-9a8a-7c47489baf08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fcda42fc503407cbed63bd9abe9e224'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:31.606853 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-a9a382ca-87fc-44a0-9a8a-7c47489baf08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fcda42fc503407cbed63bd9abe9e224'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:31.638249 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-00cda1d6-c5ad-4577-b38b-a2e38305a9e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d8987981f584e878a8732e3240fee3d', 'request_id': 'req-00cda1d6-c5ad-4577-b38b-a2e38305a9e6'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:31.644196 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-a9a382ca-87fc-44a0-9a8a-7c47489baf08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fcda42fc503407cbed63bd9abe9e224'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:31.651952 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-a9a382ca-87fc-44a0-9a8a-7c47489baf08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fcda42fc503407cbed63bd9abe9e224'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:31.654651 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-00cda1d6-c5ad-4577-b38b-a2e38305a9e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d8987981f584e878a8732e3240fee3d', 'request_id': 'req-00cda1d6-c5ad-4577-b38b-a2e38305a9e6'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:31.697766 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:41:31.751986 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 919/1822] 10.222.0.86 () {58 vars in 1223 bytes} [Tue Jun 7 14:41:30 2022] DELETE /identity/v3/users/0fcda42fc503407cbed63bd9abe9e224 => generated 0 bytes in 988 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:41:31.817317 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-00cda1d6-c5ad-4577-b38b-a2e38305a9e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d8987981f584e878a8732e3240fee3d', 'request_id': 'req-00cda1d6-c5ad-4577-b38b-a2e38305a9e6'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:31.830066 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-00cda1d6-c5ad-4577-b38b-a2e38305a9e6 admin admin] The token cache is being invalidate because project 6d8987981f584e878a8732e3240fee3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:41:31.830406 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-00cda1d6-c5ad-4577-b38b-a2e38305a9e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:31.831157 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-00cda1d6-c5ad-4577-b38b-a2e38305a9e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:31.832936 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 904/1823] 10.222.0.86 () {58 vars in 1232 bytes} [Tue Jun 7 14:41:31 2022] DELETE /identity/v3/projects/6d8987981f584e878a8732e3240fee3d => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 14:41:31.837129 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a382ca-87fc-44a0-9a8a-7c47489baf08 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:31.838801 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-a9a382ca-87fc-44a0-9a8a-7c47489baf08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:41:31.913603 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a382ca-87fc-44a0-9a8a-7c47489baf08 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:31.924437 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9cceab-6cda-4baf-a75a-064299599d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:31.924437 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9cceab-6cda-4baf-a75a-064299599d00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:31.924437 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9cceab-6cda-4baf-a75a-064299599d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:31.924437 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9cceab-6cda-4baf-a75a-064299599d00 admin admin] PATH_INFO: `/v3/users/55576466e6b74050868c7d10ad97e1fd` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:31.925403 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9cceab-6cda-4baf-a75a-064299599d00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55576466e6b74050868c7d10ad97e1fd)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:31.927371 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9cceab-6cda-4baf-a75a-064299599d00 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:32.131961 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-0f9cceab-6cda-4baf-a75a-064299599d00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55576466e6b74050868c7d10ad97e1fd'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:32.132590 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-0f9cceab-6cda-4baf-a75a-064299599d00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55576466e6b74050868c7d10ad97e1fd'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:32.140747 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-0f9cceab-6cda-4baf-a75a-064299599d00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55576466e6b74050868c7d10ad97e1fd'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:32.152505 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-0f9cceab-6cda-4baf-a75a-064299599d00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55576466e6b74050868c7d10ad97e1fd'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:32.153159 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-0f9cceab-6cda-4baf-a75a-064299599d00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55576466e6b74050868c7d10ad97e1fd'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:32.189817 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cda1d6-c5ad-4577-b38b-a2e38305a9e6 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:32.191154 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-00cda1d6-c5ad-4577-b38b-a2e38305a9e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:41:32.261731 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cda1d6-c5ad-4577-b38b-a2e38305a9e6 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:32.266370 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d894dd-b24d-44fd-850f-67258181db61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:32.267231 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d894dd-b24d-44fd-850f-67258181db61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:32.269295 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d894dd-b24d-44fd-850f-67258181db61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:32.269295 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d894dd-b24d-44fd-850f-67258181db61 admin admin] PATH_INFO: `/v3/projects/0132488f39a6484caed6638b1f2dad85` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:32.269999 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d894dd-b24d-44fd-850f-67258181db61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0132488f39a6484caed6638b1f2dad85)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:32.271991 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d894dd-b24d-44fd-850f-67258181db61 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:32.293080 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 920/1824] 10.222.0.86 () {58 vars in 1223 bytes} [Tue Jun 7 14:41:31 2022] DELETE /identity/v3/users/55576466e6b74050868c7d10ad97e1fd => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:41:32.413089 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-f0d894dd-b24d-44fd-850f-67258181db61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0132488f39a6484caed6638b1f2dad85', 'request_id': 'req-f0d894dd-b24d-44fd-850f-67258181db61'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:32.420508 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-f0d894dd-b24d-44fd-850f-67258181db61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0132488f39a6484caed6638b1f2dad85', 'request_id': 'req-f0d894dd-b24d-44fd-850f-67258181db61'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:32.531261 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-f0d894dd-b24d-44fd-850f-67258181db61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0132488f39a6484caed6638b1f2dad85', 'request_id': 'req-f0d894dd-b24d-44fd-850f-67258181db61'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:32.542398 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-f0d894dd-b24d-44fd-850f-67258181db61 admin admin] The token cache is being invalidate because project 0132488f39a6484caed6638b1f2dad85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:41:32.542692 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-f0d894dd-b24d-44fd-850f-67258181db61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:32.543331 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-f0d894dd-b24d-44fd-850f-67258181db61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:32.544946 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 905/1825] 10.222.0.86 () {58 vars in 1232 bytes} [Tue Jun 7 14:41:32 2022] DELETE /identity/v3/projects/0132488f39a6484caed6638b1f2dad85 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 14:41:32.549744 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73be1f15-a89c-4817-aa43-a9372b3cb8c7 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:32.550038 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73be1f15-a89c-4817-aa43-a9372b3cb8c7 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:32.550321 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73be1f15-a89c-4817-aa43-a9372b3cb8c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:32.572801 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-73be1f15-a89c-4817-aa43-a9372b3cb8c7 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:41:32.574087 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-73be1f15-a89c-4817-aa43-a9372b3cb8c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:41:32.660590 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 921/1826] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:41:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:41:32.669675 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba69660-a721-498a-92f7-e8c1099bd91d None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:32.673318 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba69660-a721-498a-92f7-e8c1099bd91d None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:32.673318 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba69660-a721-498a-92f7-e8c1099bd91d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:32.692883 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-5ba69660-a721-498a-92f7-e8c1099bd91d None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:41:32.695931 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-5ba69660-a721-498a-92f7-e8c1099bd91d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:41:32.704306 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 906/1827] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:41:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:41:32.709928 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73be1f15-a89c-4817-aa43-a9372b3cb8c7 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:32.725057 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73be1f15-a89c-4817-aa43-a9372b3cb8c7 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:32.730538 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421bba38-3679-4ab4-80dd-14412785f416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:32.731424 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421bba38-3679-4ab4-80dd-14412785f416 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:32.731884 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421bba38-3679-4ab4-80dd-14412785f416 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:32.732167 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421bba38-3679-4ab4-80dd-14412785f416 admin admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:32.732901 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421bba38-3679-4ab4-80dd-14412785f416 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:41:32.733211 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421bba38-3679-4ab4-80dd-14412785f416 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:32.734899 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421bba38-3679-4ab4-80dd-14412785f416 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:32.747516 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 922/1828] 10.222.0.86 () {58 vars in 1152 bytes} [Tue Jun 7 14:41:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:41:32.755183 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba69660-a721-498a-92f7-e8c1099bd91d None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:32.762626 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba69660-a721-498a-92f7-e8c1099bd91d None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:32.770830 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1768ae6e-52c0-4f77-98bf-3dcc0816802e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:32.771704 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1768ae6e-52c0-4f77-98bf-3dcc0816802e admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:32.772087 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1768ae6e-52c0-4f77-98bf-3dcc0816802e admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:32.772432 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1768ae6e-52c0-4f77-98bf-3dcc0816802e admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:32.773771 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1768ae6e-52c0-4f77-98bf-3dcc0816802e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:32.775856 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1768ae6e-52c0-4f77-98bf-3dcc0816802e admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:32.892717 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 907/1829] 10.222.0.86 () {60 vars in 1152 bytes} [Tue Jun 7 14:41:32 2022] POST /identity/v3/projects => generated 357 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:41:32.897260 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421bba38-3679-4ab4-80dd-14412785f416 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:32.907601 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421bba38-3679-4ab4-80dd-14412785f416 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:32.937406 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1768ae6e-52c0-4f77-98bf-3dcc0816802e admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:32.940491 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-1768ae6e-52c0-4f77-98bf-3dcc0816802e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:41:32.983843 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13dafc0-f083-4b4e-8cfd-b7ffebe42993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:32.984529 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13dafc0-f083-4b4e-8cfd-b7ffebe42993 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:32.984814 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13dafc0-f083-4b4e-8cfd-b7ffebe42993 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:32.985095 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13dafc0-f083-4b4e-8cfd-b7ffebe42993 admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:32.985816 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13dafc0-f083-4b4e-8cfd-b7ffebe42993 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:32.987788 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13dafc0-f083-4b4e-8cfd-b7ffebe42993 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:33.016652 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1768ae6e-52c0-4f77-98bf-3dcc0816802e admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:33.021766 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0285a98b-b4e4-4da0-ac77-7d48e404d275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:33.022654 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0285a98b-b4e4-4da0-ac77-7d48e404d275 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:33.022978 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0285a98b-b4e4-4da0-ac77-7d48e404d275 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:33.023275 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0285a98b-b4e4-4da0-ac77-7d48e404d275 admin admin] PATH_INFO: `/v3/projects/04e5bf7e2cf0456dba5e20228d10994b` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:33.024470 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0285a98b-b4e4-4da0-ac77-7d48e404d275 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04e5bf7e2cf0456dba5e20228d10994b)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:33.026352 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0285a98b-b4e4-4da0-ac77-7d48e404d275 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:33.104707 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:41:33.111033 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 923/1830] 10.222.0.86 () {60 vars in 1143 bytes} [Tue Jun 7 14:41:32 2022] POST /identity/v3/users => generated 279 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 14:41:33.114842 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13dafc0-f083-4b4e-8cfd-b7ffebe42993 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:33.125237 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13dafc0-f083-4b4e-8cfd-b7ffebe42993 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:33.130174 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298ca0bc-1ae3-4944-bf1e-df2c879a8556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:33.130887 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298ca0bc-1ae3-4944-bf1e-df2c879a8556 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:33.131205 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298ca0bc-1ae3-4944-bf1e-df2c879a8556 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:33.132278 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298ca0bc-1ae3-4944-bf1e-df2c879a8556 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:33.133081 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298ca0bc-1ae3-4944-bf1e-df2c879a8556 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:33.134759 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298ca0bc-1ae3-4944-bf1e-df2c879a8556 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:33.145142 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 924/1831] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:41:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 07 14:41:33.150096 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298ca0bc-1ae3-4944-bf1e-df2c879a8556 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:33.160251 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298ca0bc-1ae3-4944-bf1e-df2c879a8556 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:33.165661 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166b3ed0-12c9-41a8-bed4-065a5bc22f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:33.166329 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166b3ed0-12c9-41a8-bed4-065a5bc22f32 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:33.166620 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166b3ed0-12c9-41a8-bed4-065a5bc22f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:33.166900 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166b3ed0-12c9-41a8-bed4-065a5bc22f32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:33.167631 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166b3ed0-12c9-41a8-bed4-065a5bc22f32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:33.169285 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166b3ed0-12c9-41a8-bed4-065a5bc22f32 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:33.182361 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 925/1832] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:41:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:41:33.186447 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166b3ed0-12c9-41a8-bed4-065a5bc22f32 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:33.193535 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-0285a98b-b4e4-4da0-ac77-7d48e404d275 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04e5bf7e2cf0456dba5e20228d10994b', 'request_id': 'req-0285a98b-b4e4-4da0-ac77-7d48e404d275'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:33.203271 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166b3ed0-12c9-41a8-bed4-065a5bc22f32 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:33.210043 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-0285a98b-b4e4-4da0-ac77-7d48e404d275 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04e5bf7e2cf0456dba5e20228d10994b', 'request_id': 'req-0285a98b-b4e4-4da0-ac77-7d48e404d275'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:33.268979 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa05a5d-8fe9-494c-9911-fd8fa4a5317d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:33.274063 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa05a5d-8fe9-494c-9911-fd8fa4a5317d admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:33.274063 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa05a5d-8fe9-494c-9911-fd8fa4a5317d admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:33.274063 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa05a5d-8fe9-494c-9911-fd8fa4a5317d admin admin] PATH_INFO: `/v3/projects/7ff43c2253eb4c39835106ed3231f550/users/7b426b66f82347c9a9753726bb60d441/roles/c17acc2a8bb348f59ba7edd22fcf0c47` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:33.286474 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa05a5d-8fe9-494c-9911-fd8fa4a5317d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ff43c2253eb4c39835106ed3231f550, user_id=7b426b66f82347c9a9753726bb60d441, role_id=c17acc2a8bb348f59ba7edd22fcf0c47)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:33.289283 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa05a5d-8fe9-494c-9911-fd8fa4a5317d admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:33.302558 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-0285a98b-b4e4-4da0-ac77-7d48e404d275 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04e5bf7e2cf0456dba5e20228d10994b', 'request_id': 'req-0285a98b-b4e4-4da0-ac77-7d48e404d275'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:33.313601 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-0285a98b-b4e4-4da0-ac77-7d48e404d275 admin admin] The token cache is being invalidate because project 04e5bf7e2cf0456dba5e20228d10994b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:41:33.313898 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-0285a98b-b4e4-4da0-ac77-7d48e404d275 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:33.314564 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-0285a98b-b4e4-4da0-ac77-7d48e404d275 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:33.316381 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 908/1833] 10.222.0.86 () {58 vars in 1232 bytes} [Tue Jun 7 14:41:32 2022] DELETE /identity/v3/projects/04e5bf7e2cf0456dba5e20228d10994b => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 14:41:33.323243 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ec2b53-1c2a-43ca-a51c-e514c81a5d7c None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:33.325755 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ec2b53-1c2a-43ca-a51c-e514c81a5d7c None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:33.326196 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ec2b53-1c2a-43ca-a51c-e514c81a5d7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:33.346053 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-93ec2b53-1c2a-43ca-a51c-e514c81a5d7c None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:41:33.347452 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-93ec2b53-1c2a-43ca-a51c-e514c81a5d7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:41:33.357302 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 909/1834] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:41:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:41:33.366766 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d428e26-b084-4994-801d-989c6fcd5661 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:33.367517 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d428e26-b084-4994-801d-989c6fcd5661 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:33.367826 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d428e26-b084-4994-801d-989c6fcd5661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:33.386749 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-3d428e26-b084-4994-801d-989c6fcd5661 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:41:33.388285 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-3d428e26-b084-4994-801d-989c6fcd5661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:41:33.396980 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 910/1835] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:41:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 14:41:33.402410 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d428e26-b084-4994-801d-989c6fcd5661 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:33.411371 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d428e26-b084-4994-801d-989c6fcd5661 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:33.412637 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 926/1836] 10.222.0.86 () {60 vars in 1482 bytes} [Tue Jun 7 14:41:33 2022] PUT /identity/v3/projects/7ff43c2253eb4c39835106ed3231f550/users/7b426b66f82347c9a9753726bb60d441/roles/c17acc2a8bb348f59ba7edd22fcf0c47 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 14:41:33.422749 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690469e8-0cc5-4271-a88a-91ae91cf2351 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:33.423109 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690469e8-0cc5-4271-a88a-91ae91cf2351 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:33.423464 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690469e8-0cc5-4271-a88a-91ae91cf2351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:33.459031 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-690469e8-0cc5-4271-a88a-91ae91cf2351 None None] MFA Rules not processed for user `7b426b66f82347c9a9753726bb60d441`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:41:33.465993 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-690469e8-0cc5-4271-a88a-91ae91cf2351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:41:33.503060 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607f4557-44b1-45cf-a949-46f11eea722c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:33.503749 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607f4557-44b1-45cf-a949-46f11eea722c admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:33.504058 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607f4557-44b1-45cf-a949-46f11eea722c admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:33.504337 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607f4557-44b1-45cf-a949-46f11eea722c admin admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:33.512842 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607f4557-44b1-45cf-a949-46f11eea722c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:41:33.513069 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607f4557-44b1-45cf-a949-46f11eea722c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:33.514717 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607f4557-44b1-45cf-a949-46f11eea722c admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:33.545979 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 911/1837] 10.222.0.86 () {58 vars in 1152 bytes} [Tue Jun 7 14:41:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:41:33.550986 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607f4557-44b1-45cf-a949-46f11eea722c admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:33.588753 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607f4557-44b1-45cf-a949-46f11eea722c admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:33.632380 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 927/1838] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:41:33 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 14:41:33.632380 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690469e8-0cc5-4271-a88a-91ae91cf2351 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:33.632664 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bc33bb-ea52-4b2a-9662-923bbb0df482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:33.632664 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bc33bb-ea52-4b2a-9662-923bbb0df482 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:33.632664 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bc33bb-ea52-4b2a-9662-923bbb0df482 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:33.632664 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bc33bb-ea52-4b2a-9662-923bbb0df482 admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:33.632993 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-690469e8-0cc5-4271-a88a-91ae91cf2351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:41:33.633080 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bc33bb-ea52-4b2a-9662-923bbb0df482 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:33.642676 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bc33bb-ea52-4b2a-9662-923bbb0df482 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:33.671448 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690469e8-0cc5-4271-a88a-91ae91cf2351 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:33.689273 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce31aca1-bc4e-416e-bc6f-eecc3d2a8a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:33.690330 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce31aca1-bc4e-416e-bc6f-eecc3d2a8a42 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:33.690626 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce31aca1-bc4e-416e-bc6f-eecc3d2a8a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:33.690911 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce31aca1-bc4e-416e-bc6f-eecc3d2a8a42 admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:33.692475 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce31aca1-bc4e-416e-bc6f-eecc3d2a8a42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:33.696747 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce31aca1-bc4e-416e-bc6f-eecc3d2a8a42 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:33.807782 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 912/1839] 10.222.0.86 () {60 vars in 1152 bytes} [Tue Jun 7 14:41:33 2022] POST /identity/v3/projects => generated 365 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:41:33.808884 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bc33bb-ea52-4b2a-9662-923bbb0df482 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:33.811796 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 928/1840] 10.222.0.86 () {60 vars in 1152 bytes} [Tue Jun 7 14:41:33 2022] POST /identity/v3/projects => generated 357 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:41:33.815200 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce31aca1-bc4e-416e-bc6f-eecc3d2a8a42 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:33.894403 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bc33bb-ea52-4b2a-9662-923bbb0df482 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:33.934314 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce31aca1-bc4e-416e-bc6f-eecc3d2a8a42 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:33.945604 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8824ff33-075a-44cf-98ae-c1766ff0f898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:33.946423 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8824ff33-075a-44cf-98ae-c1766ff0f898 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:33.946972 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8824ff33-075a-44cf-98ae-c1766ff0f898 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:33.947456 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8824ff33-075a-44cf-98ae-c1766ff0f898 admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:33.949019 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8824ff33-075a-44cf-98ae-c1766ff0f898 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:33.955459 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8824ff33-075a-44cf-98ae-c1766ff0f898 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:33.984299 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4385946b-008b-4abf-a9cc-a4dced51ed90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:33.985320 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4385946b-008b-4abf-a9cc-a4dced51ed90 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:33.985829 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4385946b-008b-4abf-a9cc-a4dced51ed90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:33.986176 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4385946b-008b-4abf-a9cc-a4dced51ed90 admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:33.986959 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4385946b-008b-4abf-a9cc-a4dced51ed90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:33.988985 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4385946b-008b-4abf-a9cc-a4dced51ed90 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:34.088640 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 929/1841] 10.222.0.86 () {60 vars in 1143 bytes} [Tue Jun 7 14:41:33 2022] POST /identity/v3/users => generated 285 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:41:34.089904 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8824ff33-075a-44cf-98ae-c1766ff0f898 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:34.099602 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8824ff33-075a-44cf-98ae-c1766ff0f898 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:34.104920 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f62d86-3495-4255-9751-6b39499d04d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:34.105597 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f62d86-3495-4255-9751-6b39499d04d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:34.105875 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f62d86-3495-4255-9751-6b39499d04d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:34.106158 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f62d86-3495-4255-9751-6b39499d04d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:34.107011 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f62d86-3495-4255-9751-6b39499d04d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:34.108664 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f62d86-3495-4255-9751-6b39499d04d7 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:34.122468 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 930/1842] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:41:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:41:34.123979 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f62d86-3495-4255-9751-6b39499d04d7 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:34.127418 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 913/1843] 10.222.0.86 () {60 vars in 1143 bytes} [Tue Jun 7 14:41:33 2022] POST /identity/v3/users => generated 283 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:41:34.131342 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4385946b-008b-4abf-a9cc-a4dced51ed90 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:34.136094 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f62d86-3495-4255-9751-6b39499d04d7 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:34.143237 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb25637-eac2-491a-b5b4-bb9b3d001618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:34.143422 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4385946b-008b-4abf-a9cc-a4dced51ed90 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:34.144395 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb25637-eac2-491a-b5b4-bb9b3d001618 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:34.145013 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb25637-eac2-491a-b5b4-bb9b3d001618 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:34.145456 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb25637-eac2-491a-b5b4-bb9b3d001618 admin admin] PATH_INFO: `/v3/projects/358309c2745344508586219b87026ff0/users/eb3087e4a11349bfa3301107b9f2002b/roles/e3bf6239f5bf477b965704b086786f11` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:34.149377 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f91189-29ca-4c03-bfa3-945e4905fa9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:34.150211 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f91189-29ca-4c03-bfa3-945e4905fa9f admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:34.150495 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f91189-29ca-4c03-bfa3-945e4905fa9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:34.150766 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f91189-29ca-4c03-bfa3-945e4905fa9f admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:34.151500 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f91189-29ca-4c03-bfa3-945e4905fa9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:34.153122 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f91189-29ca-4c03-bfa3-945e4905fa9f admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:34.164088 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 914/1844] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:41:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 07 14:41:34.164818 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb25637-eac2-491a-b5b4-bb9b3d001618 admin admin] RBAC: Authorizing `identity:create_grant(project_id=358309c2745344508586219b87026ff0, user_id=eb3087e4a11349bfa3301107b9f2002b, role_id=e3bf6239f5bf477b965704b086786f11)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:34.167590 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb25637-eac2-491a-b5b4-bb9b3d001618 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:34.168416 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f91189-29ca-4c03-bfa3-945e4905fa9f admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:34.180026 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f91189-29ca-4c03-bfa3-945e4905fa9f admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:34.185687 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f072e6b2-06e0-458a-8dd8-2c91c6910de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:34.189097 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f072e6b2-06e0-458a-8dd8-2c91c6910de3 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:34.189097 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f072e6b2-06e0-458a-8dd8-2c91c6910de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:34.189097 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f072e6b2-06e0-458a-8dd8-2c91c6910de3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:34.189097 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f072e6b2-06e0-458a-8dd8-2c91c6910de3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:34.189429 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f072e6b2-06e0-458a-8dd8-2c91c6910de3 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:34.203180 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 915/1845] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:41:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 07 14:41:34.204477 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f072e6b2-06e0-458a-8dd8-2c91c6910de3 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:34.214593 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f072e6b2-06e0-458a-8dd8-2c91c6910de3 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:34.219183 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e9cee7-a4e6-4919-b03a-37efdcc60d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:34.220096 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e9cee7-a4e6-4919-b03a-37efdcc60d80 admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:34.220377 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e9cee7-a4e6-4919-b03a-37efdcc60d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:34.220650 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e9cee7-a4e6-4919-b03a-37efdcc60d80 admin admin] PATH_INFO: `/v3/projects/26303678a2014ff5bb80969580c1a796/users/0da6317b4b074d92bf56ed92943aa9af/roles/c17acc2a8bb348f59ba7edd22fcf0c47` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:34.236217 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e9cee7-a4e6-4919-b03a-37efdcc60d80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26303678a2014ff5bb80969580c1a796, user_id=0da6317b4b074d92bf56ed92943aa9af, role_id=c17acc2a8bb348f59ba7edd22fcf0c47)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:34.238927 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e9cee7-a4e6-4919-b03a-37efdcc60d80 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:34.262250 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 931/1846] 10.222.0.86 () {60 vars in 1482 bytes} [Tue Jun 7 14:41:34 2022] PUT /identity/v3/projects/358309c2745344508586219b87026ff0/users/eb3087e4a11349bfa3301107b9f2002b/roles/e3bf6239f5bf477b965704b086786f11 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:41:34.266013 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb25637-eac2-491a-b5b4-bb9b3d001618 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:34.312692 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 916/1847] 10.222.0.86 () {60 vars in 1482 bytes} [Tue Jun 7 14:41:34 2022] PUT /identity/v3/projects/26303678a2014ff5bb80969580c1a796/users/0da6317b4b074d92bf56ed92943aa9af/roles/c17acc2a8bb348f59ba7edd22fcf0c47 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 14:41:34.326209 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197ddb5e-8fdf-4022-b273-6756c41cf9ed None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:34.326687 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197ddb5e-8fdf-4022-b273-6756c41cf9ed None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:34.327103 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197ddb5e-8fdf-4022-b273-6756c41cf9ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:34.333487 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb25637-eac2-491a-b5b4-bb9b3d001618 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:34.361583 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-197ddb5e-8fdf-4022-b273-6756c41cf9ed None None] MFA Rules not processed for user `0da6317b4b074d92bf56ed92943aa9af`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:41:34.366046 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-197ddb5e-8fdf-4022-b273-6756c41cf9ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:41:34.400662 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7498f9-40f8-45fd-a831-09ddb9b999b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:34.401352 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7498f9-40f8-45fd-a831-09ddb9b999b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:34.401641 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7498f9-40f8-45fd-a831-09ddb9b999b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:34.403137 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7498f9-40f8-45fd-a831-09ddb9b999b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:34.404002 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7498f9-40f8-45fd-a831-09ddb9b999b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:34.405724 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7498f9-40f8-45fd-a831-09ddb9b999b4 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:34.407420 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:41:34.419361 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 932/1848] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:41:34 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:41:34.420851 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7498f9-40f8-45fd-a831-09ddb9b999b4 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:34.433480 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7498f9-40f8-45fd-a831-09ddb9b999b4 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:34.439856 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accc3dc6-98a8-4a54-88e4-3986a9f59c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:34.441016 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accc3dc6-98a8-4a54-88e4-3986a9f59c4c admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:34.441570 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accc3dc6-98a8-4a54-88e4-3986a9f59c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:34.441923 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accc3dc6-98a8-4a54-88e4-3986a9f59c4c admin admin] PATH_INFO: `/v3/projects/358309c2745344508586219b87026ff0/users/eb3087e4a11349bfa3301107b9f2002b/roles/e3bf6239f5bf477b965704b086786f11` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:34.451343 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accc3dc6-98a8-4a54-88e4-3986a9f59c4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=358309c2745344508586219b87026ff0, user_id=eb3087e4a11349bfa3301107b9f2002b, role_id=e3bf6239f5bf477b965704b086786f11)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:34.451343 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accc3dc6-98a8-4a54-88e4-3986a9f59c4c admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:34.459802 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 917/1849] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:41:34 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:41:34.460021 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 933/1850] 10.222.0.86 () {60 vars in 1482 bytes} [Tue Jun 7 14:41:34 2022] PUT /identity/v3/projects/358309c2745344508586219b87026ff0/users/eb3087e4a11349bfa3301107b9f2002b/roles/e3bf6239f5bf477b965704b086786f11 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 14:41:34.463700 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197ddb5e-8fdf-4022-b273-6756c41cf9ed None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:34.471714 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317ecd04-faeb-42ea-a644-45b2aa03f47d None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:34.472124 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317ecd04-faeb-42ea-a644-45b2aa03f47d None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:34.472562 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317ecd04-faeb-42ea-a644-45b2aa03f47d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:34.480808 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197ddb5e-8fdf-4022-b273-6756c41cf9ed None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:34.505733 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-317ecd04-faeb-42ea-a644-45b2aa03f47d None None] MFA Rules not processed for user `eb3087e4a11349bfa3301107b9f2002b`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:41:34.506972 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-317ecd04-faeb-42ea-a644-45b2aa03f47d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:41:34.560133 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e1896c-9d35-45c3-8a5c-f9c00a319816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:34.565344 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e1896c-9d35-45c3-8a5c-f9c00a319816 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:34.565344 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e1896c-9d35-45c3-8a5c-f9c00a319816 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:34.565344 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e1896c-9d35-45c3-8a5c-f9c00a319816 admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:34.565344 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e1896c-9d35-45c3-8a5c-f9c00a319816 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:34.565344 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e1896c-9d35-45c3-8a5c-f9c00a319816 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:34.593592 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 934/1851] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:41:34 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:41:34.605662 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317ecd04-faeb-42ea-a644-45b2aa03f47d None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:34.607031 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-317ecd04-faeb-42ea-a644-45b2aa03f47d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:41:34.669076 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317ecd04-faeb-42ea-a644-45b2aa03f47d None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:34.673600 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8fad38-8dc6-4ab8-9d57-d3fb1e49e559 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af5a95620a4b43538abfe09eed4bf115', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:34.674317 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8fad38-8dc6-4ab8-9d57-d3fb1e49e559 service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:34.674608 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8fad38-8dc6-4ab8-9d57-d3fb1e49e559 service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:34.674889 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8fad38-8dc6-4ab8-9d57-d3fb1e49e559 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:34.684875 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8fad38-8dc6-4ab8-9d57-d3fb1e49e559 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:34.686309 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8fad38-8dc6-4ab8-9d57-d3fb1e49e559 service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:34.698387 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 935/1852] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:41:34 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 14:41:34.700172 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 918/1853] 10.222.0.86 () {60 vars in 1152 bytes} [Tue Jun 7 14:41:34 2022] POST /identity/v3/projects => generated 365 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:41:34.704054 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8fad38-8dc6-4ab8-9d57-d3fb1e49e559 service cinder] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:34.717003 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8fad38-8dc6-4ab8-9d57-d3fb1e49e559 service cinder] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:34.782366 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc5eb15-7b6c-4a0d-b994-cca0009edfc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:34.783108 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc5eb15-7b6c-4a0d-b994-cca0009edfc9 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:34.783398 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc5eb15-7b6c-4a0d-b994-cca0009edfc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:34.783727 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc5eb15-7b6c-4a0d-b994-cca0009edfc9 admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:34.784452 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc5eb15-7b6c-4a0d-b994-cca0009edfc9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:34.786375 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc5eb15-7b6c-4a0d-b994-cca0009edfc9 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:34.841003 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:41:34.925692 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 936/1854] 10.222.0.86 () {60 vars in 1143 bytes} [Tue Jun 7 14:41:34 2022] POST /identity/v3/users => generated 289 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:41:34.930021 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e1896c-9d35-45c3-8a5c-f9c00a319816 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:34.941627 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e1896c-9d35-45c3-8a5c-f9c00a319816 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:34.973328 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc5eb15-7b6c-4a0d-b994-cca0009edfc9 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:34.983985 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7d6d90-f2f9-40af-a5c2-ed23f311289a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:34.984714 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7d6d90-f2f9-40af-a5c2-ed23f311289a admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:34.984977 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7d6d90-f2f9-40af-a5c2-ed23f311289a admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:34.986606 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7d6d90-f2f9-40af-a5c2-ed23f311289a admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:34.988164 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7d6d90-f2f9-40af-a5c2-ed23f311289a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:34.990059 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7d6d90-f2f9-40af-a5c2-ed23f311289a admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:35.003297 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 919/1855] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:41:34 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:41:35.007081 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7d6d90-f2f9-40af-a5c2-ed23f311289a admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:35.018660 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7d6d90-f2f9-40af-a5c2-ed23f311289a admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:35.025362 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c68ab24-0bd6-4051-8dd0-9b403f971612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:35.026777 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c68ab24-0bd6-4051-8dd0-9b403f971612 admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:35.026777 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c68ab24-0bd6-4051-8dd0-9b403f971612 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:35.027038 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c68ab24-0bd6-4051-8dd0-9b403f971612 admin admin] PATH_INFO: `/v3/projects/72993561478d4826a968c03a33b960c4/users/c8a7ba50218742a88e2770e54091bd3c/roles/e3bf6239f5bf477b965704b086786f11` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:35.048837 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c68ab24-0bd6-4051-8dd0-9b403f971612 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72993561478d4826a968c03a33b960c4, user_id=c8a7ba50218742a88e2770e54091bd3c, role_id=e3bf6239f5bf477b965704b086786f11)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:35.054837 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc5eb15-7b6c-4a0d-b994-cca0009edfc9 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:35.055266 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c68ab24-0bd6-4051-8dd0-9b403f971612 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:35.060180 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11357eff-3729-42d0-ad76-2e5fdb5a1fc4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af5a95620a4b43538abfe09eed4bf115', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:35.060872 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11357eff-3729-42d0-ad76-2e5fdb5a1fc4 service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:35.061160 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11357eff-3729-42d0-ad76-2e5fdb5a1fc4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:35.061437 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11357eff-3729-42d0-ad76-2e5fdb5a1fc4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:35.122748 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11357eff-3729-42d0-ad76-2e5fdb5a1fc4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:35.127913 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11357eff-3729-42d0-ad76-2e5fdb5a1fc4 service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:35.140463 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 937/1856] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:41:34 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 14:41:35.160552 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 920/1857] 10.222.0.86 () {60 vars in 1482 bytes} [Tue Jun 7 14:41:35 2022] PUT /identity/v3/projects/72993561478d4826a968c03a33b960c4/users/c8a7ba50218742a88e2770e54091bd3c/roles/e3bf6239f5bf477b965704b086786f11 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 14:41:35.167613 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11357eff-3729-42d0-ad76-2e5fdb5a1fc4 service cinder] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:35.192409 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11357eff-3729-42d0-ad76-2e5fdb5a1fc4 service cinder] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:35.277135 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf0dfd1-d167-4365-bd63-a9158083a21d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:35.277925 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf0dfd1-d167-4365-bd63-a9158083a21d admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:35.278289 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf0dfd1-d167-4365-bd63-a9158083a21d admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:35.278652 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf0dfd1-d167-4365-bd63-a9158083a21d admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:35.279466 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf0dfd1-d167-4365-bd63-a9158083a21d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:35.281346 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf0dfd1-d167-4365-bd63-a9158083a21d admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:35.296421 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 938/1858] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:41:35 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:41:35.298469 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c68ab24-0bd6-4051-8dd0-9b403f971612 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:35.310035 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c68ab24-0bd6-4051-8dd0-9b403f971612 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:35.315063 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890b58e0-f5a0-4676-bbb9-4ef4f04e69ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:35.317118 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b58e0-f5a0-4676-bbb9-4ef4f04e69ca admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:35.317118 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b58e0-f5a0-4676-bbb9-4ef4f04e69ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:35.317118 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b58e0-f5a0-4676-bbb9-4ef4f04e69ca admin admin] PATH_INFO: `/v3/projects/72993561478d4826a968c03a33b960c4/users/c8a7ba50218742a88e2770e54091bd3c/roles/e3bf6239f5bf477b965704b086786f11` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:35.318754 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890b58e0-f5a0-4676-bbb9-4ef4f04e69ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=72993561478d4826a968c03a33b960c4, user_id=c8a7ba50218742a88e2770e54091bd3c, role_id=e3bf6239f5bf477b965704b086786f11)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:35.322131 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890b58e0-f5a0-4676-bbb9-4ef4f04e69ca admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:35.344633 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 921/1859] 10.222.0.86 () {60 vars in 1482 bytes} [Tue Jun 7 14:41:35 2022] PUT /identity/v3/projects/72993561478d4826a968c03a33b960c4/users/c8a7ba50218742a88e2770e54091bd3c/roles/e3bf6239f5bf477b965704b086786f11 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 14:41:35.346554 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c360a82-01e7-42b1-93c3-687cac305288 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:35.346899 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c360a82-01e7-42b1-93c3-687cac305288 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:35.347179 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c360a82-01e7-42b1-93c3-687cac305288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:35.378657 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-1c360a82-01e7-42b1-93c3-687cac305288 None None] MFA Rules not processed for user `c8a7ba50218742a88e2770e54091bd3c`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:41:35.380290 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-1c360a82-01e7-42b1-93c3-687cac305288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:41:35.467972 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 939/1860] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:41:35 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:41:35.520147 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890b58e0-f5a0-4676-bbb9-4ef4f04e69ca admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:35.522036 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-890b58e0-f5a0-4676-bbb9-4ef4f04e69ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:41:35.583398 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890b58e0-f5a0-4676-bbb9-4ef4f04e69ca admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:35.586908 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b982c1c6-5927-487d-9281-fecb91301ba2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af5a95620a4b43538abfe09eed4bf115', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:35.587556 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b982c1c6-5927-487d-9281-fecb91301ba2 service cinder] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:35.587860 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b982c1c6-5927-487d-9281-fecb91301ba2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:35.588136 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b982c1c6-5927-487d-9281-fecb91301ba2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:35.597187 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b982c1c6-5927-487d-9281-fecb91301ba2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:35.598591 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b982c1c6-5927-487d-9281-fecb91301ba2 service cinder] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:35.608759 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 922/1861] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:41:35 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:41:35.865768 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c360a82-01e7-42b1-93c3-687cac305288 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:35.878170 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c360a82-01e7-42b1-93c3-687cac305288 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:35.881965 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfee7ec0-a2f0-4665-bfe7-ecab95997b72 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af5a95620a4b43538abfe09eed4bf115', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:35.882787 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfee7ec0-a2f0-4665-bfe7-ecab95997b72 service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:35.883150 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfee7ec0-a2f0-4665-bfe7-ecab95997b72 service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:35.883521 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfee7ec0-a2f0-4665-bfe7-ecab95997b72 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:35.944125 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfee7ec0-a2f0-4665-bfe7-ecab95997b72 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:35.945972 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfee7ec0-a2f0-4665-bfe7-ecab95997b72 service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:35.958612 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 940/1862] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:41:35 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 14:41:37.160405 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:41:37.770163 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:41:39.462834 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:41:40.236180 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:41:42.023674 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:41:42.880376 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:41:43.966102 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:41:44.332800 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b982c1c6-5927-487d-9281-fecb91301ba2 service cinder] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:44.418616 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b982c1c6-5927-487d-9281-fecb91301ba2 service cinder] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:44.423951 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8b44b1-6970-4074-b572-c88c91a09e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:44.424852 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8b44b1-6970-4074-b572-c88c91a09e2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:44.425139 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8b44b1-6970-4074-b572-c88c91a09e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:44.427209 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8b44b1-6970-4074-b572-c88c91a09e2b admin admin] PATH_INFO: `/v3/users/0da6317b4b074d92bf56ed92943aa9af` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:44.427209 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8b44b1-6970-4074-b572-c88c91a09e2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0da6317b4b074d92bf56ed92943aa9af)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:44.429237 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8b44b1-6970-4074-b572-c88c91a09e2b admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:44.777930 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-ec8b44b1-6970-4074-b572-c88c91a09e2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0da6317b4b074d92bf56ed92943aa9af'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:44.786228 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-ec8b44b1-6970-4074-b572-c88c91a09e2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0da6317b4b074d92bf56ed92943aa9af'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:44.787054 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-ec8b44b1-6970-4074-b572-c88c91a09e2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0da6317b4b074d92bf56ed92943aa9af'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:44.804048 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-ec8b44b1-6970-4074-b572-c88c91a09e2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0da6317b4b074d92bf56ed92943aa9af'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:44.804869 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-ec8b44b1-6970-4074-b572-c88c91a09e2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0da6317b4b074d92bf56ed92943aa9af'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:44.807734 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:41:44.912802 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 923/1863] 10.222.0.86 () {58 vars in 1223 bytes} [Tue Jun 7 14:41:44 2022] DELETE /identity/v3/users/0da6317b4b074d92bf56ed92943aa9af => generated 0 bytes in 580 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:41:44.917287 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f56e6b-18df-4c3a-9343-73b2d2912a74 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:44.917799 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f56e6b-18df-4c3a-9343-73b2d2912a74 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:44.918163 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f56e6b-18df-4c3a-9343-73b2d2912a74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:44.939635 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-93f56e6b-18df-4c3a-9343-73b2d2912a74 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:41:44.941107 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-93f56e6b-18df-4c3a-9343-73b2d2912a74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:41:45.010610 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 941/1864] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:41:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:41:45.022075 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8b44b1-6970-4074-b572-c88c91a09e2b admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:45.024054 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-ec8b44b1-6970-4074-b572-c88c91a09e2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:41:45.093055 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8b44b1-6970-4074-b572-c88c91a09e2b admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:45.097083 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e6ee57-fd63-4881-9855-e9aab34c395c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dda603ec5517460a83c333db2af804d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:45.097797 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e6ee57-fd63-4881-9855-e9aab34c395c service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:45.098067 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e6ee57-fd63-4881-9855-e9aab34c395c service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:45.098343 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e6ee57-fd63-4881-9855-e9aab34c395c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:45.110565 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e6ee57-fd63-4881-9855-e9aab34c395c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:45.112448 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e6ee57-fd63-4881-9855-e9aab34c395c service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:45.129301 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 924/1865] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:41:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:41:45.228307 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:41:45.812732 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f56e6b-18df-4c3a-9343-73b2d2912a74 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:45.815083 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-93f56e6b-18df-4c3a-9343-73b2d2912a74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:41:45.860010 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f56e6b-18df-4c3a-9343-73b2d2912a74 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:45.860010 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc7114d-f7a3-4be6-a6bc-06c83497ff68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:45.860010 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc7114d-f7a3-4be6-a6bc-06c83497ff68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:45.860801 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc7114d-f7a3-4be6-a6bc-06c83497ff68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:45.861311 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc7114d-f7a3-4be6-a6bc-06c83497ff68 admin admin] PATH_INFO: `/v3/projects/26303678a2014ff5bb80969580c1a796` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:45.862867 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc7114d-f7a3-4be6-a6bc-06c83497ff68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26303678a2014ff5bb80969580c1a796)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:45.865761 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc7114d-f7a3-4be6-a6bc-06c83497ff68 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:46.002399 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-8dc7114d-f7a3-4be6-a6bc-06c83497ff68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26303678a2014ff5bb80969580c1a796', 'request_id': 'req-8dc7114d-f7a3-4be6-a6bc-06c83497ff68'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:46.011588 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-8dc7114d-f7a3-4be6-a6bc-06c83497ff68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26303678a2014ff5bb80969580c1a796', 'request_id': 'req-8dc7114d-f7a3-4be6-a6bc-06c83497ff68'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:46.092557 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-8dc7114d-f7a3-4be6-a6bc-06c83497ff68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26303678a2014ff5bb80969580c1a796', 'request_id': 'req-8dc7114d-f7a3-4be6-a6bc-06c83497ff68'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:46.110794 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-8dc7114d-f7a3-4be6-a6bc-06c83497ff68 admin admin] The token cache is being invalidate because project 26303678a2014ff5bb80969580c1a796 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:41:46.111929 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-8dc7114d-f7a3-4be6-a6bc-06c83497ff68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:46.112796 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-8dc7114d-f7a3-4be6-a6bc-06c83497ff68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:46.115387 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 942/1866] 10.222.0.86 () {58 vars in 1232 bytes} [Tue Jun 7 14:41:45 2022] DELETE /identity/v3/projects/26303678a2014ff5bb80969580c1a796 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:41:46.119409 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e6ee57-fd63-4881-9855-e9aab34c395c service neutron] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:46.130690 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e6ee57-fd63-4881-9855-e9aab34c395c service neutron] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:46.205404 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413690b3-5e66-4951-9baf-f0538a5ab95d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:46.206406 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413690b3-5e66-4951-9baf-f0538a5ab95d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:46.206754 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413690b3-5e66-4951-9baf-f0538a5ab95d admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:46.207107 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413690b3-5e66-4951-9baf-f0538a5ab95d admin admin] PATH_INFO: `/v3/users/c8a7ba50218742a88e2770e54091bd3c` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:46.208566 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413690b3-5e66-4951-9baf-f0538a5ab95d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8a7ba50218742a88e2770e54091bd3c)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:46.210815 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413690b3-5e66-4951-9baf-f0538a5ab95d admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:46.544199 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-413690b3-5e66-4951-9baf-f0538a5ab95d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8a7ba50218742a88e2770e54091bd3c'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:46.550818 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-413690b3-5e66-4951-9baf-f0538a5ab95d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8a7ba50218742a88e2770e54091bd3c'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:46.551471 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-413690b3-5e66-4951-9baf-f0538a5ab95d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8a7ba50218742a88e2770e54091bd3c'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:46.564364 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-413690b3-5e66-4951-9baf-f0538a5ab95d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8a7ba50218742a88e2770e54091bd3c'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:46.565017 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-413690b3-5e66-4951-9baf-f0538a5ab95d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8a7ba50218742a88e2770e54091bd3c'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:46.697272 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 925/1867] 10.222.0.86 () {58 vars in 1223 bytes} [Tue Jun 7 14:41:46 2022] DELETE /identity/v3/users/c8a7ba50218742a88e2770e54091bd3c => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:41:46.828510 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:41:47.208896 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc7114d-f7a3-4be6-a6bc-06c83497ff68 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:47.211111 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-8dc7114d-f7a3-4be6-a6bc-06c83497ff68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:41:47.240386 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc7114d-f7a3-4be6-a6bc-06c83497ff68 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:47.306832 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03e5a83-b5e5-4b38-8b04-9401c1e7d608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:47.308018 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03e5a83-b5e5-4b38-8b04-9401c1e7d608 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:47.308510 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03e5a83-b5e5-4b38-8b04-9401c1e7d608 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:47.308864 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03e5a83-b5e5-4b38-8b04-9401c1e7d608 admin admin] PATH_INFO: `/v3/projects/72993561478d4826a968c03a33b960c4` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:47.310389 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03e5a83-b5e5-4b38-8b04-9401c1e7d608 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72993561478d4826a968c03a33b960c4)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:47.313697 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03e5a83-b5e5-4b38-8b04-9401c1e7d608 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:47.492448 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-a03e5a83-b5e5-4b38-8b04-9401c1e7d608 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72993561478d4826a968c03a33b960c4', 'request_id': 'req-a03e5a83-b5e5-4b38-8b04-9401c1e7d608'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:47.498571 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-a03e5a83-b5e5-4b38-8b04-9401c1e7d608 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72993561478d4826a968c03a33b960c4', 'request_id': 'req-a03e5a83-b5e5-4b38-8b04-9401c1e7d608'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:47.565255 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-a03e5a83-b5e5-4b38-8b04-9401c1e7d608 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72993561478d4826a968c03a33b960c4', 'request_id': 'req-a03e5a83-b5e5-4b38-8b04-9401c1e7d608'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:47.576009 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-a03e5a83-b5e5-4b38-8b04-9401c1e7d608 admin admin] The token cache is being invalidate because project 72993561478d4826a968c03a33b960c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:41:47.576511 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-a03e5a83-b5e5-4b38-8b04-9401c1e7d608 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:47.577586 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-a03e5a83-b5e5-4b38-8b04-9401c1e7d608 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:47.579247 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 943/1868] 10.222.0.86 () {58 vars in 1232 bytes} [Tue Jun 7 14:41:47 2022] DELETE /identity/v3/projects/72993561478d4826a968c03a33b960c4 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:41:47.584529 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125a6a90-9a93-4ad6-8f98-c813e370553b None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:47.585048 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125a6a90-9a93-4ad6-8f98-c813e370553b None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:47.585180 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125a6a90-9a93-4ad6-8f98-c813e370553b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:47.603566 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-125a6a90-9a93-4ad6-8f98-c813e370553b None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:41:47.604795 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-125a6a90-9a93-4ad6-8f98-c813e370553b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:41:47.613132 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:41:47.663041 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 926/1869] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:41:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:41:47.670975 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c45b23e-5784-42c8-895a-404fe52afe68 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:47.671259 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c45b23e-5784-42c8-895a-404fe52afe68 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:47.671537 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c45b23e-5784-42c8-895a-404fe52afe68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:47.689473 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-4c45b23e-5784-42c8-895a-404fe52afe68 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:41:47.690699 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-4c45b23e-5784-42c8-895a-404fe52afe68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:41:47.698553 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 944/1870] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:41:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:41:47.702492 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125a6a90-9a93-4ad6-8f98-c813e370553b None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:47.712632 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125a6a90-9a93-4ad6-8f98-c813e370553b None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:47.717238 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab752f4c-2664-4d68-ad65-aa59e7770dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:47.717885 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab752f4c-2664-4d68-ad65-aa59e7770dab admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:47.718169 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab752f4c-2664-4d68-ad65-aa59e7770dab admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:47.718446 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab752f4c-2664-4d68-ad65-aa59e7770dab admin admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:47.719179 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab752f4c-2664-4d68-ad65-aa59e7770dab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:41:47.719486 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab752f4c-2664-4d68-ad65-aa59e7770dab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:47.721136 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab752f4c-2664-4d68-ad65-aa59e7770dab admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:47.733259 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 927/1871] 10.222.0.86 () {58 vars in 1152 bytes} [Tue Jun 7 14:41:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:41:47.741901 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c45b23e-5784-42c8-895a-404fe52afe68 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:47.751110 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c45b23e-5784-42c8-895a-404fe52afe68 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:47.755848 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a784a19-923a-4e48-a763-ff4faeeecb7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:47.756534 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a784a19-923a-4e48-a763-ff4faeeecb7c admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:47.756828 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a784a19-923a-4e48-a763-ff4faeeecb7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:47.757107 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a784a19-923a-4e48-a763-ff4faeeecb7c admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:47.757813 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a784a19-923a-4e48-a763-ff4faeeecb7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:47.759702 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a784a19-923a-4e48-a763-ff4faeeecb7c admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:47.888370 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 945/1872] 10.222.0.86 () {60 vars in 1152 bytes} [Tue Jun 7 14:41:47 2022] POST /identity/v3/projects => generated 385 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:41:47.889423 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab752f4c-2664-4d68-ad65-aa59e7770dab admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:47.900717 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab752f4c-2664-4d68-ad65-aa59e7770dab admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:47.955337 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88be917d-3670-4bf5-add1-7b825847ce63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:47.955951 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88be917d-3670-4bf5-add1-7b825847ce63 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:47.956236 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88be917d-3670-4bf5-add1-7b825847ce63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:47.956576 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88be917d-3670-4bf5-add1-7b825847ce63 admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:47.957273 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88be917d-3670-4bf5-add1-7b825847ce63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:47.959162 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88be917d-3670-4bf5-add1-7b825847ce63 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:48.074744 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 928/1873] 10.222.0.86 () {60 vars in 1143 bytes} [Tue Jun 7 14:41:47 2022] POST /identity/v3/users => generated 293 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 14:41:48.079002 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a784a19-923a-4e48-a763-ff4faeeecb7c admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:48.090926 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a784a19-923a-4e48-a763-ff4faeeecb7c admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:48.096151 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a91493-fba6-4c55-9773-fb8635bd3f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:48.097026 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a91493-fba6-4c55-9773-fb8635bd3f67 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:48.098417 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:41:48.101167 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a91493-fba6-4c55-9773-fb8635bd3f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:48.101167 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a91493-fba6-4c55-9773-fb8635bd3f67 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:48.101167 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a91493-fba6-4c55-9773-fb8635bd3f67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:48.101644 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a91493-fba6-4c55-9773-fb8635bd3f67 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:48.111989 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 946/1874] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:41:48 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:41:48.116190 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88be917d-3670-4bf5-add1-7b825847ce63 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:48.126333 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88be917d-3670-4bf5-add1-7b825847ce63 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:48.131068 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19523bd7-7d6c-415c-966e-d9c66f8d435f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:48.131743 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19523bd7-7d6c-415c-966e-d9c66f8d435f admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:48.132535 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19523bd7-7d6c-415c-966e-d9c66f8d435f admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:48.132936 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19523bd7-7d6c-415c-966e-d9c66f8d435f admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:48.133672 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19523bd7-7d6c-415c-966e-d9c66f8d435f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:48.135313 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19523bd7-7d6c-415c-966e-d9c66f8d435f admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:48.146373 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 929/1875] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:41:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:41:48.151642 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a91493-fba6-4c55-9773-fb8635bd3f67 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:48.161621 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a91493-fba6-4c55-9773-fb8635bd3f67 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:48.166241 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ea7ca5-6aa8-42ad-b8a1-80608699f9ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:48.167114 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ea7ca5-6aa8-42ad-b8a1-80608699f9ca admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:48.167398 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ea7ca5-6aa8-42ad-b8a1-80608699f9ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:48.168173 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ea7ca5-6aa8-42ad-b8a1-80608699f9ca admin admin] PATH_INFO: `/v3/projects/5d22f3fc1f8144e1a6ab8e76537fb9ca/users/8f5826cb1726403cb1a9ab5770add40d/roles/c17acc2a8bb348f59ba7edd22fcf0c47` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:48.182332 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ea7ca5-6aa8-42ad-b8a1-80608699f9ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d22f3fc1f8144e1a6ab8e76537fb9ca, user_id=8f5826cb1726403cb1a9ab5770add40d, role_id=c17acc2a8bb348f59ba7edd22fcf0c47)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:48.185014 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ea7ca5-6aa8-42ad-b8a1-80608699f9ca admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:48.280088 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 947/1876] 10.222.0.86 () {60 vars in 1482 bytes} [Tue Jun 7 14:41:48 2022] PUT /identity/v3/projects/5d22f3fc1f8144e1a6ab8e76537fb9ca/users/8f5826cb1726403cb1a9ab5770add40d/roles/c17acc2a8bb348f59ba7edd22fcf0c47 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:41:48.294547 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10b16ff-2689-402e-9511-ab57955824ee None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:48.294842 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10b16ff-2689-402e-9511-ab57955824ee None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:48.295392 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10b16ff-2689-402e-9511-ab57955824ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:48.322982 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-b10b16ff-2689-402e-9511-ab57955824ee None None] MFA Rules not processed for user `8f5826cb1726403cb1a9ab5770add40d`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:41:48.324317 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-b10b16ff-2689-402e-9511-ab57955824ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:41:48.407575 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 930/1877] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:41:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:41:48.428715 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ea7ca5-6aa8-42ad-b8a1-80608699f9ca admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:48.431501 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-a6ea7ca5-6aa8-42ad-b8a1-80608699f9ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:41:48.490693 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ea7ca5-6aa8-42ad-b8a1-80608699f9ca admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:48.494389 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991cdbab-6806-4b2f-bf36-a4f20082d9df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af5a95620a4b43538abfe09eed4bf115', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:48.495092 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991cdbab-6806-4b2f-bf36-a4f20082d9df service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:48.495399 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991cdbab-6806-4b2f-bf36-a4f20082d9df service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:48.495901 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991cdbab-6806-4b2f-bf36-a4f20082d9df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:48.504350 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991cdbab-6806-4b2f-bf36-a4f20082d9df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:48.505777 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991cdbab-6806-4b2f-bf36-a4f20082d9df service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:48.514658 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 948/1878] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:41:48 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:41:48.534449 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10b16ff-2689-402e-9511-ab57955824ee None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:48.596301 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10b16ff-2689-402e-9511-ab57955824ee None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:48.601301 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cc3f0c-bc2c-4e9d-b79e-06e67a11a4b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:48.602178 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cc3f0c-bc2c-4e9d-b79e-06e67a11a4b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:48.602464 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cc3f0c-bc2c-4e9d-b79e-06e67a11a4b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:48.602743 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cc3f0c-bc2c-4e9d-b79e-06e67a11a4b3 admin admin] PATH_INFO: `/v3/users/8f5826cb1726403cb1a9ab5770add40d` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:48.603971 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cc3f0c-bc2c-4e9d-b79e-06e67a11a4b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f5826cb1726403cb1a9ab5770add40d)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:48.605876 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cc3f0c-bc2c-4e9d-b79e-06e67a11a4b3 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:48.869611 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-f6cc3f0c-bc2c-4e9d-b79e-06e67a11a4b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f5826cb1726403cb1a9ab5770add40d'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:48.876369 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-f6cc3f0c-bc2c-4e9d-b79e-06e67a11a4b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f5826cb1726403cb1a9ab5770add40d'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:48.877158 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-f6cc3f0c-bc2c-4e9d-b79e-06e67a11a4b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f5826cb1726403cb1a9ab5770add40d'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:48.889414 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-f6cc3f0c-bc2c-4e9d-b79e-06e67a11a4b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f5826cb1726403cb1a9ab5770add40d'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:48.890084 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-f6cc3f0c-bc2c-4e9d-b79e-06e67a11a4b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f5826cb1726403cb1a9ab5770add40d'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:48.890859 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:41:49.001736 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 931/1879] 10.222.0.86 () {58 vars in 1223 bytes} [Tue Jun 7 14:41:48 2022] DELETE /identity/v3/users/8f5826cb1726403cb1a9ab5770add40d => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:41:49.005107 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f95e805-42a3-4749-80a3-267dd784c799 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:49.005489 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f95e805-42a3-4749-80a3-267dd784c799 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:49.005906 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f95e805-42a3-4749-80a3-267dd784c799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:49.024894 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-0f95e805-42a3-4749-80a3-267dd784c799 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:41:49.026094 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-0f95e805-42a3-4749-80a3-267dd784c799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:41:49.084496 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 949/1880] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:41:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:41:49.094750 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cc3f0c-bc2c-4e9d-b79e-06e67a11a4b3 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:49.096268 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-f6cc3f0c-bc2c-4e9d-b79e-06e67a11a4b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:41:49.152466 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cc3f0c-bc2c-4e9d-b79e-06e67a11a4b3 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:49.156112 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118572e6-44f4-477b-a2e4-5299600af409 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dda603ec5517460a83c333db2af804d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:49.156763 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118572e6-44f4-477b-a2e4-5299600af409 service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:49.157049 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118572e6-44f4-477b-a2e4-5299600af409 service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:49.157326 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118572e6-44f4-477b-a2e4-5299600af409 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:49.166491 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118572e6-44f4-477b-a2e4-5299600af409 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:49.167949 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118572e6-44f4-477b-a2e4-5299600af409 service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:49.177589 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 932/1881] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:41:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:41:49.571521 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:41:49.738234 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f95e805-42a3-4749-80a3-267dd784c799 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:49.739283 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-0f95e805-42a3-4749-80a3-267dd784c799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:41:49.756212 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f95e805-42a3-4749-80a3-267dd784c799 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:49.759897 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496968e7-fddc-40a5-b07e-51d204a7ce07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:49.763057 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496968e7-fddc-40a5-b07e-51d204a7ce07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:49.763057 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496968e7-fddc-40a5-b07e-51d204a7ce07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:49.763057 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496968e7-fddc-40a5-b07e-51d204a7ce07 admin admin] PATH_INFO: `/v3/projects/5d22f3fc1f8144e1a6ab8e76537fb9ca` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:49.763057 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496968e7-fddc-40a5-b07e-51d204a7ce07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d22f3fc1f8144e1a6ab8e76537fb9ca)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:49.764978 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496968e7-fddc-40a5-b07e-51d204a7ce07 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:49.901237 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-496968e7-fddc-40a5-b07e-51d204a7ce07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d22f3fc1f8144e1a6ab8e76537fb9ca', 'request_id': 'req-496968e7-fddc-40a5-b07e-51d204a7ce07'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:49.913760 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-496968e7-fddc-40a5-b07e-51d204a7ce07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d22f3fc1f8144e1a6ab8e76537fb9ca', 'request_id': 'req-496968e7-fddc-40a5-b07e-51d204a7ce07'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:50.028135 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-496968e7-fddc-40a5-b07e-51d204a7ce07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d22f3fc1f8144e1a6ab8e76537fb9ca', 'request_id': 'req-496968e7-fddc-40a5-b07e-51d204a7ce07'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:50.042698 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-496968e7-fddc-40a5-b07e-51d204a7ce07 admin admin] The token cache is being invalidate because project 5d22f3fc1f8144e1a6ab8e76537fb9ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:41:50.043093 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-496968e7-fddc-40a5-b07e-51d204a7ce07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:50.043973 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-496968e7-fddc-40a5-b07e-51d204a7ce07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:50.045809 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 950/1882] 10.222.0.86 () {58 vars in 1232 bytes} [Tue Jun 7 14:41:49 2022] DELETE /identity/v3/projects/5d22f3fc1f8144e1a6ab8e76537fb9ca => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:41:50.050877 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d164a99-ce8d-4442-8af4-7f3589af6d43 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:50.051363 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d164a99-ce8d-4442-8af4-7f3589af6d43 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:50.051640 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d164a99-ce8d-4442-8af4-7f3589af6d43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:50.073627 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-1d164a99-ce8d-4442-8af4-7f3589af6d43 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:41:50.075141 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-1d164a99-ce8d-4442-8af4-7f3589af6d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:41:50.139612 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 933/1883] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:41:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 14:41:50.149368 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394df25f-fb62-4b49-b40c-09602f5236f6 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:50.149662 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394df25f-fb62-4b49-b40c-09602f5236f6 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:50.149948 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394df25f-fb62-4b49-b40c-09602f5236f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:50.168795 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-394df25f-fb62-4b49-b40c-09602f5236f6 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:41:50.170006 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-394df25f-fb62-4b49-b40c-09602f5236f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:41:50.178803 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 951/1884] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:41:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:41:50.182997 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d164a99-ce8d-4442-8af4-7f3589af6d43 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:50.194753 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d164a99-ce8d-4442-8af4-7f3589af6d43 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:50.199991 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c7559c-8a1d-4a5e-9d2e-099aabaca289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:50.200667 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c7559c-8a1d-4a5e-9d2e-099aabaca289 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:50.201008 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c7559c-8a1d-4a5e-9d2e-099aabaca289 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:50.201297 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c7559c-8a1d-4a5e-9d2e-099aabaca289 admin admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:50.202269 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c7559c-8a1d-4a5e-9d2e-099aabaca289 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:41:50.202950 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c7559c-8a1d-4a5e-9d2e-099aabaca289 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:50.204929 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c7559c-8a1d-4a5e-9d2e-099aabaca289 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:50.223686 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 934/1885] 10.222.0.86 () {58 vars in 1152 bytes} [Tue Jun 7 14:41:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:41:50.224915 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394df25f-fb62-4b49-b40c-09602f5236f6 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:50.245253 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394df25f-fb62-4b49-b40c-09602f5236f6 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:50.250358 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0c1e67-fa8b-4d5b-aa66-fde628869307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:50.251222 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0c1e67-fa8b-4d5b-aa66-fde628869307 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:50.251605 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0c1e67-fa8b-4d5b-aa66-fde628869307 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:50.252106 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0c1e67-fa8b-4d5b-aa66-fde628869307 admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:50.253139 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0c1e67-fa8b-4d5b-aa66-fde628869307 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:50.255331 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0c1e67-fa8b-4d5b-aa66-fde628869307 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:50.379494 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 952/1886] 10.222.0.86 () {60 vars in 1152 bytes} [Tue Jun 7 14:41:50 2022] POST /identity/v3/projects => generated 377 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:41:50.381453 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c7559c-8a1d-4a5e-9d2e-099aabaca289 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:50.391887 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c7559c-8a1d-4a5e-9d2e-099aabaca289 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:50.406638 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:41:50.446059 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:41:50.470428 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d903cec-eaf1-42c9-9c18-0eda52ca7412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:50.471224 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d903cec-eaf1-42c9-9c18-0eda52ca7412 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:50.471583 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d903cec-eaf1-42c9-9c18-0eda52ca7412 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:50.472019 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d903cec-eaf1-42c9-9c18-0eda52ca7412 admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:50.474242 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d903cec-eaf1-42c9-9c18-0eda52ca7412 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:50.476508 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d903cec-eaf1-42c9-9c18-0eda52ca7412 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:50.572257 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 935/1887] 10.222.0.86 () {60 vars in 1143 bytes} [Tue Jun 7 14:41:50 2022] POST /identity/v3/users => generated 289 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:41:50.576252 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0c1e67-fa8b-4d5b-aa66-fde628869307 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:50.587061 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0c1e67-fa8b-4d5b-aa66-fde628869307 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:50.591696 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce79bd79-2f09-43f2-ac9f-9c3d3c5824e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:50.592393 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce79bd79-2f09-43f2-ac9f-9c3d3c5824e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:50.592844 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce79bd79-2f09-43f2-ac9f-9c3d3c5824e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:50.593125 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce79bd79-2f09-43f2-ac9f-9c3d3c5824e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:50.593853 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce79bd79-2f09-43f2-ac9f-9c3d3c5824e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:50.598274 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce79bd79-2f09-43f2-ac9f-9c3d3c5824e2 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:50.606894 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 953/1888] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:41:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:41:50.610965 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d903cec-eaf1-42c9-9c18-0eda52ca7412 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:50.621755 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d903cec-eaf1-42c9-9c18-0eda52ca7412 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:50.622397 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff0f535-286f-49cf-8c33-a508cbbafdd1 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:50.622826 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff0f535-286f-49cf-8c33-a508cbbafdd1 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:50.623148 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff0f535-286f-49cf-8c33-a508cbbafdd1 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:50.624681 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 954/1889] 10.222.0.86 () {54 vars in 921 bytes} [Tue Jun 7 14:41:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:41:50.626914 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5a12ef-10ef-4c4b-9bfb-2c40bcd1a5c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:50.627578 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5a12ef-10ef-4c4b-9bfb-2c40bcd1a5c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:50.627903 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5a12ef-10ef-4c4b-9bfb-2c40bcd1a5c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:50.628187 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5a12ef-10ef-4c4b-9bfb-2c40bcd1a5c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:50.632880 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5a12ef-10ef-4c4b-9bfb-2c40bcd1a5c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:50.632880 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5a12ef-10ef-4c4b-9bfb-2c40bcd1a5c2 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:50.641796 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 936/1890] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:41:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:41:50.646015 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff0f535-286f-49cf-8c33-a508cbbafdd1 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:50.649883 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe577e3-12af-4330-a613-d9b33ee4d456 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:50.650386 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe577e3-12af-4330-a613-d9b33ee4d456 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:50.650672 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe577e3-12af-4330-a613-d9b33ee4d456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:50.660018 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff0f535-286f-49cf-8c33-a508cbbafdd1 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:50.665649 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d784e6d-9660-4ba5-a6f9-5bbec35c978c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:50.667119 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d784e6d-9660-4ba5-a6f9-5bbec35c978c admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:50.667612 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d784e6d-9660-4ba5-a6f9-5bbec35c978c admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:50.668074 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d784e6d-9660-4ba5-a6f9-5bbec35c978c admin admin] PATH_INFO: `/v3/projects/ffcb00882d2c457181ab4cf25d1304b8/users/8681193e4e934c70a3550f04c3d45d72/roles/c17acc2a8bb348f59ba7edd22fcf0c47` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:50.672902 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-dfe577e3-12af-4330-a613-d9b33ee4d456 None None] MFA Rules not processed for user `7e042f9d4a9345bb947e6a30f64a59ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:41:50.674136 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-dfe577e3-12af-4330-a613-d9b33ee4d456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:41:50.684472 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d784e6d-9660-4ba5-a6f9-5bbec35c978c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffcb00882d2c457181ab4cf25d1304b8, user_id=8681193e4e934c70a3550f04c3d45d72, role_id=c17acc2a8bb348f59ba7edd22fcf0c47)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:50.687153 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d784e6d-9660-4ba5-a6f9-5bbec35c978c admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:50.737324 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 937/1891] 10.222.0.86 () {58 vars in 1018 bytes} [Tue Jun 7 14:41:50 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 14:41:50.748567 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe577e3-12af-4330-a613-d9b33ee4d456 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:50.749900 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-dfe577e3-12af-4330-a613-d9b33ee4d456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:41:50.765929 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe577e3-12af-4330-a613-d9b33ee4d456 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:50.768150 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 955/1892] 10.222.0.86 () {60 vars in 1482 bytes} [Tue Jun 7 14:41:50 2022] PUT /identity/v3/projects/ffcb00882d2c457181ab4cf25d1304b8/users/8681193e4e934c70a3550f04c3d45d72/roles/c17acc2a8bb348f59ba7edd22fcf0c47 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:41:50.769897 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d784e6d-9660-4ba5-a6f9-5bbec35c978c admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:50.777952 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-1d784e6d-9660-4ba5-a6f9-5bbec35c978c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:41:50.836912 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8140fda-20ab-415a-be7d-551b0486498a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e042f9d4a9345bb947e6a30f64a59ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:50.837577 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8140fda-20ab-415a-be7d-551b0486498a service placement] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:50.837873 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8140fda-20ab-415a-be7d-551b0486498a service placement] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:50.838166 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8140fda-20ab-415a-be7d-551b0486498a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:50.847011 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8140fda-20ab-415a-be7d-551b0486498a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:50.848707 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8140fda-20ab-415a-be7d-551b0486498a service placement] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:50.852961 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d784e6d-9660-4ba5-a6f9-5bbec35c978c admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:50.858695 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63670d1-027a-4ec6-a079-74b3a4ab86fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:50.859574 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63670d1-027a-4ec6-a079-74b3a4ab86fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:50.859892 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63670d1-027a-4ec6-a079-74b3a4ab86fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:50.860175 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63670d1-027a-4ec6-a079-74b3a4ab86fb admin admin] PATH_INFO: `/v3/users/d71f4ee8182f48cdae6870a6e3be97e2` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:50.861390 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63670d1-027a-4ec6-a079-74b3a4ab86fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=d71f4ee8182f48cdae6870a6e3be97e2)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:50.863408 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63670d1-027a-4ec6-a079-74b3a4ab86fb admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:50.867340 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 938/1893] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:41:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 14:41:50.868579 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e6f021-9619-417a-a4ed-ae20b1ca3b60 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:50.868867 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e6f021-9619-417a-a4ed-ae20b1ca3b60 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:50.869140 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e6f021-9619-417a-a4ed-ae20b1ca3b60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:50.899297 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-d5e6f021-9619-417a-a4ed-ae20b1ca3b60 None None] MFA Rules not processed for user `8681193e4e934c70a3550f04c3d45d72`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:41:50.900587 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-d5e6f021-9619-417a-a4ed-ae20b1ca3b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:41:50.963174 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 939/1894] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:41:50 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:41:50.976045 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e6f021-9619-417a-a4ed-ae20b1ca3b60 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:50.977401 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-d5e6f021-9619-417a-a4ed-ae20b1ca3b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:41:51.034833 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e6f021-9619-417a-a4ed-ae20b1ca3b60 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:51.039136 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ded9cdd-dc09-4cd5-bf4d-33686fbeb4c0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b910435e5585436996ba5b5aeb7184bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:51.039800 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ded9cdd-dc09-4cd5-bf4d-33686fbeb4c0 service glance] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:51.040091 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ded9cdd-dc09-4cd5-bf4d-33686fbeb4c0 service glance] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:51.040375 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ded9cdd-dc09-4cd5-bf4d-33686fbeb4c0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:51.048607 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ded9cdd-dc09-4cd5-bf4d-33686fbeb4c0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:51.050018 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ded9cdd-dc09-4cd5-bf4d-33686fbeb4c0 service glance] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:51.060233 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 940/1895] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:41:50 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 14:41:51.075772 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-a63670d1-027a-4ec6-a079-74b3a4ab86fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd71f4ee8182f48cdae6870a6e3be97e2'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:51.076501 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-a63670d1-027a-4ec6-a079-74b3a4ab86fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd71f4ee8182f48cdae6870a6e3be97e2'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:51.085555 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-a63670d1-027a-4ec6-a079-74b3a4ab86fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd71f4ee8182f48cdae6870a6e3be97e2'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:51.097401 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-a63670d1-027a-4ec6-a079-74b3a4ab86fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd71f4ee8182f48cdae6870a6e3be97e2'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:51.098086 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-a63670d1-027a-4ec6-a079-74b3a4ab86fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd71f4ee8182f48cdae6870a6e3be97e2'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:51.197125 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 956/1896] 10.222.0.86 () {58 vars in 1223 bytes} [Tue Jun 7 14:41:50 2022] DELETE /identity/v3/users/d71f4ee8182f48cdae6870a6e3be97e2 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:41:51.256882 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:41:51.302699 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:41:51.709587 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ded9cdd-dc09-4cd5-bf4d-33686fbeb4c0 service glance] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:51.720786 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ded9cdd-dc09-4cd5-bf4d-33686fbeb4c0 service glance] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:51.777497 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deef999-a864-4909-8beb-a911942c93d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:51.778355 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deef999-a864-4909-8beb-a911942c93d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:51.778642 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deef999-a864-4909-8beb-a911942c93d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:51.778915 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deef999-a864-4909-8beb-a911942c93d5 admin admin] PATH_INFO: `/v3/projects/a38ec3eb18bc42d2b83392f305fcfcc8` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:51.780122 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1deef999-a864-4909-8beb-a911942c93d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a38ec3eb18bc42d2b83392f305fcfcc8)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:51.782012 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1deef999-a864-4909-8beb-a911942c93d5 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:51.909107 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-1deef999-a864-4909-8beb-a911942c93d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a38ec3eb18bc42d2b83392f305fcfcc8', 'request_id': 'req-1deef999-a864-4909-8beb-a911942c93d5'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:51.915889 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-1deef999-a864-4909-8beb-a911942c93d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a38ec3eb18bc42d2b83392f305fcfcc8', 'request_id': 'req-1deef999-a864-4909-8beb-a911942c93d5'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:52.014891 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-1deef999-a864-4909-8beb-a911942c93d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a38ec3eb18bc42d2b83392f305fcfcc8', 'request_id': 'req-1deef999-a864-4909-8beb-a911942c93d5'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:52.026122 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-1deef999-a864-4909-8beb-a911942c93d5 admin admin] The token cache is being invalidate because project a38ec3eb18bc42d2b83392f305fcfcc8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:41:52.026411 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-1deef999-a864-4909-8beb-a911942c93d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:52.027281 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-1deef999-a864-4909-8beb-a911942c93d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:52.028669 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 941/1897] 10.222.0.86 () {58 vars in 1232 bytes} [Tue Jun 7 14:41:51 2022] DELETE /identity/v3/projects/a38ec3eb18bc42d2b83392f305fcfcc8 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:41:52.033623 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fe5c6c-8078-420d-b235-23d53504a6d7 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:52.034049 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fe5c6c-8078-420d-b235-23d53504a6d7 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:52.034264 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fe5c6c-8078-420d-b235-23d53504a6d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:52.054511 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-44fe5c6c-8078-420d-b235-23d53504a6d7 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:41:52.055712 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-44fe5c6c-8078-420d-b235-23d53504a6d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:41:52.096583 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:41:52.115437 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 957/1898] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:41:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:41:52.124843 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24902d3-4d7b-4d2e-8e80-689e34f16ac9 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:52.125132 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24902d3-4d7b-4d2e-8e80-689e34f16ac9 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:52.125410 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24902d3-4d7b-4d2e-8e80-689e34f16ac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:52.143389 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-c24902d3-4d7b-4d2e-8e80-689e34f16ac9 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:41:52.144987 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-c24902d3-4d7b-4d2e-8e80-689e34f16ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:41:52.153402 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 942/1899] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:41:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:41:52.157632 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fe5c6c-8078-420d-b235-23d53504a6d7 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:52.167906 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fe5c6c-8078-420d-b235-23d53504a6d7 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:52.172442 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880d4e0c-d6d5-432d-9d56-c3b5ff2e2bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:52.173090 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880d4e0c-d6d5-432d-9d56-c3b5ff2e2bde admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:52.173373 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880d4e0c-d6d5-432d-9d56-c3b5ff2e2bde admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:52.173687 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880d4e0c-d6d5-432d-9d56-c3b5ff2e2bde admin admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:52.174411 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880d4e0c-d6d5-432d-9d56-c3b5ff2e2bde admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:41:52.174783 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880d4e0c-d6d5-432d-9d56-c3b5ff2e2bde admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:52.176471 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880d4e0c-d6d5-432d-9d56-c3b5ff2e2bde admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:52.190583 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 958/1900] 10.222.0.86 () {58 vars in 1152 bytes} [Tue Jun 7 14:41:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:41:52.195572 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24902d3-4d7b-4d2e-8e80-689e34f16ac9 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:52.206236 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24902d3-4d7b-4d2e-8e80-689e34f16ac9 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:52.212062 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cffdbcd-56e3-4f01-be86-900411c9784e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:52.217205 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cffdbcd-56e3-4f01-be86-900411c9784e admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:52.217205 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cffdbcd-56e3-4f01-be86-900411c9784e admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:52.217205 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cffdbcd-56e3-4f01-be86-900411c9784e admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:52.217205 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cffdbcd-56e3-4f01-be86-900411c9784e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:52.217205 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cffdbcd-56e3-4f01-be86-900411c9784e admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:52.331408 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 943/1901] 10.222.0.86 () {60 vars in 1152 bytes} [Tue Jun 7 14:41:52 2022] POST /identity/v3/projects => generated 385 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:41:52.331521 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880d4e0c-d6d5-432d-9d56-c3b5ff2e2bde admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:52.336598 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880d4e0c-d6d5-432d-9d56-c3b5ff2e2bde admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:52.393744 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5ae1e9-3000-4a56-a502-febb3ba35337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:52.394675 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5ae1e9-3000-4a56-a502-febb3ba35337 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:52.394963 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5ae1e9-3000-4a56-a502-febb3ba35337 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:52.395242 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5ae1e9-3000-4a56-a502-febb3ba35337 admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:52.395980 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5ae1e9-3000-4a56-a502-febb3ba35337 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:52.398498 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5ae1e9-3000-4a56-a502-febb3ba35337 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:52.600470 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 959/1902] 10.222.0.86 () {60 vars in 1143 bytes} [Tue Jun 7 14:41:52 2022] POST /identity/v3/users => generated 293 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:41:52.606593 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cffdbcd-56e3-4f01-be86-900411c9784e admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:52.617422 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cffdbcd-56e3-4f01-be86-900411c9784e admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:52.622027 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2607bb8-f88b-4bc1-81f5-5fc9dcb860e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:52.622684 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2607bb8-f88b-4bc1-81f5-5fc9dcb860e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:52.622971 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2607bb8-f88b-4bc1-81f5-5fc9dcb860e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:52.623248 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2607bb8-f88b-4bc1-81f5-5fc9dcb860e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:52.624018 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2607bb8-f88b-4bc1-81f5-5fc9dcb860e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:52.625601 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2607bb8-f88b-4bc1-81f5-5fc9dcb860e4 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:52.636452 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 944/1903] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:41:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:41:52.646874 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5ae1e9-3000-4a56-a502-febb3ba35337 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:52.657512 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5ae1e9-3000-4a56-a502-febb3ba35337 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:52.662216 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dc8579-d797-4045-9ac3-53c85a918dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:52.662908 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dc8579-d797-4045-9ac3-53c85a918dc4 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:52.663201 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dc8579-d797-4045-9ac3-53c85a918dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:52.663481 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dc8579-d797-4045-9ac3-53c85a918dc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:52.664251 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dc8579-d797-4045-9ac3-53c85a918dc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:52.665843 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dc8579-d797-4045-9ac3-53c85a918dc4 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:52.675712 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 960/1904] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:41:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:41:52.680051 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2607bb8-f88b-4bc1-81f5-5fc9dcb860e4 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:52.692527 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2607bb8-f88b-4bc1-81f5-5fc9dcb860e4 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:52.697662 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f20fe94-2e26-4918-8193-3f889f6e8376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:52.700420 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f20fe94-2e26-4918-8193-3f889f6e8376 admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:52.700420 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f20fe94-2e26-4918-8193-3f889f6e8376 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:52.700420 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f20fe94-2e26-4918-8193-3f889f6e8376 admin admin] PATH_INFO: `/v3/projects/c9f8c04cd5d3409e951fb986b0475048/users/67fc4f960bf14c1cb4aaac015bcfa4ba/roles/c17acc2a8bb348f59ba7edd22fcf0c47` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:52.716709 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f20fe94-2e26-4918-8193-3f889f6e8376 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9f8c04cd5d3409e951fb986b0475048, user_id=67fc4f960bf14c1cb4aaac015bcfa4ba, role_id=c17acc2a8bb348f59ba7edd22fcf0c47)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:52.719410 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f20fe94-2e26-4918-8193-3f889f6e8376 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:52.856940 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 945/1905] 10.222.0.86 () {60 vars in 1482 bytes} [Tue Jun 7 14:41:52 2022] PUT /identity/v3/projects/c9f8c04cd5d3409e951fb986b0475048/users/67fc4f960bf14c1cb4aaac015bcfa4ba/roles/c17acc2a8bb348f59ba7edd22fcf0c47 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:41:52.867007 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e67bf81-ecbf-4151-ab9c-57e0cff57f72 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:52.867325 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e67bf81-ecbf-4151-ab9c-57e0cff57f72 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:52.867607 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e67bf81-ecbf-4151-ab9c-57e0cff57f72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:52.901420 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-2e67bf81-ecbf-4151-ab9c-57e0cff57f72 None None] MFA Rules not processed for user `67fc4f960bf14c1cb4aaac015bcfa4ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:41:52.907154 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-2e67bf81-ecbf-4151-ab9c-57e0cff57f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:41:52.912456 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:41:52.966726 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 961/1906] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:41:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:41:52.977649 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f20fe94-2e26-4918-8193-3f889f6e8376 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:52.979270 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-3f20fe94-2e26-4918-8193-3f889f6e8376 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:41:53.060938 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f20fe94-2e26-4918-8193-3f889f6e8376 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:53.066439 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fd2e67-41d0-40d4-b861-474af87c1ec7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99cfb70f54c45c8870369359da20378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:53.067083 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fd2e67-41d0-40d4-b861-474af87c1ec7 service nova] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:53.067367 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fd2e67-41d0-40d4-b861-474af87c1ec7 service nova] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:53.067641 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fd2e67-41d0-40d4-b861-474af87c1ec7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:53.075889 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fd2e67-41d0-40d4-b861-474af87c1ec7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:53.077460 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fd2e67-41d0-40d4-b861-474af87c1ec7 service nova] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:53.086685 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 946/1907] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:41:52 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:41:57.269633 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e67bf81-ecbf-4151-ab9c-57e0cff57f72 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:57.271111 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-2e67bf81-ecbf-4151-ab9c-57e0cff57f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:41:57.337699 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e67bf81-ecbf-4151-ab9c-57e0cff57f72 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:57.342447 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8574c435-0572-4f4c-b943-57783076587a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:57.343320 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8574c435-0572-4f4c-b943-57783076587a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:57.343603 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8574c435-0572-4f4c-b943-57783076587a admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:57.344034 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8574c435-0572-4f4c-b943-57783076587a admin admin] PATH_INFO: `/v3/users/b69af0cf7bfd49f18d0a20cbd16d31a9` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:57.345248 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8574c435-0572-4f4c-b943-57783076587a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b69af0cf7bfd49f18d0a20cbd16d31a9)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:57.347210 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8574c435-0572-4f4c-b943-57783076587a admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:57.601040 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-8574c435-0572-4f4c-b943-57783076587a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b69af0cf7bfd49f18d0a20cbd16d31a9'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:57.601609 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-8574c435-0572-4f4c-b943-57783076587a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b69af0cf7bfd49f18d0a20cbd16d31a9'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:57.608947 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-8574c435-0572-4f4c-b943-57783076587a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b69af0cf7bfd49f18d0a20cbd16d31a9'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:57.621982 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-8574c435-0572-4f4c-b943-57783076587a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b69af0cf7bfd49f18d0a20cbd16d31a9'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:57.622702 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-8574c435-0572-4f4c-b943-57783076587a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b69af0cf7bfd49f18d0a20cbd16d31a9'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:57.720122 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 962/1908] 10.222.0.86 () {58 vars in 1223 bytes} [Tue Jun 7 14:41:57 2022] DELETE /identity/v3/users/b69af0cf7bfd49f18d0a20cbd16d31a9 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:41:57.724881 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30557abe-5838-42ab-a806-fb7da278c4bf None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:57.725310 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30557abe-5838-42ab-a806-fb7da278c4bf None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:57.726144 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30557abe-5838-42ab-a806-fb7da278c4bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:57.739813 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:41:57.746833 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-30557abe-5838-42ab-a806-fb7da278c4bf None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:41:57.748237 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-30557abe-5838-42ab-a806-fb7da278c4bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:41:57.812757 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 947/1909] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:41:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:41:57.825253 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8574c435-0572-4f4c-b943-57783076587a admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:57.826722 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-8574c435-0572-4f4c-b943-57783076587a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:41:57.867557 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:41:57.891001 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8574c435-0572-4f4c-b943-57783076587a admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:57.895188 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43cf015-c30e-49eb-a79a-df4c2647f1b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dda603ec5517460a83c333db2af804d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:57.895951 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43cf015-c30e-49eb-a79a-df4c2647f1b4 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:57.896240 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43cf015-c30e-49eb-a79a-df4c2647f1b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:57.896545 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43cf015-c30e-49eb-a79a-df4c2647f1b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:57.906571 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43cf015-c30e-49eb-a79a-df4c2647f1b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:57.908198 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43cf015-c30e-49eb-a79a-df4c2647f1b4 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:57.918231 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 963/1910] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:41:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:41:58.314895 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30557abe-5838-42ab-a806-fb7da278c4bf None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:58.316356 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-30557abe-5838-42ab-a806-fb7da278c4bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:41:58.329222 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30557abe-5838-42ab-a806-fb7da278c4bf None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:58.334125 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06be2f4-39d2-4d8a-8ad1-a34d3cecc115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:58.335369 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06be2f4-39d2-4d8a-8ad1-a34d3cecc115 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:58.335648 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06be2f4-39d2-4d8a-8ad1-a34d3cecc115 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:58.335953 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06be2f4-39d2-4d8a-8ad1-a34d3cecc115 admin admin] PATH_INFO: `/v3/users/7b426b66f82347c9a9753726bb60d441` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:58.337147 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06be2f4-39d2-4d8a-8ad1-a34d3cecc115 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b426b66f82347c9a9753726bb60d441)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:58.339019 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06be2f4-39d2-4d8a-8ad1-a34d3cecc115 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:58.390072 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43cf015-c30e-49eb-a79a-df4c2647f1b4 service neutron] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:58.391533 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-c43cf015-c30e-49eb-a79a-df4c2647f1b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:41:58.404875 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43cf015-c30e-49eb-a79a-df4c2647f1b4 service neutron] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:58.409599 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f3368a-ba12-4ca0-8782-6692d2d5cdc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:58.410460 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f3368a-ba12-4ca0-8782-6692d2d5cdc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:58.410744 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f3368a-ba12-4ca0-8782-6692d2d5cdc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:58.414430 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f3368a-ba12-4ca0-8782-6692d2d5cdc6 admin admin] PATH_INFO: `/v3/projects/67c34e5bb0a244378a367755ae3d20ea` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:58.414430 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f3368a-ba12-4ca0-8782-6692d2d5cdc6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67c34e5bb0a244378a367755ae3d20ea)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:58.414430 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f3368a-ba12-4ca0-8782-6692d2d5cdc6 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:58.557883 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-d06be2f4-39d2-4d8a-8ad1-a34d3cecc115 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b426b66f82347c9a9753726bb60d441'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:58.558099 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-30f3368a-ba12-4ca0-8782-6692d2d5cdc6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67c34e5bb0a244378a367755ae3d20ea', 'request_id': 'req-30f3368a-ba12-4ca0-8782-6692d2d5cdc6'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:58.564397 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-30f3368a-ba12-4ca0-8782-6692d2d5cdc6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67c34e5bb0a244378a367755ae3d20ea', 'request_id': 'req-30f3368a-ba12-4ca0-8782-6692d2d5cdc6'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:58.565291 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-d06be2f4-39d2-4d8a-8ad1-a34d3cecc115 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b426b66f82347c9a9753726bb60d441'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:58.565987 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-d06be2f4-39d2-4d8a-8ad1-a34d3cecc115 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b426b66f82347c9a9753726bb60d441'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:58.578286 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-d06be2f4-39d2-4d8a-8ad1-a34d3cecc115 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b426b66f82347c9a9753726bb60d441'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:58.578974 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-d06be2f4-39d2-4d8a-8ad1-a34d3cecc115 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b426b66f82347c9a9753726bb60d441'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:58.639296 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-30f3368a-ba12-4ca0-8782-6692d2d5cdc6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67c34e5bb0a244378a367755ae3d20ea', 'request_id': 'req-30f3368a-ba12-4ca0-8782-6692d2d5cdc6'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:58.651244 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-30f3368a-ba12-4ca0-8782-6692d2d5cdc6 admin admin] The token cache is being invalidate because project 67c34e5bb0a244378a367755ae3d20ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:41:58.651539 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-30f3368a-ba12-4ca0-8782-6692d2d5cdc6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:58.652215 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-30f3368a-ba12-4ca0-8782-6692d2d5cdc6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:58.653814 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 964/1911] 10.222.0.86 () {58 vars in 1232 bytes} [Tue Jun 7 14:41:58 2022] DELETE /identity/v3/projects/67c34e5bb0a244378a367755ae3d20ea => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 14:41:58.658556 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfad387-02e4-48d3-95e0-a0c1d3c58eb5 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:58.658862 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfad387-02e4-48d3-95e0-a0c1d3c58eb5 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:58.659133 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfad387-02e4-48d3-95e0-a0c1d3c58eb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:58.678008 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-cbfad387-02e4-48d3-95e0-a0c1d3c58eb5 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:41:58.679869 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-cbfad387-02e4-48d3-95e0-a0c1d3c58eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:41:58.740681 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 948/1912] 10.222.0.86 () {58 vars in 1223 bytes} [Tue Jun 7 14:41:58 2022] DELETE /identity/v3/users/7b426b66f82347c9a9753726bb60d441 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:41:58.746037 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edf6824-4944-498f-aa2d-6dcea3c5f199 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:58.746401 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edf6824-4944-498f-aa2d-6dcea3c5f199 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:58.746790 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edf6824-4944-498f-aa2d-6dcea3c5f199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:58.752184 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 965/1913] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:41:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 14:41:58.760120 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67e7e88-6d67-4ce5-bd99-ebbdf4b42a21 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:58.760501 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67e7e88-6d67-4ce5-bd99-ebbdf4b42a21 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:58.760837 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67e7e88-6d67-4ce5-bd99-ebbdf4b42a21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:58.764297 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-5edf6824-4944-498f-aa2d-6dcea3c5f199 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:41:58.765525 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-5edf6824-4944-498f-aa2d-6dcea3c5f199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:41:58.780129 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-b67e7e88-6d67-4ce5-bd99-ebbdf4b42a21 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:41:58.781500 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-b67e7e88-6d67-4ce5-bd99-ebbdf4b42a21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:41:58.831773 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 949/1914] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:41:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 14:41:58.837461 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:41:58.842804 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edf6824-4944-498f-aa2d-6dcea3c5f199 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:58.843908 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-5edf6824-4944-498f-aa2d-6dcea3c5f199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:41:58.846900 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 966/1915] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:41:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 14:41:58.851427 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67e7e88-6d67-4ce5-bd99-ebbdf4b42a21 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:58.860448 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67e7e88-6d67-4ce5-bd99-ebbdf4b42a21 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:58.865094 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82912da4-a877-4390-9021-319563617f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:58.865741 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82912da4-a877-4390-9021-319563617f57 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:58.866113 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82912da4-a877-4390-9021-319563617f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:58.866420 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82912da4-a877-4390-9021-319563617f57 admin admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:58.867147 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82912da4-a877-4390-9021-319563617f57 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:41:58.867459 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82912da4-a877-4390-9021-319563617f57 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:58.869105 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82912da4-a877-4390-9021-319563617f57 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:58.869221 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:41:58.880657 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 967/1916] 10.222.0.86 () {58 vars in 1152 bytes} [Tue Jun 7 14:41:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:41:58.885865 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82912da4-a877-4390-9021-319563617f57 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:58.895506 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82912da4-a877-4390-9021-319563617f57 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:58.901116 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca6defa-7f11-4366-9d2b-4baf700e650e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:58.901777 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca6defa-7f11-4366-9d2b-4baf700e650e admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:58.902063 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca6defa-7f11-4366-9d2b-4baf700e650e admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:58.902340 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca6defa-7f11-4366-9d2b-4baf700e650e admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:58.903056 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca6defa-7f11-4366-9d2b-4baf700e650e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:58.905010 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca6defa-7f11-4366-9d2b-4baf700e650e admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:58.907260 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edf6824-4944-498f-aa2d-6dcea3c5f199 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:58.918074 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fe1a9e-7aff-4ca5-9501-adda32399850 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dda603ec5517460a83c333db2af804d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:58.918074 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fe1a9e-7aff-4ca5-9501-adda32399850 service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:58.918074 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fe1a9e-7aff-4ca5-9501-adda32399850 service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:58.918074 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fe1a9e-7aff-4ca5-9501-adda32399850 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:58.921963 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fe1a9e-7aff-4ca5-9501-adda32399850 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:58.923390 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fe1a9e-7aff-4ca5-9501-adda32399850 service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:58.933434 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 950/1917] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:41:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 14:41:59.042945 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 968/1918] 10.222.0.86 () {60 vars in 1152 bytes} [Tue Jun 7 14:41:58 2022] POST /identity/v3/projects => generated 383 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:41:59.046408 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fe1a9e-7aff-4ca5-9501-adda32399850 service neutron] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:59.061416 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fe1a9e-7aff-4ca5-9501-adda32399850 service neutron] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:59.123746 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71443838-e51f-4864-8f05-e4c8ce8df92c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:59.124449 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71443838-e51f-4864-8f05-e4c8ce8df92c admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:59.124738 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71443838-e51f-4864-8f05-e4c8ce8df92c admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:59.125020 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71443838-e51f-4864-8f05-e4c8ce8df92c admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:59.125719 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71443838-e51f-4864-8f05-e4c8ce8df92c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:59.127641 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71443838-e51f-4864-8f05-e4c8ce8df92c admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:59.235464 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 951/1919] 10.222.0.86 () {60 vars in 1143 bytes} [Tue Jun 7 14:41:59 2022] POST /identity/v3/users => generated 292 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:41:59.239438 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca6defa-7f11-4366-9d2b-4baf700e650e admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:59.250381 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca6defa-7f11-4366-9d2b-4baf700e650e admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:59.255787 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36280e6b-6082-46a6-89c5-a8620917f201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:59.257151 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36280e6b-6082-46a6-89c5-a8620917f201 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:59.257448 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36280e6b-6082-46a6-89c5-a8620917f201 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:59.257728 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36280e6b-6082-46a6-89c5-a8620917f201 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:59.258532 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36280e6b-6082-46a6-89c5-a8620917f201 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:59.260150 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36280e6b-6082-46a6-89c5-a8620917f201 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:59.270366 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 969/1920] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:41:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:41:59.274525 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71443838-e51f-4864-8f05-e4c8ce8df92c admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:59.285298 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71443838-e51f-4864-8f05-e4c8ce8df92c admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:59.290923 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17558c2-e3ba-4e69-8f3b-ce27f1e57e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:59.291600 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17558c2-e3ba-4e69-8f3b-ce27f1e57e29 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:59.291924 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17558c2-e3ba-4e69-8f3b-ce27f1e57e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:59.292207 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17558c2-e3ba-4e69-8f3b-ce27f1e57e29 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:59.292952 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17558c2-e3ba-4e69-8f3b-ce27f1e57e29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:59.294556 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17558c2-e3ba-4e69-8f3b-ce27f1e57e29 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:59.308900 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 952/1921] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:41:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:41:59.313714 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36280e6b-6082-46a6-89c5-a8620917f201 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:59.323353 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36280e6b-6082-46a6-89c5-a8620917f201 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:59.328769 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a431eac5-4000-4ece-84f0-545d680246b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:59.330094 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a431eac5-4000-4ece-84f0-545d680246b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:59.330395 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a431eac5-4000-4ece-84f0-545d680246b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:59.330499 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a431eac5-4000-4ece-84f0-545d680246b2 admin admin] PATH_INFO: `/v3/projects/796ad8d89a62469cae1953b7fb899edd/users/4116d297271d4dd19c06d54c24d4b997/roles/c17acc2a8bb348f59ba7edd22fcf0c47` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:59.352157 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a431eac5-4000-4ece-84f0-545d680246b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=796ad8d89a62469cae1953b7fb899edd, user_id=4116d297271d4dd19c06d54c24d4b997, role_id=c17acc2a8bb348f59ba7edd22fcf0c47)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:59.354866 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a431eac5-4000-4ece-84f0-545d680246b2 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:59.371851 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17558c2-e3ba-4e69-8f3b-ce27f1e57e29 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:59.375070 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-e17558c2-e3ba-4e69-8f3b-ce27f1e57e29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:41:59.390559 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17558c2-e3ba-4e69-8f3b-ce27f1e57e29 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:59.396654 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32334936-2a4d-464c-add3-faf35017d11b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:59.398205 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32334936-2a4d-464c-add3-faf35017d11b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:59.398559 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32334936-2a4d-464c-add3-faf35017d11b admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:59.398762 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32334936-2a4d-464c-add3-faf35017d11b admin admin] PATH_INFO: `/v3/projects/7ff43c2253eb4c39835106ed3231f550` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:59.400076 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32334936-2a4d-464c-add3-faf35017d11b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ff43c2253eb4c39835106ed3231f550)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:59.402343 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32334936-2a4d-464c-add3-faf35017d11b admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:59.463418 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 970/1922] 10.222.0.86 () {60 vars in 1482 bytes} [Tue Jun 7 14:41:59 2022] PUT /identity/v3/projects/796ad8d89a62469cae1953b7fb899edd/users/4116d297271d4dd19c06d54c24d4b997/roles/c17acc2a8bb348f59ba7edd22fcf0c47 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:41:59.474463 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e06b701-146a-4337-b9bb-c9f9b30b846d None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:59.474757 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e06b701-146a-4337-b9bb-c9f9b30b846d None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:59.475039 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e06b701-146a-4337-b9bb-c9f9b30b846d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:59.500299 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-0e06b701-146a-4337-b9bb-c9f9b30b846d None None] MFA Rules not processed for user `4116d297271d4dd19c06d54c24d4b997`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:41:59.511674 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-0e06b701-146a-4337-b9bb-c9f9b30b846d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:41:59.553306 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-32334936-2a4d-464c-add3-faf35017d11b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ff43c2253eb4c39835106ed3231f550', 'request_id': 'req-32334936-2a4d-464c-add3-faf35017d11b'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:59.561389 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-32334936-2a4d-464c-add3-faf35017d11b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ff43c2253eb4c39835106ed3231f550', 'request_id': 'req-32334936-2a4d-464c-add3-faf35017d11b'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:59.575699 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 971/1923] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:41:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 14:41:59.587052 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e06b701-146a-4337-b9bb-c9f9b30b846d None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:59.588390 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-0e06b701-146a-4337-b9bb-c9f9b30b846d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:41:59.645427 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e06b701-146a-4337-b9bb-c9f9b30b846d None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:59.650228 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-32334936-2a4d-464c-add3-faf35017d11b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ff43c2253eb4c39835106ed3231f550', 'request_id': 'req-32334936-2a4d-464c-add3-faf35017d11b'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:59.663218 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-32334936-2a4d-464c-add3-faf35017d11b admin admin] The token cache is being invalidate because project 7ff43c2253eb4c39835106ed3231f550 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:41:59.663872 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-32334936-2a4d-464c-add3-faf35017d11b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:59.664789 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-32334936-2a4d-464c-add3-faf35017d11b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:59.667280 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 953/1924] 10.222.0.86 () {58 vars in 1232 bytes} [Tue Jun 7 14:41:59 2022] DELETE /identity/v3/projects/7ff43c2253eb4c39835106ed3231f550 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:41:59.675437 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32334936-2a4d-464c-add3-faf35017d11b admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:41:59.676622 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:41:59.676879 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-32334936-2a4d-464c-add3-faf35017d11b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:41:59.696135 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc71e49-01f7-47e4-be6e-4ceb2238b4e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af5a95620a4b43538abfe09eed4bf115', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:59.696791 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc71e49-01f7-47e4-be6e-4ceb2238b4e8 service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:59.697081 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc71e49-01f7-47e4-be6e-4ceb2238b4e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:59.697432 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc71e49-01f7-47e4-be6e-4ceb2238b4e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:59.699228 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-fbc71e49-01f7-47e4-be6e-4ceb2238b4e8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:41:59.705613 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:41:59.742716 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32334936-2a4d-464c-add3-faf35017d11b admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:41:59.747626 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0144f2c-c4f5-41a1-823c-45467aa9e1a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:41:59.748565 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0144f2c-c4f5-41a1-823c-45467aa9e1a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:41:59.748861 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0144f2c-c4f5-41a1-823c-45467aa9e1a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:41:59.749145 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0144f2c-c4f5-41a1-823c-45467aa9e1a5 admin admin] PATH_INFO: `/v3/users/eb3087e4a11349bfa3301107b9f2002b` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:41:59.750370 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0144f2c-c4f5-41a1-823c-45467aa9e1a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb3087e4a11349bfa3301107b9f2002b)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:59.752585 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0144f2c-c4f5-41a1-823c-45467aa9e1a5 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:59.775718 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc71e49-01f7-47e4-be6e-4ceb2238b4e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:41:59.778946 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc71e49-01f7-47e4-be6e-4ceb2238b4e8 service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:41:59.792615 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 972/1925] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:41:59 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:41:59.973483 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-f0144f2c-c4f5-41a1-823c-45467aa9e1a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb3087e4a11349bfa3301107b9f2002b'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:59.980870 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-f0144f2c-c4f5-41a1-823c-45467aa9e1a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb3087e4a11349bfa3301107b9f2002b'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:59.981567 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-f0144f2c-c4f5-41a1-823c-45467aa9e1a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb3087e4a11349bfa3301107b9f2002b'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:59.997347 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-f0144f2c-c4f5-41a1-823c-45467aa9e1a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb3087e4a11349bfa3301107b9f2002b'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:41:59.997347 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-f0144f2c-c4f5-41a1-823c-45467aa9e1a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb3087e4a11349bfa3301107b9f2002b'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:00.107794 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 954/1926] 10.222.0.86 () {58 vars in 1223 bytes} [Tue Jun 7 14:41:59 2022] DELETE /identity/v3/users/eb3087e4a11349bfa3301107b9f2002b => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 14:42:00.550474 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc71e49-01f7-47e4-be6e-4ceb2238b4e8 service cinder] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:00.553018 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-fbc71e49-01f7-47e4-be6e-4ceb2238b4e8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:42:00.568301 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc71e49-01f7-47e4-be6e-4ceb2238b4e8 service cinder] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:00.628147 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3727dcc9-954a-4a09-bbee-559af71a4be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:00.629031 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3727dcc9-954a-4a09-bbee-559af71a4be7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:00.629323 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3727dcc9-954a-4a09-bbee-559af71a4be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:00.629615 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3727dcc9-954a-4a09-bbee-559af71a4be7 admin admin] PATH_INFO: `/v3/users/67fc4f960bf14c1cb4aaac015bcfa4ba` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:00.630922 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3727dcc9-954a-4a09-bbee-559af71a4be7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67fc4f960bf14c1cb4aaac015bcfa4ba)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:00.633473 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3727dcc9-954a-4a09-bbee-559af71a4be7 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:00.651342 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0144f2c-c4f5-41a1-823c-45467aa9e1a5 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:00.652861 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-f0144f2c-c4f5-41a1-823c-45467aa9e1a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:42:00.681768 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0144f2c-c4f5-41a1-823c-45467aa9e1a5 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:00.687465 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b84297-5eea-4559-b97a-c282b07d7ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:00.688429 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b84297-5eea-4559-b97a-c282b07d7ec9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:00.688712 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b84297-5eea-4559-b97a-c282b07d7ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:00.689018 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b84297-5eea-4559-b97a-c282b07d7ec9 admin admin] PATH_INFO: `/v3/projects/358309c2745344508586219b87026ff0` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:00.691212 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b84297-5eea-4559-b97a-c282b07d7ec9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=358309c2745344508586219b87026ff0)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:00.693284 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b84297-5eea-4559-b97a-c282b07d7ec9 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:00.868720 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-20b84297-5eea-4559-b97a-c282b07d7ec9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '358309c2745344508586219b87026ff0', 'request_id': 'req-20b84297-5eea-4559-b97a-c282b07d7ec9'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:00.871765 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-3727dcc9-954a-4a09-bbee-559af71a4be7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67fc4f960bf14c1cb4aaac015bcfa4ba'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:00.872455 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-3727dcc9-954a-4a09-bbee-559af71a4be7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67fc4f960bf14c1cb4aaac015bcfa4ba'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:00.874809 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-20b84297-5eea-4559-b97a-c282b07d7ec9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '358309c2745344508586219b87026ff0', 'request_id': 'req-20b84297-5eea-4559-b97a-c282b07d7ec9'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:00.879793 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-3727dcc9-954a-4a09-bbee-559af71a4be7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67fc4f960bf14c1cb4aaac015bcfa4ba'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:00.891424 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-3727dcc9-954a-4a09-bbee-559af71a4be7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67fc4f960bf14c1cb4aaac015bcfa4ba'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:00.892129 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-3727dcc9-954a-4a09-bbee-559af71a4be7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67fc4f960bf14c1cb4aaac015bcfa4ba'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:00.979290 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-20b84297-5eea-4559-b97a-c282b07d7ec9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '358309c2745344508586219b87026ff0', 'request_id': 'req-20b84297-5eea-4559-b97a-c282b07d7ec9'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:00.991393 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-20b84297-5eea-4559-b97a-c282b07d7ec9 admin admin] The token cache is being invalidate because project 358309c2745344508586219b87026ff0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:42:00.991866 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-20b84297-5eea-4559-b97a-c282b07d7ec9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:00.992489 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-20b84297-5eea-4559-b97a-c282b07d7ec9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:00.994060 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 955/1927] 10.222.0.86 () {58 vars in 1232 bytes} [Tue Jun 7 14:42:00 2022] DELETE /identity/v3/projects/358309c2745344508586219b87026ff0 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:42:00.998955 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b46ccb1-b813-4ccb-a1ce-7b5015e0c400 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:00.999418 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b46ccb1-b813-4ccb-a1ce-7b5015e0c400 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:00.999704 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b46ccb1-b813-4ccb-a1ce-7b5015e0c400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:01.020103 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-6b46ccb1-b813-4ccb-a1ce-7b5015e0c400 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:42:01.021417 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-6b46ccb1-b813-4ccb-a1ce-7b5015e0c400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:42:01.040290 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 973/1928] 10.222.0.86 () {58 vars in 1223 bytes} [Tue Jun 7 14:42:00 2022] DELETE /identity/v3/users/67fc4f960bf14c1cb4aaac015bcfa4ba => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:42:01.044751 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:42:01.045028 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7cb6a7-381d-454d-b22b-714a6233979a None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:01.045338 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7cb6a7-381d-454d-b22b-714a6233979a None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:01.045609 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7cb6a7-381d-454d-b22b-714a6233979a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:01.060392 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:42:01.069375 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-8a7cb6a7-381d-454d-b22b-714a6233979a None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:42:01.070992 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-8a7cb6a7-381d-454d-b22b-714a6233979a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:42:01.092937 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 956/1929] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:42:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 14:42:01.101305 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28150c1e-b406-4650-b563-702119b1d914 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:01.101664 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28150c1e-b406-4650-b563-702119b1d914 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:01.101974 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28150c1e-b406-4650-b563-702119b1d914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:01.120098 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-28150c1e-b406-4650-b563-702119b1d914 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:42:01.122611 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-28150c1e-b406-4650-b563-702119b1d914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:42:01.138327 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 974/1930] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:42:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:42:01.148654 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7cb6a7-381d-454d-b22b-714a6233979a None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:01.150003 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-8a7cb6a7-381d-454d-b22b-714a6233979a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:42:01.182019 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 957/1931] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:42:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 14:42:01.186428 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28150c1e-b406-4650-b563-702119b1d914 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:01.195829 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28150c1e-b406-4650-b563-702119b1d914 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:01.201250 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac65e312-3db0-4f25-9967-a92cbf3bfab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:01.201916 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac65e312-3db0-4f25-9967-a92cbf3bfab5 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:01.202205 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac65e312-3db0-4f25-9967-a92cbf3bfab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:01.202497 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac65e312-3db0-4f25-9967-a92cbf3bfab5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:01.203366 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac65e312-3db0-4f25-9967-a92cbf3bfab5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:42:01.203593 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac65e312-3db0-4f25-9967-a92cbf3bfab5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:01.205195 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac65e312-3db0-4f25-9967-a92cbf3bfab5 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:01.208559 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7cb6a7-381d-454d-b22b-714a6233979a None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:01.212325 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2241df8e-a36f-4455-8385-03c2ad9db9b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dda603ec5517460a83c333db2af804d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:01.213023 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2241df8e-a36f-4455-8385-03c2ad9db9b3 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:01.213313 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2241df8e-a36f-4455-8385-03c2ad9db9b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:01.213595 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2241df8e-a36f-4455-8385-03c2ad9db9b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:01.217150 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 958/1932] 10.222.0.86 () {58 vars in 1152 bytes} [Tue Jun 7 14:42:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:42:01.221282 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac65e312-3db0-4f25-9967-a92cbf3bfab5 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:01.222863 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2241df8e-a36f-4455-8385-03c2ad9db9b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:01.224333 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2241df8e-a36f-4455-8385-03c2ad9db9b3 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:01.231921 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac65e312-3db0-4f25-9967-a92cbf3bfab5 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:01.237493 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 975/1933] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:42:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 14:42:01.237604 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de308a3b-e9f7-4277-8bd0-4e535b2ffe80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:01.237604 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de308a3b-e9f7-4277-8bd0-4e535b2ffe80 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:01.237776 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de308a3b-e9f7-4277-8bd0-4e535b2ffe80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:01.237938 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de308a3b-e9f7-4277-8bd0-4e535b2ffe80 admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:01.238634 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de308a3b-e9f7-4277-8bd0-4e535b2ffe80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:01.240575 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de308a3b-e9f7-4277-8bd0-4e535b2ffe80 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:01.373017 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 959/1934] 10.222.0.86 () {60 vars in 1152 bytes} [Tue Jun 7 14:42:01 2022] POST /identity/v3/projects => generated 379 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 14:42:01.377153 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2241df8e-a36f-4455-8385-03c2ad9db9b3 service neutron] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:01.387910 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2241df8e-a36f-4455-8385-03c2ad9db9b3 service neutron] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:01.446191 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7240236-2c1a-4700-bbc7-9fe3a6be301c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:01.446875 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7240236-2c1a-4700-bbc7-9fe3a6be301c admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:01.447160 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7240236-2c1a-4700-bbc7-9fe3a6be301c admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:01.447435 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7240236-2c1a-4700-bbc7-9fe3a6be301c admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:01.448214 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7240236-2c1a-4700-bbc7-9fe3a6be301c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:01.450248 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7240236-2c1a-4700-bbc7-9fe3a6be301c admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:01.549890 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 976/1935] 10.222.0.86 () {60 vars in 1143 bytes} [Tue Jun 7 14:42:01 2022] POST /identity/v3/users => generated 290 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:42:01.551102 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de308a3b-e9f7-4277-8bd0-4e535b2ffe80 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:01.562181 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de308a3b-e9f7-4277-8bd0-4e535b2ffe80 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:01.567102 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71281fa5-58ff-46bf-b389-888f0c3bd5b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:01.567816 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71281fa5-58ff-46bf-b389-888f0c3bd5b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:01.568106 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71281fa5-58ff-46bf-b389-888f0c3bd5b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:01.568385 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71281fa5-58ff-46bf-b389-888f0c3bd5b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:01.569641 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71281fa5-58ff-46bf-b389-888f0c3bd5b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:01.571246 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71281fa5-58ff-46bf-b389-888f0c3bd5b2 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:01.585821 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 960/1936] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:42:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:42:01.587455 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7240236-2c1a-4700-bbc7-9fe3a6be301c admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:01.598282 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7240236-2c1a-4700-bbc7-9fe3a6be301c admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:01.604005 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd896a40-3be4-4de6-bd2f-012936d6717b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:01.605102 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd896a40-3be4-4de6-bd2f-012936d6717b admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:01.605102 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd896a40-3be4-4de6-bd2f-012936d6717b admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:01.607674 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd896a40-3be4-4de6-bd2f-012936d6717b admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:01.607674 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd896a40-3be4-4de6-bd2f-012936d6717b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:01.608004 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd896a40-3be4-4de6-bd2f-012936d6717b admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:01.619440 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 977/1937] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:42:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:42:01.623906 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71281fa5-58ff-46bf-b389-888f0c3bd5b2 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:01.638620 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71281fa5-58ff-46bf-b389-888f0c3bd5b2 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:01.640998 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a664d10-a01d-4a82-a977-5f440af8645b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:01.641873 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a664d10-a01d-4a82-a977-5f440af8645b admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:01.642159 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a664d10-a01d-4a82-a977-5f440af8645b admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:01.642433 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a664d10-a01d-4a82-a977-5f440af8645b admin admin] PATH_INFO: `/v3/projects/930b56242dae4f6b94ad9a6fe763779f/users/b8596496d78147109590ca29be18dd02/roles/c17acc2a8bb348f59ba7edd22fcf0c47` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:01.659290 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a664d10-a01d-4a82-a977-5f440af8645b admin admin] RBAC: Authorizing `identity:create_grant(project_id=930b56242dae4f6b94ad9a6fe763779f, user_id=b8596496d78147109590ca29be18dd02, role_id=c17acc2a8bb348f59ba7edd22fcf0c47)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:01.661967 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a664d10-a01d-4a82-a977-5f440af8645b admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:01.720858 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd896a40-3be4-4de6-bd2f-012936d6717b admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:01.722599 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-dd896a40-3be4-4de6-bd2f-012936d6717b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:42:01.735950 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd896a40-3be4-4de6-bd2f-012936d6717b admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:01.740672 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3091f9c3-6107-4162-b427-5eeef555268b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:01.741642 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3091f9c3-6107-4162-b427-5eeef555268b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:01.741929 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3091f9c3-6107-4162-b427-5eeef555268b admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:01.742209 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3091f9c3-6107-4162-b427-5eeef555268b admin admin] PATH_INFO: `/v3/projects/c9f8c04cd5d3409e951fb986b0475048` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:01.743409 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3091f9c3-6107-4162-b427-5eeef555268b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9f8c04cd5d3409e951fb986b0475048)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:01.745715 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3091f9c3-6107-4162-b427-5eeef555268b admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:01.755014 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 961/1938] 10.222.0.86 () {60 vars in 1482 bytes} [Tue Jun 7 14:42:01 2022] PUT /identity/v3/projects/930b56242dae4f6b94ad9a6fe763779f/users/b8596496d78147109590ca29be18dd02/roles/c17acc2a8bb348f59ba7edd22fcf0c47 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:42:01.765810 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6969dabb-4704-45c1-8ff7-9a7e0788a39b None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:01.766110 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6969dabb-4704-45c1-8ff7-9a7e0788a39b None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:01.766393 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6969dabb-4704-45c1-8ff7-9a7e0788a39b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:01.785672 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:42:01.795046 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-6969dabb-4704-45c1-8ff7-9a7e0788a39b None None] MFA Rules not processed for user `b8596496d78147109590ca29be18dd02`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:42:01.796314 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-6969dabb-4704-45c1-8ff7-9a7e0788a39b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:42:01.843409 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:42:01.862366 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 962/1939] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:42:01 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 14:42:01.866791 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6969dabb-4704-45c1-8ff7-9a7e0788a39b None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:01.886751 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-3091f9c3-6107-4162-b427-5eeef555268b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9f8c04cd5d3409e951fb986b0475048', 'request_id': 'req-3091f9c3-6107-4162-b427-5eeef555268b'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:01.898041 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-3091f9c3-6107-4162-b427-5eeef555268b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9f8c04cd5d3409e951fb986b0475048', 'request_id': 'req-3091f9c3-6107-4162-b427-5eeef555268b'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:01.929990 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6969dabb-4704-45c1-8ff7-9a7e0788a39b None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:01.988269 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75f2b25-5f9f-4364-b29b-e9d7cf3a18da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:01.988938 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75f2b25-5f9f-4364-b29b-e9d7cf3a18da admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:01.989416 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75f2b25-5f9f-4364-b29b-e9d7cf3a18da admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:01.989707 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75f2b25-5f9f-4364-b29b-e9d7cf3a18da admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:01.990625 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75f2b25-5f9f-4364-b29b-e9d7cf3a18da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:01.993282 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75f2b25-5f9f-4364-b29b-e9d7cf3a18da admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:01.999043 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-3091f9c3-6107-4162-b427-5eeef555268b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9f8c04cd5d3409e951fb986b0475048', 'request_id': 'req-3091f9c3-6107-4162-b427-5eeef555268b'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:02.010918 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-3091f9c3-6107-4162-b427-5eeef555268b admin admin] The token cache is being invalidate because project c9f8c04cd5d3409e951fb986b0475048 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:42:02.011212 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-3091f9c3-6107-4162-b427-5eeef555268b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:02.011965 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-3091f9c3-6107-4162-b427-5eeef555268b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:02.013576 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 978/1940] 10.222.0.86 () {58 vars in 1232 bytes} [Tue Jun 7 14:42:01 2022] DELETE /identity/v3/projects/c9f8c04cd5d3409e951fb986b0475048 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 14:42:02.018221 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8741aa-389a-4e7b-a3dc-cec275e5231c None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:02.018513 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8741aa-389a-4e7b-a3dc-cec275e5231c None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:02.018819 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8741aa-389a-4e7b-a3dc-cec275e5231c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:02.037467 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-7f8741aa-389a-4e7b-a3dc-cec275e5231c None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:42:02.039255 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-7f8741aa-389a-4e7b-a3dc-cec275e5231c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:42:02.047226 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 979/1941] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:42:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 14:42:02.057120 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8271f0-c039-4894-bc53-dfb211a0e27d None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:02.057521 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8271f0-c039-4894-bc53-dfb211a0e27d None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:02.057902 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8271f0-c039-4894-bc53-dfb211a0e27d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:02.058147 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 963/1942] 10.222.0.86 () {60 vars in 1152 bytes} [Tue Jun 7 14:42:01 2022] POST /identity/v3/projects => generated 379 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 14:42:02.062092 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75f2b25-5f9f-4364-b29b-e9d7cf3a18da admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:02.063858 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-f75f2b25-5f9f-4364-b29b-e9d7cf3a18da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:42:02.076477 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-5b8271f0-c039-4894-bc53-dfb211a0e27d None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:42:02.077689 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-5b8271f0-c039-4894-bc53-dfb211a0e27d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:42:02.143005 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75f2b25-5f9f-4364-b29b-e9d7cf3a18da admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:02.149794 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54de3e7-0d1f-459d-a026-7800ecd8ff3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:02.150334 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54de3e7-0d1f-459d-a026-7800ecd8ff3f admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:02.150832 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54de3e7-0d1f-459d-a026-7800ecd8ff3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:02.151621 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54de3e7-0d1f-459d-a026-7800ecd8ff3f admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:02.152493 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54de3e7-0d1f-459d-a026-7800ecd8ff3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:02.154640 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54de3e7-0d1f-459d-a026-7800ecd8ff3f admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:02.155957 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 980/1943] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:42:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:42:02.162174 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8271f0-c039-4894-bc53-dfb211a0e27d None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:02.174772 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8271f0-c039-4894-bc53-dfb211a0e27d None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:02.180084 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65f0b03-2135-4f2d-8855-484786a536ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:02.180750 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65f0b03-2135-4f2d-8855-484786a536ae admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:02.181040 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65f0b03-2135-4f2d-8855-484786a536ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:02.181365 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65f0b03-2135-4f2d-8855-484786a536ae admin admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:02.182185 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65f0b03-2135-4f2d-8855-484786a536ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:42:02.182517 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65f0b03-2135-4f2d-8855-484786a536ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:02.184194 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65f0b03-2135-4f2d-8855-484786a536ae admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:02.202549 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 981/1944] 10.222.0.86 () {58 vars in 1152 bytes} [Tue Jun 7 14:42:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:42:02.203498 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65f0b03-2135-4f2d-8855-484786a536ae admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:02.216212 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65f0b03-2135-4f2d-8855-484786a536ae admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:02.220936 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab64beef-d693-4945-a52c-a8729d3a7874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:02.221665 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab64beef-d693-4945-a52c-a8729d3a7874 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:02.221995 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab64beef-d693-4945-a52c-a8729d3a7874 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:02.222271 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab64beef-d693-4945-a52c-a8729d3a7874 admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:02.222994 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab64beef-d693-4945-a52c-a8729d3a7874 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:02.224926 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab64beef-d693-4945-a52c-a8729d3a7874 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:02.332092 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 964/1945] 10.222.0.86 () {60 vars in 1143 bytes} [Tue Jun 7 14:42:02 2022] POST /identity/v3/users => generated 296 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 14:42:02.344695 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54de3e7-0d1f-459d-a026-7800ecd8ff3f admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:02.354902 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54de3e7-0d1f-459d-a026-7800ecd8ff3f admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:02.359711 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ce8970-d39e-4cf2-ad03-20ca19409274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:02.360432 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ce8970-d39e-4cf2-ad03-20ca19409274 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:02.360729 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ce8970-d39e-4cf2-ad03-20ca19409274 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:02.360995 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ce8970-d39e-4cf2-ad03-20ca19409274 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:02.361730 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ce8970-d39e-4cf2-ad03-20ca19409274 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:02.363493 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ce8970-d39e-4cf2-ad03-20ca19409274 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:02.373755 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 965/1946] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:42:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:42:02.377864 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ce8970-d39e-4cf2-ad03-20ca19409274 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:02.388575 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ce8970-d39e-4cf2-ad03-20ca19409274 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:02.393521 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c18c70b-8202-4cdf-ace0-e330c020d91e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:02.394705 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c18c70b-8202-4cdf-ace0-e330c020d91e admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:02.394993 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c18c70b-8202-4cdf-ace0-e330c020d91e admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:02.395279 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c18c70b-8202-4cdf-ace0-e330c020d91e admin admin] PATH_INFO: `/v3/projects/b01174c5c614450e84e526fb5a13f6cc/users/044a19807e7549e6bb79eaa4be5222df/roles/e3bf6239f5bf477b965704b086786f11` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:02.411920 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 982/1947] 10.222.0.86 () {60 vars in 1152 bytes} [Tue Jun 7 14:42:02 2022] POST /identity/v3/projects => generated 405 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 14:42:02.414887 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c18c70b-8202-4cdf-ace0-e330c020d91e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b01174c5c614450e84e526fb5a13f6cc, user_id=044a19807e7549e6bb79eaa4be5222df, role_id=e3bf6239f5bf477b965704b086786f11)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:02.414887 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c18c70b-8202-4cdf-ace0-e330c020d91e admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:02.416053 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab64beef-d693-4945-a52c-a8729d3a7874 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:02.478796 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab64beef-d693-4945-a52c-a8729d3a7874 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:02.483631 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e10339-5a64-47cf-9d49-923ce87a7114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:02.487283 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e10339-5a64-47cf-9d49-923ce87a7114 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:02.487283 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e10339-5a64-47cf-9d49-923ce87a7114 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:02.487283 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e10339-5a64-47cf-9d49-923ce87a7114 admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:02.487283 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e10339-5a64-47cf-9d49-923ce87a7114 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:02.488217 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e10339-5a64-47cf-9d49-923ce87a7114 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:02.512562 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 966/1948] 10.222.0.86 () {60 vars in 1482 bytes} [Tue Jun 7 14:42:02 2022] PUT /identity/v3/projects/b01174c5c614450e84e526fb5a13f6cc/users/044a19807e7549e6bb79eaa4be5222df/roles/e3bf6239f5bf477b965704b086786f11 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 14:42:02.516521 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c18c70b-8202-4cdf-ace0-e330c020d91e admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:02.579873 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c18c70b-8202-4cdf-ace0-e330c020d91e admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:02.585341 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06819d3e-5d07-42b5-85c8-402aafff8637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:02.586008 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06819d3e-5d07-42b5-85c8-402aafff8637 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:02.586297 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06819d3e-5d07-42b5-85c8-402aafff8637 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:02.586577 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06819d3e-5d07-42b5-85c8-402aafff8637 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:02.587306 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06819d3e-5d07-42b5-85c8-402aafff8637 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:02.588925 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06819d3e-5d07-42b5-85c8-402aafff8637 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:02.601043 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 967/1949] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:42:02 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 07 14:42:02.602796 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06819d3e-5d07-42b5-85c8-402aafff8637 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:02.603635 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 983/1950] 10.222.0.86 () {60 vars in 1143 bytes} [Tue Jun 7 14:42:02 2022] POST /identity/v3/users => generated 303 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 14:42:02.611897 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e10339-5a64-47cf-9d49-923ce87a7114 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:02.615474 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06819d3e-5d07-42b5-85c8-402aafff8637 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:02.621771 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16687b8b-9c19-480f-8cb7-5b201e77ad2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:02.622716 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16687b8b-9c19-480f-8cb7-5b201e77ad2b admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:02.623154 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16687b8b-9c19-480f-8cb7-5b201e77ad2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:02.623432 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e10339-5a64-47cf-9d49-923ce87a7114 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:02.623541 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16687b8b-9c19-480f-8cb7-5b201e77ad2b admin admin] PATH_INFO: `/v3/projects/b01174c5c614450e84e526fb5a13f6cc/users/044a19807e7549e6bb79eaa4be5222df/roles/e3bf6239f5bf477b965704b086786f11` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:02.625568 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16687b8b-9c19-480f-8cb7-5b201e77ad2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b01174c5c614450e84e526fb5a13f6cc, user_id=044a19807e7549e6bb79eaa4be5222df, role_id=e3bf6239f5bf477b965704b086786f11)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:02.628317 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16687b8b-9c19-480f-8cb7-5b201e77ad2b admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:02.628443 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317c3911-43cc-4113-939f-539973721fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:02.629098 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317c3911-43cc-4113-939f-539973721fcd admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:02.629387 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317c3911-43cc-4113-939f-539973721fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:02.629669 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317c3911-43cc-4113-939f-539973721fcd admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:02.630403 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317c3911-43cc-4113-939f-539973721fcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:02.632649 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317c3911-43cc-4113-939f-539973721fcd admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:02.639648 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 968/1951] 10.222.0.86 () {60 vars in 1482 bytes} [Tue Jun 7 14:42:02 2022] PUT /identity/v3/projects/b01174c5c614450e84e526fb5a13f6cc/users/044a19807e7549e6bb79eaa4be5222df/roles/e3bf6239f5bf477b965704b086786f11 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 14:42:02.643427 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 984/1952] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:42:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 07 14:42:02.647778 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16687b8b-9c19-480f-8cb7-5b201e77ad2b admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:02.651951 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba197a77-6b7c-44a7-8f98-9939b597981a None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:02.652248 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba197a77-6b7c-44a7-8f98-9939b597981a None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:02.652527 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba197a77-6b7c-44a7-8f98-9939b597981a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:02.683967 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-ba197a77-6b7c-44a7-8f98-9939b597981a None None] MFA Rules not processed for user `044a19807e7549e6bb79eaa4be5222df`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:42:02.685221 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-ba197a77-6b7c-44a7-8f98-9939b597981a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:42:02.691526 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:42:02.729329 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16687b8b-9c19-480f-8cb7-5b201e77ad2b admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:02.734259 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498f9740-4cf7-4fc0-8e73-67d38f9d32a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:02.735092 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498f9740-4cf7-4fc0-8e73-67d38f9d32a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:02.735386 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498f9740-4cf7-4fc0-8e73-67d38f9d32a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:02.735669 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498f9740-4cf7-4fc0-8e73-67d38f9d32a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:02.740430 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498f9740-4cf7-4fc0-8e73-67d38f9d32a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:02.742664 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498f9740-4cf7-4fc0-8e73-67d38f9d32a0 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:02.753928 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 969/1953] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:42:02 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:42:02.758227 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498f9740-4cf7-4fc0-8e73-67d38f9d32a0 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:02.769403 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498f9740-4cf7-4fc0-8e73-67d38f9d32a0 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:02.778010 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e16fc89-9d0c-4000-b161-6fb1e2e03511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:02.779107 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e16fc89-9d0c-4000-b161-6fb1e2e03511 admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:02.779394 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e16fc89-9d0c-4000-b161-6fb1e2e03511 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:02.779672 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e16fc89-9d0c-4000-b161-6fb1e2e03511 admin admin] PATH_INFO: `/v3/projects/3c550de3604f410a9e3a3a1de0f2d0af/users/7c768b1f163844518132a729a52ccb39/roles/c17acc2a8bb348f59ba7edd22fcf0c47` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:02.780229 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 985/1954] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:42:02 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:42:02.793146 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba197a77-6b7c-44a7-8f98-9939b597981a None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:02.797205 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-ba197a77-6b7c-44a7-8f98-9939b597981a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:42:02.800651 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e16fc89-9d0c-4000-b161-6fb1e2e03511 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c550de3604f410a9e3a3a1de0f2d0af, user_id=7c768b1f163844518132a729a52ccb39, role_id=c17acc2a8bb348f59ba7edd22fcf0c47)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:02.805597 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e16fc89-9d0c-4000-b161-6fb1e2e03511 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:02.851614 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba197a77-6b7c-44a7-8f98-9939b597981a None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:02.855688 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbe3886-60be-4549-b01c-9473b03e8222 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af5a95620a4b43538abfe09eed4bf115', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:02.860392 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbe3886-60be-4549-b01c-9473b03e8222 service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:02.860392 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbe3886-60be-4549-b01c-9473b03e8222 service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:02.860392 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbe3886-60be-4549-b01c-9473b03e8222 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:02.867631 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbe3886-60be-4549-b01c-9473b03e8222 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:02.869055 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbe3886-60be-4549-b01c-9473b03e8222 service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:02.878644 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 986/1955] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:42:02 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 14:42:02.891268 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 970/1956] 10.222.0.86 () {60 vars in 1482 bytes} [Tue Jun 7 14:42:02 2022] PUT /identity/v3/projects/3c550de3604f410a9e3a3a1de0f2d0af/users/7c768b1f163844518132a729a52ccb39/roles/c17acc2a8bb348f59ba7edd22fcf0c47 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 14:42:02.903856 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f4b724-7068-44f1-ad66-d9166777e5ca None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:02.904146 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f4b724-7068-44f1-ad66-d9166777e5ca None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:02.904426 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f4b724-7068-44f1-ad66-d9166777e5ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:02.925074 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=89,keystone:DELETE=6,keystone:INSERT=5 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:42:02.933972 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-41f4b724-7068-44f1-ad66-d9166777e5ca None None] MFA Rules not processed for user `7c768b1f163844518132a729a52ccb39`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:42:02.935502 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-41f4b724-7068-44f1-ad66-d9166777e5ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:42:03.001569 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 987/1957] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:42:02 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:42:03.006176 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e16fc89-9d0c-4000-b161-6fb1e2e03511 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:03.072921 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e16fc89-9d0c-4000-b161-6fb1e2e03511 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:03.077781 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f6635e-8939-492d-9e71-60996c96d658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:03.078433 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f6635e-8939-492d-9e71-60996c96d658 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:03.078717 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f6635e-8939-492d-9e71-60996c96d658 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:03.078991 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f6635e-8939-492d-9e71-60996c96d658 admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:03.079697 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f6635e-8939-492d-9e71-60996c96d658 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:03.082013 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f6635e-8939-492d-9e71-60996c96d658 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:03.220665 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 971/1958] 10.222.0.86 () {60 vars in 1152 bytes} [Tue Jun 7 14:42:03 2022] POST /identity/v3/projects => generated 405 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:42:03.221847 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f4b724-7068-44f1-ad66-d9166777e5ca None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:03.233017 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f4b724-7068-44f1-ad66-d9166777e5ca None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:03.290158 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01804db0-840e-465a-b02a-822a69c8a41d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:03.290847 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01804db0-840e-465a-b02a-822a69c8a41d admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:03.291135 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01804db0-840e-465a-b02a-822a69c8a41d admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:03.291450 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01804db0-840e-465a-b02a-822a69c8a41d admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:03.292184 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01804db0-840e-465a-b02a-822a69c8a41d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:03.294149 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01804db0-840e-465a-b02a-822a69c8a41d admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:03.375977 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 988/1959] 10.222.0.86 () {60 vars in 1143 bytes} [Tue Jun 7 14:42:03 2022] POST /identity/v3/users => generated 309 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 14:42:03.380006 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f6635e-8939-492d-9e71-60996c96d658 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:03.391857 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f6635e-8939-492d-9e71-60996c96d658 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:03.396805 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21657800-5cf8-400a-9387-3ef46613b9ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:03.400856 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21657800-5cf8-400a-9387-3ef46613b9ad admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:03.400856 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21657800-5cf8-400a-9387-3ef46613b9ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:03.400856 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21657800-5cf8-400a-9387-3ef46613b9ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:03.400856 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21657800-5cf8-400a-9387-3ef46613b9ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:03.401290 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21657800-5cf8-400a-9387-3ef46613b9ad admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:03.411651 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 972/1960] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:42:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:42:03.420430 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01804db0-840e-465a-b02a-822a69c8a41d admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:03.431006 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01804db0-840e-465a-b02a-822a69c8a41d admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:03.436019 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d16bad-83f4-4e9a-a234-5fea2b4b29cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:03.437109 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d16bad-83f4-4e9a-a234-5fea2b4b29cd admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:03.437393 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d16bad-83f4-4e9a-a234-5fea2b4b29cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:03.437671 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d16bad-83f4-4e9a-a234-5fea2b4b29cd admin admin] PATH_INFO: `/v3/projects/210e2cd9923d45b2b9f2920c7e331b53/users/30ae03d4340d4804927d24441891c928/roles/e3bf6239f5bf477b965704b086786f11` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:03.452703 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d16bad-83f4-4e9a-a234-5fea2b4b29cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=210e2cd9923d45b2b9f2920c7e331b53, user_id=30ae03d4340d4804927d24441891c928, role_id=e3bf6239f5bf477b965704b086786f11)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:03.455434 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d16bad-83f4-4e9a-a234-5fea2b4b29cd admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:03.577702 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 989/1961] 10.222.0.86 () {60 vars in 1482 bytes} [Tue Jun 7 14:42:03 2022] PUT /identity/v3/projects/210e2cd9923d45b2b9f2920c7e331b53/users/30ae03d4340d4804927d24441891c928/roles/e3bf6239f5bf477b965704b086786f11 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 14:42:03.581383 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21657800-5cf8-400a-9387-3ef46613b9ad admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:03.592080 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21657800-5cf8-400a-9387-3ef46613b9ad admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:03.606220 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:42:03.652007 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5449d08-fc2f-46ab-a7a0-5637a76f13b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:03.652798 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5449d08-fc2f-46ab-a7a0-5637a76f13b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:03.653085 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5449d08-fc2f-46ab-a7a0-5637a76f13b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:03.653359 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5449d08-fc2f-46ab-a7a0-5637a76f13b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:03.654094 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5449d08-fc2f-46ab-a7a0-5637a76f13b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:03.655673 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5449d08-fc2f-46ab-a7a0-5637a76f13b5 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:03.666225 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 973/1962] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:42:03 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:42:03.670383 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d16bad-83f4-4e9a-a234-5fea2b4b29cd admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:03.680858 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d16bad-83f4-4e9a-a234-5fea2b4b29cd admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:03.686086 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63824c94-21c5-4db8-b283-6897afdd8930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:03.686965 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63824c94-21c5-4db8-b283-6897afdd8930 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:03.687249 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63824c94-21c5-4db8-b283-6897afdd8930 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:03.687526 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63824c94-21c5-4db8-b283-6897afdd8930 admin admin] PATH_INFO: `/v3/projects/210e2cd9923d45b2b9f2920c7e331b53/users/30ae03d4340d4804927d24441891c928/roles/e3bf6239f5bf477b965704b086786f11` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:03.689505 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63824c94-21c5-4db8-b283-6897afdd8930 admin admin] RBAC: Authorizing `identity:create_grant(project_id=210e2cd9923d45b2b9f2920c7e331b53, user_id=30ae03d4340d4804927d24441891c928, role_id=e3bf6239f5bf477b965704b086786f11)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:03.692201 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63824c94-21c5-4db8-b283-6897afdd8930 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:03.702390 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 990/1963] 10.222.0.86 () {60 vars in 1482 bytes} [Tue Jun 7 14:42:03 2022] PUT /identity/v3/projects/210e2cd9923d45b2b9f2920c7e331b53/users/30ae03d4340d4804927d24441891c928/roles/e3bf6239f5bf477b965704b086786f11 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:42:03.713002 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0c3e5c-a4f1-48fe-9ecd-9ce5aaff7200 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:03.713295 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0c3e5c-a4f1-48fe-9ecd-9ce5aaff7200 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:03.713572 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0c3e5c-a4f1-48fe-9ecd-9ce5aaff7200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:03.740170 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-ac0c3e5c-a4f1-48fe-9ecd-9ce5aaff7200 None None] MFA Rules not processed for user `30ae03d4340d4804927d24441891c928`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:42:03.742118 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-ac0c3e5c-a4f1-48fe-9ecd-9ce5aaff7200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:42:03.813123 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 974/1964] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:42:03 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:42:03.824570 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63824c94-21c5-4db8-b283-6897afdd8930 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:03.826697 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-63824c94-21c5-4db8-b283-6897afdd8930 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:42:03.885442 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63824c94-21c5-4db8-b283-6897afdd8930 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:03.889116 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a081af1-02dd-4f5f-beb5-8028fb18fbb7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af5a95620a4b43538abfe09eed4bf115', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:03.889765 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a081af1-02dd-4f5f-beb5-8028fb18fbb7 service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:03.890051 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a081af1-02dd-4f5f-beb5-8028fb18fbb7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:03.890331 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a081af1-02dd-4f5f-beb5-8028fb18fbb7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:03.898828 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:42:03.901177 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a081af1-02dd-4f5f-beb5-8028fb18fbb7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:03.902596 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a081af1-02dd-4f5f-beb5-8028fb18fbb7 service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:03.913193 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 991/1965] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:42:03 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:42:04.027066 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0c3e5c-a4f1-48fe-9ecd-9ce5aaff7200 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:04.057753 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:42:04.093256 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a081af1-02dd-4f5f-beb5-8028fb18fbb7 service cinder] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:04.094766 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0c3e5c-a4f1-48fe-9ecd-9ce5aaff7200 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:04.100275 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fb44f0-88b0-4597-bd67-dd949718af44 tempest-VolumeQuotaClassesTest-224046138 tempest-VolumeQuotaClassesTest-224046138-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '044a19807e7549e6bb79eaa4be5222df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01174c5c614450e84e526fb5a13f6cc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:04.104960 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fb44f0-88b0-4597-bd67-dd949718af44 tempest-VolumeQuotaClassesTest-224046138 tempest-VolumeQuotaClassesTest-224046138-project-admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:04.104960 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fb44f0-88b0-4597-bd67-dd949718af44 tempest-VolumeQuotaClassesTest-224046138 tempest-VolumeQuotaClassesTest-224046138-project-admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:04.104960 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fb44f0-88b0-4597-bd67-dd949718af44 tempest-VolumeQuotaClassesTest-224046138 tempest-VolumeQuotaClassesTest-224046138-project-admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:04.104960 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fb44f0-88b0-4597-bd67-dd949718af44 tempest-VolumeQuotaClassesTest-224046138 tempest-VolumeQuotaClassesTest-224046138-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:42:04.104960 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fb44f0-88b0-4597-bd67-dd949718af44 tempest-VolumeQuotaClassesTest-224046138 tempest-VolumeQuotaClassesTest-224046138-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:04.105401 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fb44f0-88b0-4597-bd67-dd949718af44 tempest-VolumeQuotaClassesTest-224046138 tempest-VolumeQuotaClassesTest-224046138-project-admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:04.116971 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 975/1966] 10.222.0.86 () {58 vars in 1152 bytes} [Tue Jun 7 14:42:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:42:04.120887 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fb44f0-88b0-4597-bd67-dd949718af44 tempest-VolumeQuotaClassesTest-224046138 tempest-VolumeQuotaClassesTest-224046138-project-admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:04.134793 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fb44f0-88b0-4597-bd67-dd949718af44 tempest-VolumeQuotaClassesTest-224046138 tempest-VolumeQuotaClassesTest-224046138-project-admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:04.139417 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7726e42-7fdc-4f22-bc9c-89777048d784 tempest-VolumeQuotaClassesTest-224046138 tempest-VolumeQuotaClassesTest-224046138-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '044a19807e7549e6bb79eaa4be5222df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01174c5c614450e84e526fb5a13f6cc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:04.140127 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7726e42-7fdc-4f22-bc9c-89777048d784 tempest-VolumeQuotaClassesTest-224046138 tempest-VolumeQuotaClassesTest-224046138-project-admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:04.140428 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7726e42-7fdc-4f22-bc9c-89777048d784 tempest-VolumeQuotaClassesTest-224046138 tempest-VolumeQuotaClassesTest-224046138-project-admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:04.140709 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7726e42-7fdc-4f22-bc9c-89777048d784 tempest-VolumeQuotaClassesTest-224046138 tempest-VolumeQuotaClassesTest-224046138-project-admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:04.141412 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7726e42-7fdc-4f22-bc9c-89777048d784 tempest-VolumeQuotaClassesTest-224046138 tempest-VolumeQuotaClassesTest-224046138-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:04.143308 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7726e42-7fdc-4f22-bc9c-89777048d784 tempest-VolumeQuotaClassesTest-224046138 tempest-VolumeQuotaClassesTest-224046138-project-admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:04.163218 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a081af1-02dd-4f5f-beb5-8028fb18fbb7 service cinder] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:04.167958 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776aec63-654e-4246-beee-918be520a506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:04.168614 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776aec63-654e-4246-beee-918be520a506 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:04.168874 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776aec63-654e-4246-beee-918be520a506 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:04.169144 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776aec63-654e-4246-beee-918be520a506 admin admin] PATH_INFO: `/v3/users/7c768b1f163844518132a729a52ccb39` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:04.170318 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776aec63-654e-4246-beee-918be520a506 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c768b1f163844518132a729a52ccb39)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:04.172291 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776aec63-654e-4246-beee-918be520a506 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:04.174654 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:42:04.226913 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 976/1967] 10.222.0.86 () {60 vars in 1152 bytes} [Tue Jun 7 14:42:04 2022] POST /identity/v3/projects => generated 354 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 14:42:04.226913 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7726e42-7fdc-4f22-bc9c-89777048d784 tempest-VolumeQuotaClassesTest-224046138 tempest-VolumeQuotaClassesTest-224046138-project-admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:04.228683 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-b7726e42-7fdc-4f22-bc9c-89777048d784 tempest-VolumeQuotaClassesTest-224046138 tempest-VolumeQuotaClassesTest-224046138-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:42:04.293885 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7726e42-7fdc-4f22-bc9c-89777048d784 tempest-VolumeQuotaClassesTest-224046138 tempest-VolumeQuotaClassesTest-224046138-project-admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:04.298452 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b75bd76-0bca-45fc-b63a-cdfc7deba806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:04.299368 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b75bd76-0bca-45fc-b63a-cdfc7deba806 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:04.299958 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b75bd76-0bca-45fc-b63a-cdfc7deba806 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:04.300234 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b75bd76-0bca-45fc-b63a-cdfc7deba806 admin admin] PATH_INFO: `/v3/users/4116d297271d4dd19c06d54c24d4b997` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:04.301430 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b75bd76-0bca-45fc-b63a-cdfc7deba806 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4116d297271d4dd19c06d54c24d4b997)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:04.303394 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b75bd76-0bca-45fc-b63a-cdfc7deba806 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:04.504340 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-776aec63-654e-4246-beee-918be520a506 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c768b1f163844518132a729a52ccb39'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:04.505005 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-776aec63-654e-4246-beee-918be520a506 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c768b1f163844518132a729a52ccb39'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:04.513165 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-776aec63-654e-4246-beee-918be520a506 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c768b1f163844518132a729a52ccb39'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:04.528152 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-776aec63-654e-4246-beee-918be520a506 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c768b1f163844518132a729a52ccb39'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:04.529305 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-776aec63-654e-4246-beee-918be520a506 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c768b1f163844518132a729a52ccb39'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:04.548557 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-6b75bd76-0bca-45fc-b63a-cdfc7deba806 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4116d297271d4dd19c06d54c24d4b997'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:04.555639 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-6b75bd76-0bca-45fc-b63a-cdfc7deba806 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4116d297271d4dd19c06d54c24d4b997'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:04.556357 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-6b75bd76-0bca-45fc-b63a-cdfc7deba806 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4116d297271d4dd19c06d54c24d4b997'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:04.576223 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-6b75bd76-0bca-45fc-b63a-cdfc7deba806 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4116d297271d4dd19c06d54c24d4b997'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:04.577237 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-6b75bd76-0bca-45fc-b63a-cdfc7deba806 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4116d297271d4dd19c06d54c24d4b997'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:04.626613 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 992/1968] 10.222.0.86 () {58 vars in 1223 bytes} [Tue Jun 7 14:42:04 2022] DELETE /identity/v3/users/7c768b1f163844518132a729a52ccb39 => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 14:42:04.630158 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776aec63-654e-4246-beee-918be520a506 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:04.630158 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-776aec63-654e-4246-beee-918be520a506 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:42:04.695732 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776aec63-654e-4246-beee-918be520a506 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:04.696755 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 977/1969] 10.222.0.86 () {58 vars in 1223 bytes} [Tue Jun 7 14:42:04 2022] DELETE /identity/v3/users/4116d297271d4dd19c06d54c24d4b997 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:42:04.698399 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0631454f-5246-4bf2-88b3-6ab60d2b65f3 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:04.698695 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0631454f-5246-4bf2-88b3-6ab60d2b65f3 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:04.698976 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0631454f-5246-4bf2-88b3-6ab60d2b65f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:04.716498 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-0631454f-5246-4bf2-88b3-6ab60d2b65f3 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:42:04.717702 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-0631454f-5246-4bf2-88b3-6ab60d2b65f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:42:04.727917 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:42:04.756063 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf34cb0-bbbd-4718-80e3-f5c732f22793 tempest-VolumeQuotaClassesTest-224046138 tempest-VolumeQuotaClassesTest-224046138-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '044a19807e7549e6bb79eaa4be5222df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01174c5c614450e84e526fb5a13f6cc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:04.756787 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf34cb0-bbbd-4718-80e3-f5c732f22793 tempest-VolumeQuotaClassesTest-224046138 tempest-VolumeQuotaClassesTest-224046138-project-admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:04.757073 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf34cb0-bbbd-4718-80e3-f5c732f22793 tempest-VolumeQuotaClassesTest-224046138 tempest-VolumeQuotaClassesTest-224046138-project-admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:04.757355 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf34cb0-bbbd-4718-80e3-f5c732f22793 tempest-VolumeQuotaClassesTest-224046138 tempest-VolumeQuotaClassesTest-224046138-project-admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:04.758119 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf34cb0-bbbd-4718-80e3-f5c732f22793 tempest-VolumeQuotaClassesTest-224046138 tempest-VolumeQuotaClassesTest-224046138-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:42:04.758431 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf34cb0-bbbd-4718-80e3-f5c732f22793 tempest-VolumeQuotaClassesTest-224046138 tempest-VolumeQuotaClassesTest-224046138-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:04.760062 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf34cb0-bbbd-4718-80e3-f5c732f22793 tempest-VolumeQuotaClassesTest-224046138 tempest-VolumeQuotaClassesTest-224046138-project-admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:04.773476 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 993/1970] 10.222.0.86 () {58 vars in 1152 bytes} [Tue Jun 7 14:42:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:42:04.774872 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87322e11-7e29-45e9-a81d-2d78d1897bc7 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:04.775168 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87322e11-7e29-45e9-a81d-2d78d1897bc7 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:04.775450 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87322e11-7e29-45e9-a81d-2d78d1897bc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:04.782089 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 978/1971] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:42:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:42:04.792248 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0631454f-5246-4bf2-88b3-6ab60d2b65f3 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:04.796317 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-0631454f-5246-4bf2-88b3-6ab60d2b65f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:42:04.800647 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-87322e11-7e29-45e9-a81d-2d78d1897bc7 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:42:04.801830 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-87322e11-7e29-45e9-a81d-2d78d1897bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:42:04.820549 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 994/1972] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:42:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:42:04.821386 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87322e11-7e29-45e9-a81d-2d78d1897bc7 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:04.822689 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-87322e11-7e29-45e9-a81d-2d78d1897bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:42:04.836584 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87322e11-7e29-45e9-a81d-2d78d1897bc7 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:04.842264 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9ed69a-a2f4-406c-a8e7-af31df8455cb tempest-VolumeQuotaClassesTest-224046138 tempest-VolumeQuotaClassesTest-224046138-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '044a19807e7549e6bb79eaa4be5222df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01174c5c614450e84e526fb5a13f6cc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:04.842264 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9ed69a-a2f4-406c-a8e7-af31df8455cb tempest-VolumeQuotaClassesTest-224046138 tempest-VolumeQuotaClassesTest-224046138-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:04.842502 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9ed69a-a2f4-406c-a8e7-af31df8455cb tempest-VolumeQuotaClassesTest-224046138 tempest-VolumeQuotaClassesTest-224046138-project-admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:04.842733 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9ed69a-a2f4-406c-a8e7-af31df8455cb tempest-VolumeQuotaClassesTest-224046138 tempest-VolumeQuotaClassesTest-224046138-project-admin] PATH_INFO: `/v3/projects/9733293fa8ad48dfad465c78969fbf91` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:04.843962 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9ed69a-a2f4-406c-a8e7-af31df8455cb tempest-VolumeQuotaClassesTest-224046138 tempest-VolumeQuotaClassesTest-224046138-project-admin] RBAC: Authorizing `identity:delete_project(project_id=9733293fa8ad48dfad465c78969fbf91)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:04.845882 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9ed69a-a2f4-406c-a8e7-af31df8455cb tempest-VolumeQuotaClassesTest-224046138 tempest-VolumeQuotaClassesTest-224046138-project-admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:04.857556 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0631454f-5246-4bf2-88b3-6ab60d2b65f3 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:04.857970 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:42:04.861553 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aa8ce4-c22a-4454-b63d-f2880aad1039 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dda603ec5517460a83c333db2af804d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:04.862204 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aa8ce4-c22a-4454-b63d-f2880aad1039 service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:04.862494 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aa8ce4-c22a-4454-b63d-f2880aad1039 service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:04.862770 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aa8ce4-c22a-4454-b63d-f2880aad1039 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:04.872486 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aa8ce4-c22a-4454-b63d-f2880aad1039 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:04.876618 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aa8ce4-c22a-4454-b63d-f2880aad1039 service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:04.883992 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 979/1973] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:42:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 14:42:04.884952 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aa8ce4-c22a-4454-b63d-f2880aad1039 service neutron] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:04.886215 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-93aa8ce4-c22a-4454-b63d-f2880aad1039 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:42:04.900220 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aa8ce4-c22a-4454-b63d-f2880aad1039 service neutron] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:04.903288 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b54dff-a011-449e-95eb-a4442ad0eca1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dda603ec5517460a83c333db2af804d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:04.903970 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b54dff-a011-449e-95eb-a4442ad0eca1 service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:04.904255 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b54dff-a011-449e-95eb-a4442ad0eca1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:04.904531 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b54dff-a011-449e-95eb-a4442ad0eca1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:04.914023 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b54dff-a011-449e-95eb-a4442ad0eca1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:04.915443 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b54dff-a011-449e-95eb-a4442ad0eca1 service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:04.925536 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 980/1974] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:42:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:42:04.977040 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-5f9ed69a-a2f4-406c-a8e7-af31df8455cb tempest-VolumeQuotaClassesTest-224046138 tempest-VolumeQuotaClassesTest-224046138-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9733293fa8ad48dfad465c78969fbf91', 'request_id': 'req-5f9ed69a-a2f4-406c-a8e7-af31df8455cb'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:04.984014 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-5f9ed69a-a2f4-406c-a8e7-af31df8455cb tempest-VolumeQuotaClassesTest-224046138 tempest-VolumeQuotaClassesTest-224046138-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9733293fa8ad48dfad465c78969fbf91', 'request_id': 'req-5f9ed69a-a2f4-406c-a8e7-af31df8455cb'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:05.096747 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-5f9ed69a-a2f4-406c-a8e7-af31df8455cb tempest-VolumeQuotaClassesTest-224046138 tempest-VolumeQuotaClassesTest-224046138-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9733293fa8ad48dfad465c78969fbf91', 'request_id': 'req-5f9ed69a-a2f4-406c-a8e7-af31df8455cb'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:05.111483 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-5f9ed69a-a2f4-406c-a8e7-af31df8455cb tempest-VolumeQuotaClassesTest-224046138 tempest-VolumeQuotaClassesTest-224046138-project-admin] The token cache is being invalidate because project 9733293fa8ad48dfad465c78969fbf91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:42:05.111697 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-5f9ed69a-a2f4-406c-a8e7-af31df8455cb tempest-VolumeQuotaClassesTest-224046138 tempest-VolumeQuotaClassesTest-224046138-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:05.116589 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-5f9ed69a-a2f4-406c-a8e7-af31df8455cb tempest-VolumeQuotaClassesTest-224046138 tempest-VolumeQuotaClassesTest-224046138-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:05.120190 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 995/1975] 10.222.0.86 () {58 vars in 1232 bytes} [Tue Jun 7 14:42:04 2022] DELETE /identity/v3/projects/9733293fa8ad48dfad465c78969fbf91 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:42:05.559806 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b54dff-a011-449e-95eb-a4442ad0eca1 service neutron] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:05.599590 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-61b54dff-a011-449e-95eb-a4442ad0eca1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:42:05.600002 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9ed69a-a2f4-406c-a8e7-af31df8455cb tempest-VolumeQuotaClassesTest-224046138 tempest-VolumeQuotaClassesTest-224046138-project-admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:05.600002 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-5f9ed69a-a2f4-406c-a8e7-af31df8455cb tempest-VolumeQuotaClassesTest-224046138 tempest-VolumeQuotaClassesTest-224046138-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:42:05.600468 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b54dff-a011-449e-95eb-a4442ad0eca1 service neutron] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:05.673661 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455a745b-6a91-4017-bd90-e139be8d3c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:05.673795 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9ed69a-a2f4-406c-a8e7-af31df8455cb tempest-VolumeQuotaClassesTest-224046138 tempest-VolumeQuotaClassesTest-224046138-project-admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:05.674385 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455a745b-6a91-4017-bd90-e139be8d3c0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:05.674846 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455a745b-6a91-4017-bd90-e139be8d3c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:05.675294 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455a745b-6a91-4017-bd90-e139be8d3c0a admin admin] PATH_INFO: `/v3/projects/796ad8d89a62469cae1953b7fb899edd` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:05.676814 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455a745b-6a91-4017-bd90-e139be8d3c0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=796ad8d89a62469cae1953b7fb899edd)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:05.678621 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b10a13-7f6a-4f31-a210-8d5b36a480bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:05.679534 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b10a13-7f6a-4f31-a210-8d5b36a480bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:05.679850 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b10a13-7f6a-4f31-a210-8d5b36a480bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:05.680132 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b10a13-7f6a-4f31-a210-8d5b36a480bb admin admin] PATH_INFO: `/v3/projects/3c550de3604f410a9e3a3a1de0f2d0af` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:05.680951 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455a745b-6a91-4017-bd90-e139be8d3c0a admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:05.681344 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b10a13-7f6a-4f31-a210-8d5b36a480bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c550de3604f410a9e3a3a1de0f2d0af)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:05.684530 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b10a13-7f6a-4f31-a210-8d5b36a480bb admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:05.822040 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:42:05.823269 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-455a745b-6a91-4017-bd90-e139be8d3c0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '796ad8d89a62469cae1953b7fb899edd', 'request_id': 'req-455a745b-6a91-4017-bd90-e139be8d3c0a'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:05.829530 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-455a745b-6a91-4017-bd90-e139be8d3c0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '796ad8d89a62469cae1953b7fb899edd', 'request_id': 'req-455a745b-6a91-4017-bd90-e139be8d3c0a'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:05.856854 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-b6b10a13-7f6a-4f31-a210-8d5b36a480bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c550de3604f410a9e3a3a1de0f2d0af', 'request_id': 'req-b6b10a13-7f6a-4f31-a210-8d5b36a480bb'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:05.865461 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-b6b10a13-7f6a-4f31-a210-8d5b36a480bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c550de3604f410a9e3a3a1de0f2d0af', 'request_id': 'req-b6b10a13-7f6a-4f31-a210-8d5b36a480bb'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:05.948055 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-455a745b-6a91-4017-bd90-e139be8d3c0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '796ad8d89a62469cae1953b7fb899edd', 'request_id': 'req-455a745b-6a91-4017-bd90-e139be8d3c0a'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:05.959095 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-455a745b-6a91-4017-bd90-e139be8d3c0a admin admin] The token cache is being invalidate because project 796ad8d89a62469cae1953b7fb899edd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:42:05.959428 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-455a745b-6a91-4017-bd90-e139be8d3c0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:05.960070 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-455a745b-6a91-4017-bd90-e139be8d3c0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:05.961652 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 981/1976] 10.222.0.86 () {58 vars in 1232 bytes} [Tue Jun 7 14:42:05 2022] DELETE /identity/v3/projects/796ad8d89a62469cae1953b7fb899edd => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:42:05.966211 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878dabc5-ac10-4687-a639-8ddc6503fba9 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:05.966500 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878dabc5-ac10-4687-a639-8ddc6503fba9 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:05.966779 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878dabc5-ac10-4687-a639-8ddc6503fba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:05.985412 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-878dabc5-ac10-4687-a639-8ddc6503fba9 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:42:05.986335 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-878dabc5-ac10-4687-a639-8ddc6503fba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:42:06.047825 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 982/1977] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:42:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 14:42:06.048709 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878dabc5-ac10-4687-a639-8ddc6503fba9 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:06.049962 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-878dabc5-ac10-4687-a639-8ddc6503fba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:42:06.064528 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878dabc5-ac10-4687-a639-8ddc6503fba9 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:06.069430 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de8fd81-51b5-4535-bbcd-5e82f73803c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:06.070338 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de8fd81-51b5-4535-bbcd-5e82f73803c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:06.070643 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de8fd81-51b5-4535-bbcd-5e82f73803c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:06.070920 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de8fd81-51b5-4535-bbcd-5e82f73803c9 admin admin] PATH_INFO: `/v3/users/b8596496d78147109590ca29be18dd02` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:06.072320 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de8fd81-51b5-4535-bbcd-5e82f73803c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8596496d78147109590ca29be18dd02)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:06.074192 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de8fd81-51b5-4535-bbcd-5e82f73803c9 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:06.084811 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-b6b10a13-7f6a-4f31-a210-8d5b36a480bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c550de3604f410a9e3a3a1de0f2d0af', 'request_id': 'req-b6b10a13-7f6a-4f31-a210-8d5b36a480bb'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:06.095746 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-b6b10a13-7f6a-4f31-a210-8d5b36a480bb admin admin] The token cache is being invalidate because project 3c550de3604f410a9e3a3a1de0f2d0af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:42:06.100602 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-b6b10a13-7f6a-4f31-a210-8d5b36a480bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:06.100602 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-b6b10a13-7f6a-4f31-a210-8d5b36a480bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:06.100602 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 996/1978] 10.222.0.86 () {58 vars in 1232 bytes} [Tue Jun 7 14:42:05 2022] DELETE /identity/v3/projects/3c550de3604f410a9e3a3a1de0f2d0af => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 14:42:06.100602 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecc66fa-49f1-48a7-8d53-29d45ead7df1 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:06.100602 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecc66fa-49f1-48a7-8d53-29d45ead7df1 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:06.100602 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecc66fa-49f1-48a7-8d53-29d45ead7df1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:06.119020 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-aecc66fa-49f1-48a7-8d53-29d45ead7df1 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:42:06.120265 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-aecc66fa-49f1-48a7-8d53-29d45ead7df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:42:06.128100 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 997/1979] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:42:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:42:06.128862 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecc66fa-49f1-48a7-8d53-29d45ead7df1 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:06.130041 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-aecc66fa-49f1-48a7-8d53-29d45ead7df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:42:06.141225 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecc66fa-49f1-48a7-8d53-29d45ead7df1 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:06.146398 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef62164-4fc4-4725-8e58-e20db94b68a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:06.147322 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef62164-4fc4-4725-8e58-e20db94b68a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:06.147602 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef62164-4fc4-4725-8e58-e20db94b68a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:06.147941 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef62164-4fc4-4725-8e58-e20db94b68a3 admin admin] PATH_INFO: `/v3/users/30ae03d4340d4804927d24441891c928` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:06.149091 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef62164-4fc4-4725-8e58-e20db94b68a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30ae03d4340d4804927d24441891c928)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:06.150993 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef62164-4fc4-4725-8e58-e20db94b68a3 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:06.168333 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:42:06.271940 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-1de8fd81-51b5-4535-bbcd-5e82f73803c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8596496d78147109590ca29be18dd02'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:06.279178 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-1de8fd81-51b5-4535-bbcd-5e82f73803c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8596496d78147109590ca29be18dd02'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:06.279915 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-1de8fd81-51b5-4535-bbcd-5e82f73803c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8596496d78147109590ca29be18dd02'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:06.293017 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-1de8fd81-51b5-4535-bbcd-5e82f73803c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8596496d78147109590ca29be18dd02'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:06.293683 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-1de8fd81-51b5-4535-bbcd-5e82f73803c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8596496d78147109590ca29be18dd02'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:06.367942 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-2ef62164-4fc4-4725-8e58-e20db94b68a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30ae03d4340d4804927d24441891c928'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:06.368514 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-2ef62164-4fc4-4725-8e58-e20db94b68a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30ae03d4340d4804927d24441891c928'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:06.375428 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-2ef62164-4fc4-4725-8e58-e20db94b68a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30ae03d4340d4804927d24441891c928'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:06.387026 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-2ef62164-4fc4-4725-8e58-e20db94b68a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30ae03d4340d4804927d24441891c928'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:06.387661 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-2ef62164-4fc4-4725-8e58-e20db94b68a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30ae03d4340d4804927d24441891c928'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:06.399886 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 983/1980] 10.222.0.86 () {58 vars in 1223 bytes} [Tue Jun 7 14:42:06 2022] DELETE /identity/v3/users/b8596496d78147109590ca29be18dd02 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:42:06.402765 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de8fd81-51b5-4535-bbcd-5e82f73803c9 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:06.402765 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-1de8fd81-51b5-4535-bbcd-5e82f73803c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:42:06.451939 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:42:06.467067 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de8fd81-51b5-4535-bbcd-5e82f73803c9 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:06.472065 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df69a8d-5a11-45fa-8f89-8a58583b305b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:06.472738 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df69a8d-5a11-45fa-8f89-8a58583b305b admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:06.473026 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df69a8d-5a11-45fa-8f89-8a58583b305b admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:06.473309 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df69a8d-5a11-45fa-8f89-8a58583b305b admin admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:06.474099 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df69a8d-5a11-45fa-8f89-8a58583b305b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:42:06.474413 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df69a8d-5a11-45fa-8f89-8a58583b305b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:06.476665 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df69a8d-5a11-45fa-8f89-8a58583b305b admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:06.488579 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 984/1981] 10.222.0.86 () {58 vars in 1152 bytes} [Tue Jun 7 14:42:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:42:06.489850 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3366e8c3-3b73-4e60-9a7b-e30373733678 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:06.490139 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3366e8c3-3b73-4e60-9a7b-e30373733678 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:06.490423 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3366e8c3-3b73-4e60-9a7b-e30373733678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:06.507299 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-3366e8c3-3b73-4e60-9a7b-e30373733678 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:42:06.509450 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-3366e8c3-3b73-4e60-9a7b-e30373733678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:42:06.516453 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 985/1982] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:42:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:42:06.517368 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3366e8c3-3b73-4e60-9a7b-e30373733678 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:06.518577 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-3366e8c3-3b73-4e60-9a7b-e30373733678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:42:06.533496 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3366e8c3-3b73-4e60-9a7b-e30373733678 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:06.535280 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 998/1983] 10.222.0.86 () {58 vars in 1223 bytes} [Tue Jun 7 14:42:06 2022] DELETE /identity/v3/users/30ae03d4340d4804927d24441891c928 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:42:06.536182 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef62164-4fc4-4725-8e58-e20db94b68a3 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:06.538351 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-2ef62164-4fc4-4725-8e58-e20db94b68a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:42:06.603846 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981c2e88-e327-4a2c-8d18-0a1e0b42359a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:06.604528 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981c2e88-e327-4a2c-8d18-0a1e0b42359a admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:06.604821 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981c2e88-e327-4a2c-8d18-0a1e0b42359a admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:06.605473 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981c2e88-e327-4a2c-8d18-0a1e0b42359a admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:06.606007 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981c2e88-e327-4a2c-8d18-0a1e0b42359a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:06.608216 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981c2e88-e327-4a2c-8d18-0a1e0b42359a admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:06.615911 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef62164-4fc4-4725-8e58-e20db94b68a3 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:06.619845 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5a786d-b8f7-4b4e-98c9-bf86fd6d3857 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dda603ec5517460a83c333db2af804d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:06.620555 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5a786d-b8f7-4b4e-98c9-bf86fd6d3857 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:06.620823 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5a786d-b8f7-4b4e-98c9-bf86fd6d3857 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:06.624555 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5a786d-b8f7-4b4e-98c9-bf86fd6d3857 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:06.634668 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5a786d-b8f7-4b4e-98c9-bf86fd6d3857 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:06.636196 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5a786d-b8f7-4b4e-98c9-bf86fd6d3857 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:06.646406 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 999/1984] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:42:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:42:06.738532 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 986/1985] 10.222.0.86 () {60 vars in 1152 bytes} [Tue Jun 7 14:42:06 2022] POST /identity/v3/projects => generated 365 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:42:06.742610 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5a786d-b8f7-4b4e-98c9-bf86fd6d3857 service neutron] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:06.753595 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5a786d-b8f7-4b4e-98c9-bf86fd6d3857 service neutron] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:06.823842 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e67325-d8e2-441b-85bc-b252318a745d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:06.823842 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e67325-d8e2-441b-85bc-b252318a745d admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:06.823842 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e67325-d8e2-441b-85bc-b252318a745d admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:06.823842 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e67325-d8e2-441b-85bc-b252318a745d admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:06.824159 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e67325-d8e2-441b-85bc-b252318a745d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:06.825711 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e67325-d8e2-441b-85bc-b252318a745d admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:06.956742 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1000/1986] 10.222.0.86 () {60 vars in 1143 bytes} [Tue Jun 7 14:42:06 2022] POST /identity/v3/users => generated 283 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:42:06.958080 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981c2e88-e327-4a2c-8d18-0a1e0b42359a admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:06.970942 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981c2e88-e327-4a2c-8d18-0a1e0b42359a admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:06.984177 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b205f57-2a6e-4df9-a6c7-cf109c7f26e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:06.985103 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b205f57-2a6e-4df9-a6c7-cf109c7f26e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:06.985266 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b205f57-2a6e-4df9-a6c7-cf109c7f26e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:06.985469 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b205f57-2a6e-4df9-a6c7-cf109c7f26e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:06.986241 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b205f57-2a6e-4df9-a6c7-cf109c7f26e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:06.988517 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b205f57-2a6e-4df9-a6c7-cf109c7f26e7 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:07.003656 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 987/1987] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:42:06 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 07 14:42:07.005395 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e67325-d8e2-441b-85bc-b252318a745d admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:07.015944 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e67325-d8e2-441b-85bc-b252318a745d admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:07.021895 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbf5324-c50c-4e64-9d07-1ab341fdc2f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:07.022675 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbf5324-c50c-4e64-9d07-1ab341fdc2f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:07.023057 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbf5324-c50c-4e64-9d07-1ab341fdc2f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:07.023790 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbf5324-c50c-4e64-9d07-1ab341fdc2f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:07.024533 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbf5324-c50c-4e64-9d07-1ab341fdc2f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:07.026217 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbf5324-c50c-4e64-9d07-1ab341fdc2f3 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:07.039836 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1001/1988] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:42:07 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 07 14:42:07.042488 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b205f57-2a6e-4df9-a6c7-cf109c7f26e7 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:07.049465 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbf5324-c50c-4e64-9d07-1ab341fdc2f3 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:07.055653 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-5bbf5324-c50c-4e64-9d07-1ab341fdc2f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:42:07.055816 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b205f57-2a6e-4df9-a6c7-cf109c7f26e7 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:07.060538 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ba481d-71a1-4f0b-b6c9-e4c899673dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:07.061452 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ba481d-71a1-4f0b-b6c9-e4c899673dd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:07.062283 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ba481d-71a1-4f0b-b6c9-e4c899673dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:07.062283 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ba481d-71a1-4f0b-b6c9-e4c899673dd1 admin admin] PATH_INFO: `/v3/projects/f9d78cdf610f421684e8417f87a9d3a9/users/39de829aec0a4dd3be9e3e00ca006357/roles/c17acc2a8bb348f59ba7edd22fcf0c47` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:07.070911 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbf5324-c50c-4e64-9d07-1ab341fdc2f3 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:07.076609 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10668c6a-8fee-414d-ba4a-739eff8f7d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:07.078156 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10668c6a-8fee-414d-ba4a-739eff8f7d28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:07.078156 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10668c6a-8fee-414d-ba4a-739eff8f7d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:07.078341 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10668c6a-8fee-414d-ba4a-739eff8f7d28 admin admin] PATH_INFO: `/v3/projects/210e2cd9923d45b2b9f2920c7e331b53` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:07.079591 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10668c6a-8fee-414d-ba4a-739eff8f7d28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=210e2cd9923d45b2b9f2920c7e331b53)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:07.082113 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ba481d-71a1-4f0b-b6c9-e4c899673dd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9d78cdf610f421684e8417f87a9d3a9, user_id=39de829aec0a4dd3be9e3e00ca006357, role_id=c17acc2a8bb348f59ba7edd22fcf0c47)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:07.084305 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10668c6a-8fee-414d-ba4a-739eff8f7d28 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:07.085015 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ba481d-71a1-4f0b-b6c9-e4c899673dd1 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:07.096343 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:42:07.186735 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 988/1989] 10.222.0.86 () {60 vars in 1482 bytes} [Tue Jun 7 14:42:07 2022] PUT /identity/v3/projects/f9d78cdf610f421684e8417f87a9d3a9/users/39de829aec0a4dd3be9e3e00ca006357/roles/c17acc2a8bb348f59ba7edd22fcf0c47 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:42:07.198487 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cfdd62-a4b0-4909-a799-d0d33da88b3b None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:07.198771 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cfdd62-a4b0-4909-a799-d0d33da88b3b None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:07.199053 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cfdd62-a4b0-4909-a799-d0d33da88b3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:07.229675 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-22cfdd62-a4b0-4909-a799-d0d33da88b3b None None] MFA Rules not processed for user `39de829aec0a4dd3be9e3e00ca006357`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:42:07.230903 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-22cfdd62-a4b0-4909-a799-d0d33da88b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:42:07.247103 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-10668c6a-8fee-414d-ba4a-739eff8f7d28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '210e2cd9923d45b2b9f2920c7e331b53', 'request_id': 'req-10668c6a-8fee-414d-ba4a-739eff8f7d28'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:07.263333 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-10668c6a-8fee-414d-ba4a-739eff8f7d28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '210e2cd9923d45b2b9f2920c7e331b53', 'request_id': 'req-10668c6a-8fee-414d-ba4a-739eff8f7d28'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:07.298314 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 989/1990] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:42:07 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:42:07.299224 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cfdd62-a4b0-4909-a799-d0d33da88b3b None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:07.300622 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-22cfdd62-a4b0-4909-a799-d0d33da88b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:42:07.320570 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:42:07.353313 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-10668c6a-8fee-414d-ba4a-739eff8f7d28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '210e2cd9923d45b2b9f2920c7e331b53', 'request_id': 'req-10668c6a-8fee-414d-ba4a-739eff8f7d28'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:07.366354 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cfdd62-a4b0-4909-a799-d0d33da88b3b None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:07.367506 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-10668c6a-8fee-414d-ba4a-739eff8f7d28 admin admin] The token cache is being invalidate because project 210e2cd9923d45b2b9f2920c7e331b53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:42:07.367835 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-10668c6a-8fee-414d-ba4a-739eff8f7d28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:07.368504 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-10668c6a-8fee-414d-ba4a-739eff8f7d28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:07.370292 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1002/1991] 10.222.0.86 () {58 vars in 1232 bytes} [Tue Jun 7 14:42:07 2022] DELETE /identity/v3/projects/210e2cd9923d45b2b9f2920c7e331b53 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:42:07.371226 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10668c6a-8fee-414d-ba4a-739eff8f7d28 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:07.371460 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d663895d-47d9-455a-9b2e-95c89478c37f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:07.372363 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d663895d-47d9-455a-9b2e-95c89478c37f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:07.372646 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d663895d-47d9-455a-9b2e-95c89478c37f admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:07.372927 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d663895d-47d9-455a-9b2e-95c89478c37f admin admin] PATH_INFO: `/v3/projects/930b56242dae4f6b94ad9a6fe763779f` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:07.374132 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d663895d-47d9-455a-9b2e-95c89478c37f admin admin] RBAC: Authorizing `identity:delete_project(project_id=930b56242dae4f6b94ad9a6fe763779f)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:07.374843 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-10668c6a-8fee-414d-ba4a-739eff8f7d28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:42:07.376041 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d663895d-47d9-455a-9b2e-95c89478c37f admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:07.432472 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10668c6a-8fee-414d-ba4a-739eff8f7d28 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:07.436323 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b4c195-1be0-4f5c-92ca-16fc58131ff4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af5a95620a4b43538abfe09eed4bf115', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:07.437045 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b4c195-1be0-4f5c-92ca-16fc58131ff4 service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:07.437282 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b4c195-1be0-4f5c-92ca-16fc58131ff4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:07.437559 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b4c195-1be0-4f5c-92ca-16fc58131ff4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:07.439450 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-c8b4c195-1be0-4f5c-92ca-16fc58131ff4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:42:07.451149 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b4c195-1be0-4f5c-92ca-16fc58131ff4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:07.452769 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b4c195-1be0-4f5c-92ca-16fc58131ff4 service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:07.462681 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1003/1992] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:42:07 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:42:07.464489 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff004c3-b547-4478-8916-cfd32a8bfa80 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:07.464788 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff004c3-b547-4478-8916-cfd32a8bfa80 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:07.465110 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff004c3-b547-4478-8916-cfd32a8bfa80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:07.474435 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-d663895d-47d9-455a-9b2e-95c89478c37f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '930b56242dae4f6b94ad9a6fe763779f', 'request_id': 'req-d663895d-47d9-455a-9b2e-95c89478c37f'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:07.481620 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-d663895d-47d9-455a-9b2e-95c89478c37f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '930b56242dae4f6b94ad9a6fe763779f', 'request_id': 'req-d663895d-47d9-455a-9b2e-95c89478c37f'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:07.483132 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-bff004c3-b547-4478-8916-cfd32a8bfa80 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:42:07.484616 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-bff004c3-b547-4478-8916-cfd32a8bfa80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:42:07.548846 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1004/1993] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:42:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:42:07.556435 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890fc205-a728-4165-9b0d-ec1578dd0dbf None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:07.556729 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890fc205-a728-4165-9b0d-ec1578dd0dbf None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:07.557003 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890fc205-a728-4165-9b0d-ec1578dd0dbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:07.569391 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-d663895d-47d9-455a-9b2e-95c89478c37f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '930b56242dae4f6b94ad9a6fe763779f', 'request_id': 'req-d663895d-47d9-455a-9b2e-95c89478c37f'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:07.576445 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-890fc205-a728-4165-9b0d-ec1578dd0dbf None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:42:07.579282 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-890fc205-a728-4165-9b0d-ec1578dd0dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:42:07.581174 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-d663895d-47d9-455a-9b2e-95c89478c37f admin admin] The token cache is being invalidate because project 930b56242dae4f6b94ad9a6fe763779f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:42:07.582014 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-d663895d-47d9-455a-9b2e-95c89478c37f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:07.582140 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-d663895d-47d9-455a-9b2e-95c89478c37f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:07.583854 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 990/1994] 10.222.0.86 () {58 vars in 1232 bytes} [Tue Jun 7 14:42:07 2022] DELETE /identity/v3/projects/930b56242dae4f6b94ad9a6fe763779f => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:42:07.588439 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d663895d-47d9-455a-9b2e-95c89478c37f admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:07.590094 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-d663895d-47d9-455a-9b2e-95c89478c37f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:42:07.595149 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1005/1995] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:42:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:42:07.596305 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890fc205-a728-4165-9b0d-ec1578dd0dbf None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:07.604184 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d663895d-47d9-455a-9b2e-95c89478c37f admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:07.608184 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890fc205-a728-4165-9b0d-ec1578dd0dbf None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:07.610510 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a059fdd9-238a-4e72-aaed-3523a717ba63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:07.610900 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4999ec-97d0-46ad-9c71-336079b5dda5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:07.611388 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a059fdd9-238a-4e72-aaed-3523a717ba63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:07.611677 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a059fdd9-238a-4e72-aaed-3523a717ba63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:07.611799 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4999ec-97d0-46ad-9c71-336079b5dda5 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:07.611990 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a059fdd9-238a-4e72-aaed-3523a717ba63 admin admin] PATH_INFO: `/v3/users/044a19807e7549e6bb79eaa4be5222df` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:07.612190 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4999ec-97d0-46ad-9c71-336079b5dda5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:07.612543 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4999ec-97d0-46ad-9c71-336079b5dda5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:07.613205 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a059fdd9-238a-4e72-aaed-3523a717ba63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=044a19807e7549e6bb79eaa4be5222df)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:07.613321 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4999ec-97d0-46ad-9c71-336079b5dda5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:42:07.613614 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4999ec-97d0-46ad-9c71-336079b5dda5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:07.615192 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a059fdd9-238a-4e72-aaed-3523a717ba63 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:07.615316 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4999ec-97d0-46ad-9c71-336079b5dda5 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:07.627788 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1006/1996] 10.222.0.86 () {58 vars in 1152 bytes} [Tue Jun 7 14:42:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:42:07.632159 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4999ec-97d0-46ad-9c71-336079b5dda5 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:07.641972 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4999ec-97d0-46ad-9c71-336079b5dda5 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:07.646984 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eb4a88-1ed0-4427-8ce8-a69207260de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:07.647634 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eb4a88-1ed0-4427-8ce8-a69207260de9 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:07.647957 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eb4a88-1ed0-4427-8ce8-a69207260de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:07.648250 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eb4a88-1ed0-4427-8ce8-a69207260de9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:07.649151 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0eb4a88-1ed0-4427-8ce8-a69207260de9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:07.650978 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0eb4a88-1ed0-4427-8ce8-a69207260de9 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:07.766560 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:42:07.773360 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1007/1997] 10.222.0.86 () {60 vars in 1152 bytes} [Tue Jun 7 14:42:07 2022] POST /identity/v3/projects => generated 405 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 14:42:07.780816 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eb4a88-1ed0-4427-8ce8-a69207260de9 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:07.813127 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-a059fdd9-238a-4e72-aaed-3523a717ba63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '044a19807e7549e6bb79eaa4be5222df'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:07.820199 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-a059fdd9-238a-4e72-aaed-3523a717ba63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '044a19807e7549e6bb79eaa4be5222df'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:07.820938 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-a059fdd9-238a-4e72-aaed-3523a717ba63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '044a19807e7549e6bb79eaa4be5222df'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:07.833280 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-a059fdd9-238a-4e72-aaed-3523a717ba63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '044a19807e7549e6bb79eaa4be5222df'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:07.833996 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-a059fdd9-238a-4e72-aaed-3523a717ba63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '044a19807e7549e6bb79eaa4be5222df'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:07.845121 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eb4a88-1ed0-4427-8ce8-a69207260de9 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:07.850390 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9a6dc7-5820-4160-808c-c47aa17aea7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:07.851062 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9a6dc7-5820-4160-808c-c47aa17aea7f admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:07.851350 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9a6dc7-5820-4160-808c-c47aa17aea7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:07.851630 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9a6dc7-5820-4160-808c-c47aa17aea7f admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:07.852370 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9a6dc7-5820-4160-808c-c47aa17aea7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:07.854322 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9a6dc7-5820-4160-808c-c47aa17aea7f admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:07.924764 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 991/1998] 10.222.0.86 () {58 vars in 1223 bytes} [Tue Jun 7 14:42:07 2022] DELETE /identity/v3/users/044a19807e7549e6bb79eaa4be5222df => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:42:07.986039 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1008/1999] 10.222.0.86 () {60 vars in 1143 bytes} [Tue Jun 7 14:42:07 2022] POST /identity/v3/users => generated 303 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 14:42:07.987363 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a059fdd9-238a-4e72-aaed-3523a717ba63 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:07.988981 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-a059fdd9-238a-4e72-aaed-3523a717ba63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:42:08.013707 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:42:08.058842 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a059fdd9-238a-4e72-aaed-3523a717ba63 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:08.063595 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5513a0-1094-4d41-a9e1-2060cc373ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:08.064292 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5513a0-1094-4d41-a9e1-2060cc373ddb admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:08.064580 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5513a0-1094-4d41-a9e1-2060cc373ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:08.064855 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5513a0-1094-4d41-a9e1-2060cc373ddb admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:08.065598 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5513a0-1094-4d41-a9e1-2060cc373ddb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:08.067180 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5513a0-1094-4d41-a9e1-2060cc373ddb admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:08.077691 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 992/2000] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:42:07 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 07 14:42:08.081676 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9a6dc7-5820-4160-808c-c47aa17aea7f admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:08.091620 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9a6dc7-5820-4160-808c-c47aa17aea7f admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:08.096993 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86057f82-dea9-4984-8cd1-3d5db4e3e029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:08.097723 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86057f82-dea9-4984-8cd1-3d5db4e3e029 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:08.100798 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86057f82-dea9-4984-8cd1-3d5db4e3e029 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:08.100798 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86057f82-dea9-4984-8cd1-3d5db4e3e029 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:08.100798 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86057f82-dea9-4984-8cd1-3d5db4e3e029 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:08.100798 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86057f82-dea9-4984-8cd1-3d5db4e3e029 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:08.110639 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1009/2001] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:42:08 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:42:08.114757 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5513a0-1094-4d41-a9e1-2060cc373ddb admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:08.125607 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5513a0-1094-4d41-a9e1-2060cc373ddb admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:08.131949 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f736f1-795c-489a-a38e-520682357c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:08.135434 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f736f1-795c-489a-a38e-520682357c82 admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:08.135434 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f736f1-795c-489a-a38e-520682357c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:08.135434 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f736f1-795c-489a-a38e-520682357c82 admin admin] PATH_INFO: `/v3/projects/1f615bed99314d20b8dfeb70f0eb3ad9/users/876debec47204fb0aee1815449835b35/roles/c17acc2a8bb348f59ba7edd22fcf0c47` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:08.176026 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f736f1-795c-489a-a38e-520682357c82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f615bed99314d20b8dfeb70f0eb3ad9, user_id=876debec47204fb0aee1815449835b35, role_id=c17acc2a8bb348f59ba7edd22fcf0c47)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:08.178179 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f736f1-795c-489a-a38e-520682357c82 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:08.267882 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 993/2002] 10.222.0.86 () {60 vars in 1482 bytes} [Tue Jun 7 14:42:08 2022] PUT /identity/v3/projects/1f615bed99314d20b8dfeb70f0eb3ad9/users/876debec47204fb0aee1815449835b35/roles/c17acc2a8bb348f59ba7edd22fcf0c47 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:42:08.273555 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36cab81-a879-4287-81b8-73d35c07f9eb None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:08.273858 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36cab81-a879-4287-81b8-73d35c07f9eb None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:08.274140 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36cab81-a879-4287-81b8-73d35c07f9eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:08.296608 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-e36cab81-a879-4287-81b8-73d35c07f9eb None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:42:08.298010 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-e36cab81-a879-4287-81b8-73d35c07f9eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:42:08.360665 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1010/2003] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:42:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:42:08.370090 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f736f1-795c-489a-a38e-520682357c82 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:08.371992 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-91f736f1-795c-489a-a38e-520682357c82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:42:08.427517 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f736f1-795c-489a-a38e-520682357c82 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:08.434695 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ed1ebe-1f27-4b07-8447-5e75077db5f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dda603ec5517460a83c333db2af804d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:08.435454 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ed1ebe-1f27-4b07-8447-5e75077db5f0 service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:08.435743 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ed1ebe-1f27-4b07-8447-5e75077db5f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:08.435967 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36cab81-a879-4287-81b8-73d35c07f9eb None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:08.436100 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ed1ebe-1f27-4b07-8447-5e75077db5f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:08.437607 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-e36cab81-a879-4287-81b8-73d35c07f9eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:42:08.448623 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ed1ebe-1f27-4b07-8447-5e75077db5f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:08.450792 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ed1ebe-1f27-4b07-8447-5e75077db5f0 service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:08.454056 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36cab81-a879-4287-81b8-73d35c07f9eb None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:08.459086 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80823b04-4d0f-481e-aefd-bf4c3671c6b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:08.460738 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80823b04-4d0f-481e-aefd-bf4c3671c6b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:08.461842 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80823b04-4d0f-481e-aefd-bf4c3671c6b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:08.462465 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80823b04-4d0f-481e-aefd-bf4c3671c6b7 admin admin] PATH_INFO: `/v3/projects/b01174c5c614450e84e526fb5a13f6cc` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:08.463780 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80823b04-4d0f-481e-aefd-bf4c3671c6b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b01174c5c614450e84e526fb5a13f6cc)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:08.465481 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 994/2004] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:42:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:42:08.466026 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80823b04-4d0f-481e-aefd-bf4c3671c6b7 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:08.704519 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-80823b04-4d0f-481e-aefd-bf4c3671c6b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b01174c5c614450e84e526fb5a13f6cc', 'request_id': 'req-80823b04-4d0f-481e-aefd-bf4c3671c6b7'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:08.710800 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-80823b04-4d0f-481e-aefd-bf4c3671c6b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b01174c5c614450e84e526fb5a13f6cc', 'request_id': 'req-80823b04-4d0f-481e-aefd-bf4c3671c6b7'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:08.845055 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-80823b04-4d0f-481e-aefd-bf4c3671c6b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b01174c5c614450e84e526fb5a13f6cc', 'request_id': 'req-80823b04-4d0f-481e-aefd-bf4c3671c6b7'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:08.857318 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-80823b04-4d0f-481e-aefd-bf4c3671c6b7 admin admin] The token cache is being invalidate because project b01174c5c614450e84e526fb5a13f6cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:42:08.857611 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-80823b04-4d0f-481e-aefd-bf4c3671c6b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:08.858772 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-80823b04-4d0f-481e-aefd-bf4c3671c6b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:08.860463 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1011/2005] 10.222.0.86 () {58 vars in 1232 bytes} [Tue Jun 7 14:42:08 2022] DELETE /identity/v3/projects/b01174c5c614450e84e526fb5a13f6cc => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:42:08.865299 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1542d970-2ae7-40cc-b424-cedd34092423 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:08.865797 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1542d970-2ae7-40cc-b424-cedd34092423 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:08.867985 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1542d970-2ae7-40cc-b424-cedd34092423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:08.884316 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-1542d970-2ae7-40cc-b424-cedd34092423 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:42:08.885535 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-1542d970-2ae7-40cc-b424-cedd34092423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:42:08.946957 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 995/2006] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:42:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:42:08.954568 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befdaddc-3b07-4914-96aa-b38be1069e79 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:08.954865 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befdaddc-3b07-4914-96aa-b38be1069e79 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:08.955148 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befdaddc-3b07-4914-96aa-b38be1069e79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:08.962158 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:42:08.974652 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-befdaddc-3b07-4914-96aa-b38be1069e79 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:42:08.976579 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-befdaddc-3b07-4914-96aa-b38be1069e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:42:08.984585 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1012/2007] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:42:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:42:08.988789 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1542d970-2ae7-40cc-b424-cedd34092423 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:08.998450 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1542d970-2ae7-40cc-b424-cedd34092423 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:09.003265 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ef3e46-dbf4-4de7-ab67-64af5aee0730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:09.004108 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ef3e46-dbf4-4de7-ab67-64af5aee0730 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:09.004397 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ef3e46-dbf4-4de7-ab67-64af5aee0730 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:09.004673 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ef3e46-dbf4-4de7-ab67-64af5aee0730 admin admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:09.005409 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ef3e46-dbf4-4de7-ab67-64af5aee0730 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:42:09.005718 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ef3e46-dbf4-4de7-ab67-64af5aee0730 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:09.007850 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ef3e46-dbf4-4de7-ab67-64af5aee0730 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:09.019843 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 996/2008] 10.222.0.86 () {58 vars in 1152 bytes} [Tue Jun 7 14:42:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:42:09.024750 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befdaddc-3b07-4914-96aa-b38be1069e79 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:09.033988 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befdaddc-3b07-4914-96aa-b38be1069e79 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:09.038743 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cc8962-1ffe-4d19-8e7c-24249d121c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:09.039405 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cc8962-1ffe-4d19-8e7c-24249d121c4e admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:09.039931 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cc8962-1ffe-4d19-8e7c-24249d121c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:09.040024 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cc8962-1ffe-4d19-8e7c-24249d121c4e admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:09.040678 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cc8962-1ffe-4d19-8e7c-24249d121c4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:09.042576 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cc8962-1ffe-4d19-8e7c-24249d121c4e admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:09.171619 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1013/2009] 10.222.0.86 () {60 vars in 1152 bytes} [Tue Jun 7 14:42:09 2022] POST /identity/v3/projects => generated 399 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 14:42:09.176342 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ef3e46-dbf4-4de7-ab67-64af5aee0730 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:09.188495 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ef3e46-dbf4-4de7-ab67-64af5aee0730 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:09.208988 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:42:09.253061 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb81c6e1-d50c-4c01-9293-cdafe9c99873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:09.253811 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb81c6e1-d50c-4c01-9293-cdafe9c99873 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:09.254162 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb81c6e1-d50c-4c01-9293-cdafe9c99873 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:09.254504 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb81c6e1-d50c-4c01-9293-cdafe9c99873 admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:09.255412 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb81c6e1-d50c-4c01-9293-cdafe9c99873 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:09.258161 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb81c6e1-d50c-4c01-9293-cdafe9c99873 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:09.386404 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 997/2010] 10.222.0.86 () {60 vars in 1143 bytes} [Tue Jun 7 14:42:09 2022] POST /identity/v3/users => generated 300 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:42:09.387819 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cc8962-1ffe-4d19-8e7c-24249d121c4e admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:09.405170 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cc8962-1ffe-4d19-8e7c-24249d121c4e admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:09.409824 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9579bba8-af8f-49ec-98e0-50378dd86f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:09.410497 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9579bba8-af8f-49ec-98e0-50378dd86f99 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:09.410782 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9579bba8-af8f-49ec-98e0-50378dd86f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:09.411061 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9579bba8-af8f-49ec-98e0-50378dd86f99 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:09.411855 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9579bba8-af8f-49ec-98e0-50378dd86f99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:09.413515 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9579bba8-af8f-49ec-98e0-50378dd86f99 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:09.424217 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1014/2011] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:42:09 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:42:09.428647 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb81c6e1-d50c-4c01-9293-cdafe9c99873 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:09.438510 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb81c6e1-d50c-4c01-9293-cdafe9c99873 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:09.444572 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee7d6a4-6fba-4020-b844-800daaca9d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:09.445249 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee7d6a4-6fba-4020-b844-800daaca9d62 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:09.445542 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee7d6a4-6fba-4020-b844-800daaca9d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:09.445832 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee7d6a4-6fba-4020-b844-800daaca9d62 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:09.446578 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee7d6a4-6fba-4020-b844-800daaca9d62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:09.448543 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee7d6a4-6fba-4020-b844-800daaca9d62 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:09.459128 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 998/2012] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:42:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 07 14:42:09.463355 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9579bba8-af8f-49ec-98e0-50378dd86f99 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:09.473032 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9579bba8-af8f-49ec-98e0-50378dd86f99 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:09.478596 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ea2ed5-26b9-4fbf-99be-ea21dd2b8862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:09.478596 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ea2ed5-26b9-4fbf-99be-ea21dd2b8862 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:09.478788 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ea2ed5-26b9-4fbf-99be-ea21dd2b8862 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:09.478919 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ea2ed5-26b9-4fbf-99be-ea21dd2b8862 admin admin] PATH_INFO: `/v3/projects/fd8b679172324a03b932807a03ed4fbb/users/a0ee076dbdae463a8d241745fe2b52dc/roles/c17acc2a8bb348f59ba7edd22fcf0c47` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:09.493654 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ea2ed5-26b9-4fbf-99be-ea21dd2b8862 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd8b679172324a03b932807a03ed4fbb, user_id=a0ee076dbdae463a8d241745fe2b52dc, role_id=c17acc2a8bb348f59ba7edd22fcf0c47)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:09.496518 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ea2ed5-26b9-4fbf-99be-ea21dd2b8862 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:09.581824 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1015/2013] 10.222.0.86 () {60 vars in 1482 bytes} [Tue Jun 7 14:42:09 2022] PUT /identity/v3/projects/fd8b679172324a03b932807a03ed4fbb/users/a0ee076dbdae463a8d241745fe2b52dc/roles/c17acc2a8bb348f59ba7edd22fcf0c47 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:42:09.592986 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dd067c-4281-4aa2-bdd6-b73744b1666a None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:09.593283 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dd067c-4281-4aa2-bdd6-b73744b1666a None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:09.593562 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dd067c-4281-4aa2-bdd6-b73744b1666a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:09.620342 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-37dd067c-4281-4aa2-bdd6-b73744b1666a None None] MFA Rules not processed for user `a0ee076dbdae463a8d241745fe2b52dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:42:09.621570 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-37dd067c-4281-4aa2-bdd6-b73744b1666a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:42:09.689048 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 999/2014] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:42:09 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:42:09.693449 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ea2ed5-26b9-4fbf-99be-ea21dd2b8862 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:09.753400 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ea2ed5-26b9-4fbf-99be-ea21dd2b8862 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:09.758730 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661a254b-9995-4043-8676-065da6a852ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:09.759387 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661a254b-9995-4043-8676-065da6a852ab admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:09.759694 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661a254b-9995-4043-8676-065da6a852ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:09.759988 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661a254b-9995-4043-8676-065da6a852ab admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:09.760719 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661a254b-9995-4043-8676-065da6a852ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:09.762613 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661a254b-9995-4043-8676-065da6a852ab admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:09.890447 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1016/2015] 10.222.0.86 () {60 vars in 1152 bytes} [Tue Jun 7 14:42:09 2022] POST /identity/v3/projects => generated 401 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:42:09.895269 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dd067c-4281-4aa2-bdd6-b73744b1666a None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:09.905713 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dd067c-4281-4aa2-bdd6-b73744b1666a None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:09.965790 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4f1aed-011e-4883-84c8-04942025fd3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:09.966396 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4f1aed-011e-4883-84c8-04942025fd3f admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:09.966687 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4f1aed-011e-4883-84c8-04942025fd3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:09.966970 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4f1aed-011e-4883-84c8-04942025fd3f admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:09.967776 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4f1aed-011e-4883-84c8-04942025fd3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:09.969706 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4f1aed-011e-4883-84c8-04942025fd3f admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:10.023825 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26942d97-37f7-496c-8e4b-b901a79da729 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:10.023996 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26942d97-37f7-496c-8e4b-b901a79da729 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:10.024183 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26942d97-37f7-496c-8e4b-b901a79da729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:10.051797 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-26942d97-37f7-496c-8e4b-b901a79da729 None None] MFA Rules not processed for user `876debec47204fb0aee1815449835b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:42:10.053085 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-26942d97-37f7-496c-8e4b-b901a79da729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:42:10.114974 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1000/2016] 10.222.0.86 () {60 vars in 1143 bytes} [Tue Jun 7 14:42:09 2022] POST /identity/v3/users => generated 307 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 14:42:10.118382 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4f1aed-011e-4883-84c8-04942025fd3f admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:10.120925 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1017/2017] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:42:10 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:42:10.128690 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4f1aed-011e-4883-84c8-04942025fd3f admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:10.134465 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2001cbe2-48bf-4b84-8270-9cf1a90c4047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:10.134629 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26942d97-37f7-496c-8e4b-b901a79da729 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:10.135284 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2001cbe2-48bf-4b84-8270-9cf1a90c4047 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:10.135631 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2001cbe2-48bf-4b84-8270-9cf1a90c4047 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:10.135869 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-26942d97-37f7-496c-8e4b-b901a79da729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:42:10.136067 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2001cbe2-48bf-4b84-8270-9cf1a90c4047 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:10.136903 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2001cbe2-48bf-4b84-8270-9cf1a90c4047 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:10.138568 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2001cbe2-48bf-4b84-8270-9cf1a90c4047 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:10.152919 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1001/2018] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:42:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:42:10.153105 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26942d97-37f7-496c-8e4b-b901a79da729 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:10.154066 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2001cbe2-48bf-4b84-8270-9cf1a90c4047 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:10.155879 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08062c8f-100c-40ea-80d4-b24cd1399b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:10.156673 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08062c8f-100c-40ea-80d4-b24cd1399b04 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:10.156969 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08062c8f-100c-40ea-80d4-b24cd1399b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:10.159677 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08062c8f-100c-40ea-80d4-b24cd1399b04 admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:10.159677 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08062c8f-100c-40ea-80d4-b24cd1399b04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:10.160088 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08062c8f-100c-40ea-80d4-b24cd1399b04 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:10.164473 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2001cbe2-48bf-4b84-8270-9cf1a90c4047 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:10.169722 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f970925a-cadb-4ebf-93fa-d81a75bc1fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:10.170627 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f970925a-cadb-4ebf-93fa-d81a75bc1fb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:10.170920 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f970925a-cadb-4ebf-93fa-d81a75bc1fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:10.171153 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:42:10.171285 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f970925a-cadb-4ebf-93fa-d81a75bc1fb4 admin admin] PATH_INFO: `/v3/projects/b56b9beb9fdd4526a627f34c6c9d26b1/users/cd8cf96966cd42798eaf71a8117b773d/roles/e3bf6239f5bf477b965704b086786f11` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:10.173535 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:42:10.187245 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f970925a-cadb-4ebf-93fa-d81a75bc1fb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b56b9beb9fdd4526a627f34c6c9d26b1, user_id=cd8cf96966cd42798eaf71a8117b773d, role_id=e3bf6239f5bf477b965704b086786f11)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:10.189955 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f970925a-cadb-4ebf-93fa-d81a75bc1fb4 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:10.245128 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1018/2019] 10.222.0.86 () {60 vars in 1152 bytes} [Tue Jun 7 14:42:10 2022] POST /identity/v3/projects => generated 405 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 14:42:10.249037 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08062c8f-100c-40ea-80d4-b24cd1399b04 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:10.278529 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1002/2020] 10.222.0.86 () {60 vars in 1482 bytes} [Tue Jun 7 14:42:10 2022] PUT /identity/v3/projects/b56b9beb9fdd4526a627f34c6c9d26b1/users/cd8cf96966cd42798eaf71a8117b773d/roles/e3bf6239f5bf477b965704b086786f11 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:42:10.282285 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f970925a-cadb-4ebf-93fa-d81a75bc1fb4 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:10.313154 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08062c8f-100c-40ea-80d4-b24cd1399b04 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:10.353047 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f970925a-cadb-4ebf-93fa-d81a75bc1fb4 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:10.359145 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218766aa-0b2f-4193-9da9-e28c5f23b4b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:10.359906 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218766aa-0b2f-4193-9da9-e28c5f23b4b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:10.360183 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218766aa-0b2f-4193-9da9-e28c5f23b4b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:10.360403 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218766aa-0b2f-4193-9da9-e28c5f23b4b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:10.361141 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218766aa-0b2f-4193-9da9-e28c5f23b4b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:10.363286 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218766aa-0b2f-4193-9da9-e28c5f23b4b3 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:10.377976 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1003/2021] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:42:10 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 07 14:42:10.378113 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae5d1e0-9ebc-4862-ae4b-a927c3190165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:10.378113 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae5d1e0-9ebc-4862-ae4b-a927c3190165 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:10.378113 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae5d1e0-9ebc-4862-ae4b-a927c3190165 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:10.378113 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae5d1e0-9ebc-4862-ae4b-a927c3190165 admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:10.378477 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae5d1e0-9ebc-4862-ae4b-a927c3190165 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:10.378786 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218766aa-0b2f-4193-9da9-e28c5f23b4b3 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:10.380068 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae5d1e0-9ebc-4862-ae4b-a927c3190165 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:10.390459 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218766aa-0b2f-4193-9da9-e28c5f23b4b3 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:10.396470 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d2a8c9-f357-424b-bdaf-da229acf87e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:10.398013 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d2a8c9-f357-424b-bdaf-da229acf87e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:10.398013 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d2a8c9-f357-424b-bdaf-da229acf87e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:10.398013 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d2a8c9-f357-424b-bdaf-da229acf87e5 admin admin] PATH_INFO: `/v3/projects/b56b9beb9fdd4526a627f34c6c9d26b1/users/cd8cf96966cd42798eaf71a8117b773d/roles/e3bf6239f5bf477b965704b086786f11` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:10.399900 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d2a8c9-f357-424b-bdaf-da229acf87e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b56b9beb9fdd4526a627f34c6c9d26b1, user_id=cd8cf96966cd42798eaf71a8117b773d, role_id=e3bf6239f5bf477b965704b086786f11)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:10.402529 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d2a8c9-f357-424b-bdaf-da229acf87e5 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:10.423695 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1004/2022] 10.222.0.86 () {60 vars in 1482 bytes} [Tue Jun 7 14:42:10 2022] PUT /identity/v3/projects/b56b9beb9fdd4526a627f34c6c9d26b1/users/cd8cf96966cd42798eaf71a8117b773d/roles/e3bf6239f5bf477b965704b086786f11 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 14:42:10.425333 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea81ae7-48e9-4d2a-bded-3dcb56f76e4e None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:10.425816 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea81ae7-48e9-4d2a-bded-3dcb56f76e4e None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:10.426240 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea81ae7-48e9-4d2a-bded-3dcb56f76e4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:10.460984 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-5ea81ae7-48e9-4d2a-bded-3dcb56f76e4e None None] MFA Rules not processed for user `cd8cf96966cd42798eaf71a8117b773d`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:42:10.462256 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-5ea81ae7-48e9-4d2a-bded-3dcb56f76e4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:42:10.470366 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1019/2023] 10.222.0.86 () {60 vars in 1143 bytes} [Tue Jun 7 14:42:10 2022] POST /identity/v3/users => generated 309 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 14:42:10.474320 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae5d1e0-9ebc-4862-ae4b-a927c3190165 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:10.492320 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae5d1e0-9ebc-4862-ae4b-a927c3190165 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:10.542480 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1005/2024] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:42:10 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:42:10.555714 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea81ae7-48e9-4d2a-bded-3dcb56f76e4e None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:10.557431 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-5ea81ae7-48e9-4d2a-bded-3dcb56f76e4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:42:10.579232 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b70f99-7fd5-43ee-90b2-e6ff2765fd84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:10.580205 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b70f99-7fd5-43ee-90b2-e6ff2765fd84 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:10.580603 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b70f99-7fd5-43ee-90b2-e6ff2765fd84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:10.581147 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b70f99-7fd5-43ee-90b2-e6ff2765fd84 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:10.582369 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b70f99-7fd5-43ee-90b2-e6ff2765fd84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:10.584806 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b70f99-7fd5-43ee-90b2-e6ff2765fd84 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:10.601432 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1020/2025] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:42:10 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:42:10.604656 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b70f99-7fd5-43ee-90b2-e6ff2765fd84 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:10.614242 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b70f99-7fd5-43ee-90b2-e6ff2765fd84 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:10.619458 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852051ee-462b-4258-ad7b-b9d4a2def505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:10.620398 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852051ee-462b-4258-ad7b-b9d4a2def505 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:10.620683 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852051ee-462b-4258-ad7b-b9d4a2def505 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:10.620958 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852051ee-462b-4258-ad7b-b9d4a2def505 admin admin] PATH_INFO: `/v3/projects/38d626a968ab4fd7b17cd01604557a55/users/088ec620530d4f44a240a57d020e2e0d/roles/e3bf6239f5bf477b965704b086786f11` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:10.637945 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea81ae7-48e9-4d2a-bded-3dcb56f76e4e None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:10.638151 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852051ee-462b-4258-ad7b-b9d4a2def505 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38d626a968ab4fd7b17cd01604557a55, user_id=088ec620530d4f44a240a57d020e2e0d, role_id=e3bf6239f5bf477b965704b086786f11)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:10.640932 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852051ee-462b-4258-ad7b-b9d4a2def505 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:10.642229 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44d5830-2e7d-42f7-be17-b536146062e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af5a95620a4b43538abfe09eed4bf115', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:10.643558 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44d5830-2e7d-42f7-be17-b536146062e4 service cinder] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:10.643558 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44d5830-2e7d-42f7-be17-b536146062e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:10.644229 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44d5830-2e7d-42f7-be17-b536146062e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:10.650987 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:42:10.654621 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44d5830-2e7d-42f7-be17-b536146062e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:10.656062 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44d5830-2e7d-42f7-be17-b536146062e4 service cinder] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:10.666139 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1006/2026] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:42:10 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 14:42:10.715051 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:42:10.720089 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1021/2027] 10.222.0.86 () {60 vars in 1482 bytes} [Tue Jun 7 14:42:10 2022] PUT /identity/v3/projects/38d626a968ab4fd7b17cd01604557a55/users/088ec620530d4f44a240a57d020e2e0d/roles/e3bf6239f5bf477b965704b086786f11 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 14:42:10.724093 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44d5830-2e7d-42f7-be17-b536146062e4 service cinder] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:10.734843 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44d5830-2e7d-42f7-be17-b536146062e4 service cinder] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:10.793272 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911d8e48-bf61-42cb-82df-37b616a5634c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:10.793938 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911d8e48-bf61-42cb-82df-37b616a5634c admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:10.794220 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911d8e48-bf61-42cb-82df-37b616a5634c admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:10.794497 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911d8e48-bf61-42cb-82df-37b616a5634c admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:10.798480 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911d8e48-bf61-42cb-82df-37b616a5634c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:10.798480 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911d8e48-bf61-42cb-82df-37b616a5634c admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:10.806326 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1007/2028] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:42:10 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:42:10.810667 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852051ee-462b-4258-ad7b-b9d4a2def505 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:10.821570 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852051ee-462b-4258-ad7b-b9d4a2def505 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:10.827732 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd49ecf-d640-43d1-bdff-1331e800ee2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:10.827732 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd49ecf-d640-43d1-bdff-1331e800ee2a admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:10.827732 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd49ecf-d640-43d1-bdff-1331e800ee2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:10.828864 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd49ecf-d640-43d1-bdff-1331e800ee2a admin admin] PATH_INFO: `/v3/projects/38d626a968ab4fd7b17cd01604557a55/users/088ec620530d4f44a240a57d020e2e0d/roles/e3bf6239f5bf477b965704b086786f11` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:10.829754 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd49ecf-d640-43d1-bdff-1331e800ee2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=38d626a968ab4fd7b17cd01604557a55, user_id=088ec620530d4f44a240a57d020e2e0d, role_id=e3bf6239f5bf477b965704b086786f11)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:10.832481 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd49ecf-d640-43d1-bdff-1331e800ee2a admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:10.843725 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1022/2029] 10.222.0.86 () {60 vars in 1482 bytes} [Tue Jun 7 14:42:10 2022] PUT /identity/v3/projects/38d626a968ab4fd7b17cd01604557a55/users/088ec620530d4f44a240a57d020e2e0d/roles/e3bf6239f5bf477b965704b086786f11 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:42:10.920188 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911d8e48-bf61-42cb-82df-37b616a5634c admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:10.986403 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911d8e48-bf61-42cb-82df-37b616a5634c admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:11.037690 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29802b65-0936-4936-94a6-c72eb1ce2f8b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af5a95620a4b43538abfe09eed4bf115', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:11.038332 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29802b65-0936-4936-94a6-c72eb1ce2f8b service cinder] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:11.045089 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29802b65-0936-4936-94a6-c72eb1ce2f8b service cinder] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:11.045089 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29802b65-0936-4936-94a6-c72eb1ce2f8b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:11.094077 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29802b65-0936-4936-94a6-c72eb1ce2f8b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:11.095500 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29802b65-0936-4936-94a6-c72eb1ce2f8b service cinder] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:11.100555 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:42:11.105107 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1008/2030] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:42:10 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:42:12.235130 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cea0e5b-fc54-4fd1-80ff-c09817c4ba34 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:12.235130 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cea0e5b-fc54-4fd1-80ff-c09817c4ba34 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:12.235130 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cea0e5b-fc54-4fd1-80ff-c09817c4ba34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:12.274893 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-7cea0e5b-fc54-4fd1-80ff-c09817c4ba34 None None] MFA Rules not processed for user `088ec620530d4f44a240a57d020e2e0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:42:12.276242 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-7cea0e5b-fc54-4fd1-80ff-c09817c4ba34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:42:12.392767 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1023/2031] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:42:12 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:42:13.983030 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99dfef4-911a-488a-bb3b-907a9b2f6ff5 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:13.983537 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99dfef4-911a-488a-bb3b-907a9b2f6ff5 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:13.983630 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99dfef4-911a-488a-bb3b-907a9b2f6ff5 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:13.985135 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1009/2032] 10.222.0.86 () {54 vars in 921 bytes} [Tue Jun 7 14:42:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:42:14.022729 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d658a65-cdb2-4597-9fa9-13603b630dc6 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:14.023591 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d658a65-cdb2-4597-9fa9-13603b630dc6 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:14.023909 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d658a65-cdb2-4597-9fa9-13603b630dc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:14.049909 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-4d658a65-cdb2-4597-9fa9-13603b630dc6 None None] MFA Rules not processed for user `7e042f9d4a9345bb947e6a30f64a59ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:42:14.049909 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-4d658a65-cdb2-4597-9fa9-13603b630dc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:42:14.152297 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1024/2033] 10.222.0.86 () {58 vars in 1018 bytes} [Tue Jun 7 14:42:14 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:42:14.176294 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99dfef4-911a-488a-bb3b-907a9b2f6ff5 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:14.178553 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-a99dfef4-911a-488a-bb3b-907a9b2f6ff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:42:14.196917 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99dfef4-911a-488a-bb3b-907a9b2f6ff5 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:14.207170 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1adec5-5c2e-4028-9da0-d6255ec694c0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e042f9d4a9345bb947e6a30f64a59ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:14.207994 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d658a65-cdb2-4597-9fa9-13603b630dc6 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:14.208570 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1adec5-5c2e-4028-9da0-d6255ec694c0 service placement] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:14.208870 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1adec5-5c2e-4028-9da0-d6255ec694c0 service placement] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:14.209190 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1adec5-5c2e-4028-9da0-d6255ec694c0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:14.223387 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1adec5-5c2e-4028-9da0-d6255ec694c0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:14.228575 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1adec5-5c2e-4028-9da0-d6255ec694c0 service placement] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:14.242134 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:42:14.247796 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1010/2034] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:42:14 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:42:14.288180 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d658a65-cdb2-4597-9fa9-13603b630dc6 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:14.293015 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bd846f-4b4d-4d88-a663-a1066fb80b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:14.293918 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bd846f-4b4d-4d88-a663-a1066fb80b5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:14.294203 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bd846f-4b4d-4d88-a663-a1066fb80b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:14.294481 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bd846f-4b4d-4d88-a663-a1066fb80b5b admin admin] PATH_INFO: `/v3/users/876debec47204fb0aee1815449835b35` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:14.295672 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bd846f-4b4d-4d88-a663-a1066fb80b5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=876debec47204fb0aee1815449835b35)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:14.297702 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bd846f-4b4d-4d88-a663-a1066fb80b5b admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:14.606937 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-03bd846f-4b4d-4d88-a663-a1066fb80b5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '876debec47204fb0aee1815449835b35'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:14.607563 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-03bd846f-4b4d-4d88-a663-a1066fb80b5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '876debec47204fb0aee1815449835b35'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:14.614365 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-03bd846f-4b4d-4d88-a663-a1066fb80b5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '876debec47204fb0aee1815449835b35'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:14.626970 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-03bd846f-4b4d-4d88-a663-a1066fb80b5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '876debec47204fb0aee1815449835b35'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:14.627656 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-03bd846f-4b4d-4d88-a663-a1066fb80b5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '876debec47204fb0aee1815449835b35'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:14.702519 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1025/2035] 10.222.0.86 () {58 vars in 1223 bytes} [Tue Jun 7 14:42:14 2022] DELETE /identity/v3/users/876debec47204fb0aee1815449835b35 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:42:14.960705 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1adec5-5c2e-4028-9da0-d6255ec694c0 service placement] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:14.971090 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1adec5-5c2e-4028-9da0-d6255ec694c0 service placement] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:15.028066 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9826bbce-642b-4c61-a19c-64e5f3a5721f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:15.029011 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9826bbce-642b-4c61-a19c-64e5f3a5721f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:15.029293 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9826bbce-642b-4c61-a19c-64e5f3a5721f admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:15.029590 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9826bbce-642b-4c61-a19c-64e5f3a5721f admin admin] PATH_INFO: `/v3/projects/1f615bed99314d20b8dfeb70f0eb3ad9` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:15.030796 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9826bbce-642b-4c61-a19c-64e5f3a5721f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f615bed99314d20b8dfeb70f0eb3ad9)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:15.032761 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9826bbce-642b-4c61-a19c-64e5f3a5721f admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:15.180485 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-9826bbce-642b-4c61-a19c-64e5f3a5721f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f615bed99314d20b8dfeb70f0eb3ad9', 'request_id': 'req-9826bbce-642b-4c61-a19c-64e5f3a5721f'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:15.187246 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-9826bbce-642b-4c61-a19c-64e5f3a5721f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f615bed99314d20b8dfeb70f0eb3ad9', 'request_id': 'req-9826bbce-642b-4c61-a19c-64e5f3a5721f'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:15.278708 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-9826bbce-642b-4c61-a19c-64e5f3a5721f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f615bed99314d20b8dfeb70f0eb3ad9', 'request_id': 'req-9826bbce-642b-4c61-a19c-64e5f3a5721f'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:15.303067 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-9826bbce-642b-4c61-a19c-64e5f3a5721f admin admin] The token cache is being invalidate because project 1f615bed99314d20b8dfeb70f0eb3ad9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:42:15.303362 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-9826bbce-642b-4c61-a19c-64e5f3a5721f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:15.304041 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-9826bbce-642b-4c61-a19c-64e5f3a5721f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:15.305623 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1011/2036] 10.222.0.86 () {58 vars in 1232 bytes} [Tue Jun 7 14:42:14 2022] DELETE /identity/v3/projects/1f615bed99314d20b8dfeb70f0eb3ad9 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:42:15.309679 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bd846f-4b4d-4d88-a663-a1066fb80b5b admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:15.311253 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-03bd846f-4b4d-4d88-a663-a1066fb80b5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:42:15.325368 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bd846f-4b4d-4d88-a663-a1066fb80b5b admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:15.385285 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7673d0-f7a2-401c-b9ef-daa45e548008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:15.386230 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7673d0-f7a2-401c-b9ef-daa45e548008 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:15.386481 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7673d0-f7a2-401c-b9ef-daa45e548008 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:15.386753 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7673d0-f7a2-401c-b9ef-daa45e548008 admin admin] PATH_INFO: `/v3/users/088ec620530d4f44a240a57d020e2e0d` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:15.387962 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7673d0-f7a2-401c-b9ef-daa45e548008 admin admin] RBAC: Authorizing `identity:delete_user(user_id=088ec620530d4f44a240a57d020e2e0d)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:15.389871 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7673d0-f7a2-401c-b9ef-daa45e548008 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:15.601248 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:42:15.606113 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-5a7673d0-f7a2-401c-b9ef-daa45e548008 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '088ec620530d4f44a240a57d020e2e0d'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:15.606763 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-5a7673d0-f7a2-401c-b9ef-daa45e548008 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '088ec620530d4f44a240a57d020e2e0d'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:15.613667 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-5a7673d0-f7a2-401c-b9ef-daa45e548008 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '088ec620530d4f44a240a57d020e2e0d'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:15.625266 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-5a7673d0-f7a2-401c-b9ef-daa45e548008 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '088ec620530d4f44a240a57d020e2e0d'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:15.625905 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-5a7673d0-f7a2-401c-b9ef-daa45e548008 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '088ec620530d4f44a240a57d020e2e0d'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:15.712178 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1026/2037] 10.222.0.86 () {58 vars in 1223 bytes} [Tue Jun 7 14:42:15 2022] DELETE /identity/v3/users/088ec620530d4f44a240a57d020e2e0d => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:42:15.971232 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9826bbce-642b-4c61-a19c-64e5f3a5721f admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:15.972772 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-9826bbce-642b-4c61-a19c-64e5f3a5721f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:42:15.988347 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9826bbce-642b-4c61-a19c-64e5f3a5721f admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:16.047931 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9021898f-1788-45f5-b14f-cff78f749d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:16.048839 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9021898f-1788-45f5-b14f-cff78f749d73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:16.049125 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9021898f-1788-45f5-b14f-cff78f749d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:16.049539 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9021898f-1788-45f5-b14f-cff78f749d73 admin admin] PATH_INFO: `/v3/projects/38d626a968ab4fd7b17cd01604557a55` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:16.050738 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9021898f-1788-45f5-b14f-cff78f749d73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38d626a968ab4fd7b17cd01604557a55)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:16.052858 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9021898f-1788-45f5-b14f-cff78f749d73 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:16.061065 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:42:16.216606 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-9021898f-1788-45f5-b14f-cff78f749d73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38d626a968ab4fd7b17cd01604557a55', 'request_id': 'req-9021898f-1788-45f5-b14f-cff78f749d73'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:16.223628 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-9021898f-1788-45f5-b14f-cff78f749d73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38d626a968ab4fd7b17cd01604557a55', 'request_id': 'req-9021898f-1788-45f5-b14f-cff78f749d73'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:16.341794 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-9021898f-1788-45f5-b14f-cff78f749d73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38d626a968ab4fd7b17cd01604557a55', 'request_id': 'req-9021898f-1788-45f5-b14f-cff78f749d73'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:16.353364 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-9021898f-1788-45f5-b14f-cff78f749d73 admin admin] The token cache is being invalidate because project 38d626a968ab4fd7b17cd01604557a55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:42:16.353714 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-9021898f-1788-45f5-b14f-cff78f749d73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:16.354559 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-9021898f-1788-45f5-b14f-cff78f749d73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:16.356482 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1012/2038] 10.222.0.86 () {58 vars in 1232 bytes} [Tue Jun 7 14:42:15 2022] DELETE /identity/v3/projects/38d626a968ab4fd7b17cd01604557a55 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:42:16.361318 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472ec3e7-ba9f-4099-a8fb-7edd238e4735 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:16.361784 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472ec3e7-ba9f-4099-a8fb-7edd238e4735 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:16.362018 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472ec3e7-ba9f-4099-a8fb-7edd238e4735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:16.381943 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-472ec3e7-ba9f-4099-a8fb-7edd238e4735 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:42:16.383148 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-472ec3e7-ba9f-4099-a8fb-7edd238e4735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:42:16.442970 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1027/2039] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:42:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:42:16.451889 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378410ce-ea96-4ea2-a676-dc575d783f5d None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:16.452183 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378410ce-ea96-4ea2-a676-dc575d783f5d None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:16.452470 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378410ce-ea96-4ea2-a676-dc575d783f5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:16.471118 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-378410ce-ea96-4ea2-a676-dc575d783f5d None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:42:16.472414 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-378410ce-ea96-4ea2-a676-dc575d783f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:42:16.482556 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1013/2040] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:42:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:42:16.486997 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472ec3e7-ba9f-4099-a8fb-7edd238e4735 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:16.497805 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472ec3e7-ba9f-4099-a8fb-7edd238e4735 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:16.503044 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911401e6-84f7-404e-87a3-b266a5dd1d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:16.503644 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911401e6-84f7-404e-87a3-b266a5dd1d8b admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:16.503963 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911401e6-84f7-404e-87a3-b266a5dd1d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:16.504246 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911401e6-84f7-404e-87a3-b266a5dd1d8b admin admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:16.505159 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911401e6-84f7-404e-87a3-b266a5dd1d8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:42:16.505488 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911401e6-84f7-404e-87a3-b266a5dd1d8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:16.507793 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911401e6-84f7-404e-87a3-b266a5dd1d8b admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:16.520484 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1028/2041] 10.222.0.86 () {58 vars in 1152 bytes} [Tue Jun 7 14:42:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:42:16.524769 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378410ce-ea96-4ea2-a676-dc575d783f5d None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:16.534245 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378410ce-ea96-4ea2-a676-dc575d783f5d None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:16.539941 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7da9042-425a-4745-8dd0-449440f72420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:16.540632 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7da9042-425a-4745-8dd0-449440f72420 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:16.540916 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7da9042-425a-4745-8dd0-449440f72420 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:16.541196 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7da9042-425a-4745-8dd0-449440f72420 admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:16.541914 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7da9042-425a-4745-8dd0-449440f72420 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:16.543875 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7da9042-425a-4745-8dd0-449440f72420 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:16.651787 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1014/2042] 10.222.0.86 () {60 vars in 1152 bytes} [Tue Jun 7 14:42:16 2022] POST /identity/v3/projects => generated 387 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 14:42:16.655668 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911401e6-84f7-404e-87a3-b266a5dd1d8b admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:16.688801 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911401e6-84f7-404e-87a3-b266a5dd1d8b admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:16.744834 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3bc98b-a133-4cc5-9ac9-de24346f8446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:16.745502 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3bc98b-a133-4cc5-9ac9-de24346f8446 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:16.745786 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3bc98b-a133-4cc5-9ac9-de24346f8446 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:16.746062 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3bc98b-a133-4cc5-9ac9-de24346f8446 admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:16.746741 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3bc98b-a133-4cc5-9ac9-de24346f8446 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:16.748660 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3bc98b-a133-4cc5-9ac9-de24346f8446 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:16.839435 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1029/2043] 10.222.0.86 () {60 vars in 1143 bytes} [Tue Jun 7 14:42:16 2022] POST /identity/v3/users => generated 294 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:42:16.843497 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7da9042-425a-4745-8dd0-449440f72420 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:16.865057 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7da9042-425a-4745-8dd0-449440f72420 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:16.869763 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13741f08-6602-48ba-a222-c8dffb650b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:16.870414 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13741f08-6602-48ba-a222-c8dffb650b19 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:16.870699 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13741f08-6602-48ba-a222-c8dffb650b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:16.870983 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13741f08-6602-48ba-a222-c8dffb650b19 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:16.871709 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13741f08-6602-48ba-a222-c8dffb650b19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:16.873559 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13741f08-6602-48ba-a222-c8dffb650b19 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:16.883712 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1015/2044] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:42:16 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:42:16.887486 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3bc98b-a133-4cc5-9ac9-de24346f8446 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:16.897831 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3bc98b-a133-4cc5-9ac9-de24346f8446 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:16.902666 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09310d5d-0768-4a1f-86f3-6ecfd9fa63da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:16.903268 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09310d5d-0768-4a1f-86f3-6ecfd9fa63da admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:16.903582 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09310d5d-0768-4a1f-86f3-6ecfd9fa63da admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:16.903908 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09310d5d-0768-4a1f-86f3-6ecfd9fa63da admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:16.904702 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09310d5d-0768-4a1f-86f3-6ecfd9fa63da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:16.906345 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09310d5d-0768-4a1f-86f3-6ecfd9fa63da admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:16.921219 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1030/2045] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:42:16 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:42:16.925178 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13741f08-6602-48ba-a222-c8dffb650b19 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:16.935603 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13741f08-6602-48ba-a222-c8dffb650b19 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:16.940270 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c5f6dd-7dd0-43f4-9691-234690ce43f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:16.941138 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c5f6dd-7dd0-43f4-9691-234690ce43f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:16.944594 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c5f6dd-7dd0-43f4-9691-234690ce43f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:16.944594 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c5f6dd-7dd0-43f4-9691-234690ce43f2 admin admin] PATH_INFO: `/v3/projects/a1c329d1948e48b1a5da232bacc92a68/users/a0dce291b905431bb0154faf228474f9/roles/c17acc2a8bb348f59ba7edd22fcf0c47` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:16.956483 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c5f6dd-7dd0-43f4-9691-234690ce43f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1c329d1948e48b1a5da232bacc92a68, user_id=a0dce291b905431bb0154faf228474f9, role_id=c17acc2a8bb348f59ba7edd22fcf0c47)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:16.959105 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c5f6dd-7dd0-43f4-9691-234690ce43f2 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:17.074442 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1016/2046] 10.222.0.86 () {60 vars in 1482 bytes} [Tue Jun 7 14:42:16 2022] PUT /identity/v3/projects/a1c329d1948e48b1a5da232bacc92a68/users/a0dce291b905431bb0154faf228474f9/roles/c17acc2a8bb348f59ba7edd22fcf0c47 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 14:42:17.085574 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57c1fa6-7a42-4fe3-876b-bcec2b09332e None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:17.085880 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57c1fa6-7a42-4fe3-876b-bcec2b09332e None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:17.086163 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57c1fa6-7a42-4fe3-876b-bcec2b09332e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:17.104729 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:42:17.113199 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-c57c1fa6-7a42-4fe3-876b-bcec2b09332e None None] MFA Rules not processed for user `a0dce291b905431bb0154faf228474f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:42:17.114411 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-c57c1fa6-7a42-4fe3-876b-bcec2b09332e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:42:17.181318 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1031/2047] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:42:17 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 14:42:17.185909 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c5f6dd-7dd0-43f4-9691-234690ce43f2 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:17.247962 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c5f6dd-7dd0-43f4-9691-234690ce43f2 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:17.252656 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e833cee9-03f4-40d4-a7eb-7a44f0e88255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:17.253313 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e833cee9-03f4-40d4-a7eb-7a44f0e88255 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:17.253595 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e833cee9-03f4-40d4-a7eb-7a44f0e88255 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:17.253868 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e833cee9-03f4-40d4-a7eb-7a44f0e88255 admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:17.254585 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e833cee9-03f4-40d4-a7eb-7a44f0e88255 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:17.257290 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e833cee9-03f4-40d4-a7eb-7a44f0e88255 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:17.401031 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1017/2048] 10.222.0.86 () {60 vars in 1152 bytes} [Tue Jun 7 14:42:17 2022] POST /identity/v3/projects => generated 387 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 14:42:17.405492 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57c1fa6-7a42-4fe3-876b-bcec2b09332e None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:17.416661 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57c1fa6-7a42-4fe3-876b-bcec2b09332e None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:17.475157 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44290b31-10c9-480b-9103-393f32078e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:17.475894 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44290b31-10c9-480b-9103-393f32078e81 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:17.476178 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44290b31-10c9-480b-9103-393f32078e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:17.476453 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44290b31-10c9-480b-9103-393f32078e81 admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:17.477249 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44290b31-10c9-480b-9103-393f32078e81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:17.479175 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44290b31-10c9-480b-9103-393f32078e81 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:17.584100 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1032/2049] 10.222.0.86 () {60 vars in 1143 bytes} [Tue Jun 7 14:42:17 2022] POST /identity/v3/users => generated 300 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:42:17.586258 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e833cee9-03f4-40d4-a7eb-7a44f0e88255 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:17.608393 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e833cee9-03f4-40d4-a7eb-7a44f0e88255 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:17.613811 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9fd766-2114-49b4-93f4-073686c066a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:17.616295 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9fd766-2114-49b4-93f4-073686c066a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:17.616295 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9fd766-2114-49b4-93f4-073686c066a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:17.616295 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9fd766-2114-49b4-93f4-073686c066a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:17.616943 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9fd766-2114-49b4-93f4-073686c066a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:17.618751 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9fd766-2114-49b4-93f4-073686c066a7 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:17.621734 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:42:17.627955 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44290b31-10c9-480b-9103-393f32078e81 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:17.629665 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-44290b31-10c9-480b-9103-393f32078e81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:42:17.637619 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1018/2050] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:42:17 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:42:17.641946 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9fd766-2114-49b4-93f4-073686c066a7 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:17.645643 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44290b31-10c9-480b-9103-393f32078e81 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:17.653045 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9fd766-2114-49b4-93f4-073686c066a7 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:17.653918 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c925b4-90d4-420c-b550-e7b829300c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:17.655167 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c925b4-90d4-420c-b550-e7b829300c78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:17.655706 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c925b4-90d4-420c-b550-e7b829300c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:17.656292 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c925b4-90d4-420c-b550-e7b829300c78 admin admin] PATH_INFO: `/v3/users/a0ee076dbdae463a8d241745fe2b52dc` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:17.657678 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad93dbd-ec70-4c19-a8bf-2e57f7cbcdfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:17.658058 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c925b4-90d4-420c-b550-e7b829300c78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0ee076dbdae463a8d241745fe2b52dc)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:17.658549 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad93dbd-ec70-4c19-a8bf-2e57f7cbcdfd admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:17.658830 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad93dbd-ec70-4c19-a8bf-2e57f7cbcdfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:17.659100 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad93dbd-ec70-4c19-a8bf-2e57f7cbcdfd admin admin] PATH_INFO: `/v3/projects/74ff102ac4d64a8e93a86f5e57c64f0a/users/d626674292274be4821a57e7fd445d6e/roles/e3bf6239f5bf477b965704b086786f11` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:17.661410 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c925b4-90d4-420c-b550-e7b829300c78 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:17.680378 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad93dbd-ec70-4c19-a8bf-2e57f7cbcdfd admin admin] RBAC: Authorizing `identity:create_grant(project_id=74ff102ac4d64a8e93a86f5e57c64f0a, user_id=d626674292274be4821a57e7fd445d6e, role_id=e3bf6239f5bf477b965704b086786f11)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:17.683570 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad93dbd-ec70-4c19-a8bf-2e57f7cbcdfd admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:17.789704 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1019/2051] 10.222.0.86 () {60 vars in 1482 bytes} [Tue Jun 7 14:42:17 2022] PUT /identity/v3/projects/74ff102ac4d64a8e93a86f5e57c64f0a/users/d626674292274be4821a57e7fd445d6e/roles/e3bf6239f5bf477b965704b086786f11 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 14:42:17.794541 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad93dbd-ec70-4c19-a8bf-2e57f7cbcdfd admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:17.855632 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad93dbd-ec70-4c19-a8bf-2e57f7cbcdfd admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:17.860462 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aa90e8-2a63-4701-80f4-6cba45d62f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:17.861124 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aa90e8-2a63-4701-80f4-6cba45d62f36 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:17.861413 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aa90e8-2a63-4701-80f4-6cba45d62f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:17.861696 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aa90e8-2a63-4701-80f4-6cba45d62f36 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:17.862450 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aa90e8-2a63-4701-80f4-6cba45d62f36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:17.864097 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aa90e8-2a63-4701-80f4-6cba45d62f36 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:17.873646 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1020/2052] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:42:17 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 07 14:42:17.877587 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aa90e8-2a63-4701-80f4-6cba45d62f36 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:17.886837 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aa90e8-2a63-4701-80f4-6cba45d62f36 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:17.891392 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd2618a-f9d4-4dd7-a3df-3814e5ac36be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:17.892280 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd2618a-f9d4-4dd7-a3df-3814e5ac36be admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:17.892570 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd2618a-f9d4-4dd7-a3df-3814e5ac36be admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:17.892849 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd2618a-f9d4-4dd7-a3df-3814e5ac36be admin admin] PATH_INFO: `/v3/projects/74ff102ac4d64a8e93a86f5e57c64f0a/users/d626674292274be4821a57e7fd445d6e/roles/e3bf6239f5bf477b965704b086786f11` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:17.895062 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd2618a-f9d4-4dd7-a3df-3814e5ac36be admin admin] RBAC: Authorizing `identity:create_grant(project_id=74ff102ac4d64a8e93a86f5e57c64f0a, user_id=d626674292274be4821a57e7fd445d6e, role_id=e3bf6239f5bf477b965704b086786f11)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:17.898186 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd2618a-f9d4-4dd7-a3df-3814e5ac36be admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:17.908484 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1021/2053] 10.222.0.86 () {60 vars in 1482 bytes} [Tue Jun 7 14:42:17 2022] PUT /identity/v3/projects/74ff102ac4d64a8e93a86f5e57c64f0a/users/d626674292274be4821a57e7fd445d6e/roles/e3bf6239f5bf477b965704b086786f11 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 14:42:17.919139 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d12ccea-a698-4e35-8e3d-21a8ad09c743 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:17.919433 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d12ccea-a698-4e35-8e3d-21a8ad09c743 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:17.919719 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d12ccea-a698-4e35-8e3d-21a8ad09c743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:17.922047 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-08c925b4-90d4-420c-b550-e7b829300c78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0ee076dbdae463a8d241745fe2b52dc'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:17.922867 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-08c925b4-90d4-420c-b550-e7b829300c78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0ee076dbdae463a8d241745fe2b52dc'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:17.930949 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-08c925b4-90d4-420c-b550-e7b829300c78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0ee076dbdae463a8d241745fe2b52dc'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:17.943844 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-08c925b4-90d4-420c-b550-e7b829300c78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0ee076dbdae463a8d241745fe2b52dc'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:17.947422 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-08c925b4-90d4-420c-b550-e7b829300c78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0ee076dbdae463a8d241745fe2b52dc'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:17.948112 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-4d12ccea-a698-4e35-8e3d-21a8ad09c743 None None] MFA Rules not processed for user `d626674292274be4821a57e7fd445d6e`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:42:17.949521 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-4d12ccea-a698-4e35-8e3d-21a8ad09c743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:42:18.030716 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:42:18.032355 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1022/2054] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:42:17 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:42:18.036769 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1033/2055] 10.222.0.86 () {58 vars in 1223 bytes} [Tue Jun 7 14:42:17 2022] DELETE /identity/v3/users/a0ee076dbdae463a8d241745fe2b52dc => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 14:42:18.042052 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555a1863-5fdf-4ca5-a6de-ae2be49cf092 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:18.042351 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555a1863-5fdf-4ca5-a6de-ae2be49cf092 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:18.042632 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555a1863-5fdf-4ca5-a6de-ae2be49cf092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:18.050738 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c925b4-90d4-420c-b550-e7b829300c78 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:18.052299 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-08c925b4-90d4-420c-b550-e7b829300c78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:42:18.072163 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-555a1863-5fdf-4ca5-a6de-ae2be49cf092 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:42:18.074052 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-555a1863-5fdf-4ca5-a6de-ae2be49cf092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:42:18.106386 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:42:18.117786 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c925b4-90d4-420c-b550-e7b829300c78 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:18.121559 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09806ef-ce01-4fd4-b1b3-0d4a262e633e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af5a95620a4b43538abfe09eed4bf115', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:18.122213 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09806ef-ce01-4fd4-b1b3-0d4a262e633e service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:18.122596 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09806ef-ce01-4fd4-b1b3-0d4a262e633e service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:18.122890 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09806ef-ce01-4fd4-b1b3-0d4a262e633e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:18.142297 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1023/2056] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:42:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:42:18.153790 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555a1863-5fdf-4ca5-a6de-ae2be49cf092 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:18.155152 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-555a1863-5fdf-4ca5-a6de-ae2be49cf092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:42:18.192793 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09806ef-ce01-4fd4-b1b3-0d4a262e633e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:18.194784 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09806ef-ce01-4fd4-b1b3-0d4a262e633e service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:18.205101 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1034/2057] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:42:18 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 14:42:18.245122 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555a1863-5fdf-4ca5-a6de-ae2be49cf092 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:18.248954 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a9f765-8433-40b5-bac2-f80f52ca69ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dda603ec5517460a83c333db2af804d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:18.249614 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a9f765-8433-40b5-bac2-f80f52ca69ef service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:18.249905 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a9f765-8433-40b5-bac2-f80f52ca69ef service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:18.250185 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a9f765-8433-40b5-bac2-f80f52ca69ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:18.259832 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a9f765-8433-40b5-bac2-f80f52ca69ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:18.261304 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a9f765-8433-40b5-bac2-f80f52ca69ef service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:18.270765 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1024/2058] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:42:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:42:18.783281 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09806ef-ce01-4fd4-b1b3-0d4a262e633e service cinder] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:18.784770 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-d09806ef-ce01-4fd4-b1b3-0d4a262e633e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:42:18.799387 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09806ef-ce01-4fd4-b1b3-0d4a262e633e service cinder] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:18.805351 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63304770-a69d-4bd4-be6b-bedbd2f17d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:18.806214 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63304770-a69d-4bd4-be6b-bedbd2f17d51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:18.806545 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63304770-a69d-4bd4-be6b-bedbd2f17d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:18.806832 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63304770-a69d-4bd4-be6b-bedbd2f17d51 admin admin] PATH_INFO: `/v3/projects/fd8b679172324a03b932807a03ed4fbb` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:18.808088 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63304770-a69d-4bd4-be6b-bedbd2f17d51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd8b679172324a03b932807a03ed4fbb)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:18.810015 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63304770-a69d-4bd4-be6b-bedbd2f17d51 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:18.941431 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-63304770-a69d-4bd4-be6b-bedbd2f17d51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd8b679172324a03b932807a03ed4fbb', 'request_id': 'req-63304770-a69d-4bd4-be6b-bedbd2f17d51'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:18.949286 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-63304770-a69d-4bd4-be6b-bedbd2f17d51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd8b679172324a03b932807a03ed4fbb', 'request_id': 'req-63304770-a69d-4bd4-be6b-bedbd2f17d51'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:19.004792 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-63304770-a69d-4bd4-be6b-bedbd2f17d51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd8b679172324a03b932807a03ed4fbb', 'request_id': 'req-63304770-a69d-4bd4-be6b-bedbd2f17d51'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:19.016868 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-63304770-a69d-4bd4-be6b-bedbd2f17d51 admin admin] The token cache is being invalidate because project fd8b679172324a03b932807a03ed4fbb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:42:19.017207 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-63304770-a69d-4bd4-be6b-bedbd2f17d51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:19.017846 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-63304770-a69d-4bd4-be6b-bedbd2f17d51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:19.019674 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1035/2059] 10.222.0.86 () {58 vars in 1232 bytes} [Tue Jun 7 14:42:18 2022] DELETE /identity/v3/projects/fd8b679172324a03b932807a03ed4fbb => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:42:19.025835 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a9f765-8433-40b5-bac2-f80f52ca69ef service neutron] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:19.035511 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a9f765-8433-40b5-bac2-f80f52ca69ef service neutron] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:19.092354 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e587bb6-f6b5-4e16-b482-b6bf41277f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:19.093094 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e587bb6-f6b5-4e16-b482-b6bf41277f41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:19.093384 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e587bb6-f6b5-4e16-b482-b6bf41277f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:19.093664 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e587bb6-f6b5-4e16-b482-b6bf41277f41 admin admin] PATH_INFO: `/v3/users/cd8cf96966cd42798eaf71a8117b773d` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:19.095480 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e587bb6-f6b5-4e16-b482-b6bf41277f41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd8cf96966cd42798eaf71a8117b773d)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:19.097506 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e587bb6-f6b5-4e16-b482-b6bf41277f41 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:19.143530 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63304770-a69d-4bd4-be6b-bedbd2f17d51 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:19.145323 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-63304770-a69d-4bd4-be6b-bedbd2f17d51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:42:19.159077 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63304770-a69d-4bd4-be6b-bedbd2f17d51 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:19.164722 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08833ad1-81c0-40e8-ad12-3a80b4ee41d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:19.165697 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08833ad1-81c0-40e8-ad12-3a80b4ee41d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:19.165983 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08833ad1-81c0-40e8-ad12-3a80b4ee41d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:19.166265 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08833ad1-81c0-40e8-ad12-3a80b4ee41d0 admin admin] PATH_INFO: `/v3/users/8681193e4e934c70a3550f04c3d45d72` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:19.168143 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08833ad1-81c0-40e8-ad12-3a80b4ee41d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8681193e4e934c70a3550f04c3d45d72)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:19.170083 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08833ad1-81c0-40e8-ad12-3a80b4ee41d0 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:19.283235 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:42:19.385003 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-9e587bb6-f6b5-4e16-b482-b6bf41277f41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd8cf96966cd42798eaf71a8117b773d'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:19.395103 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-9e587bb6-f6b5-4e16-b482-b6bf41277f41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd8cf96966cd42798eaf71a8117b773d'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:19.395859 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-9e587bb6-f6b5-4e16-b482-b6bf41277f41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd8cf96966cd42798eaf71a8117b773d'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:19.403221 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:42:19.412303 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-9e587bb6-f6b5-4e16-b482-b6bf41277f41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd8cf96966cd42798eaf71a8117b773d'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:19.413216 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-9e587bb6-f6b5-4e16-b482-b6bf41277f41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd8cf96966cd42798eaf71a8117b773d'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:19.416277 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-08833ad1-81c0-40e8-ad12-3a80b4ee41d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8681193e4e934c70a3550f04c3d45d72'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:19.416950 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-08833ad1-81c0-40e8-ad12-3a80b4ee41d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8681193e4e934c70a3550f04c3d45d72'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:19.423748 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-08833ad1-81c0-40e8-ad12-3a80b4ee41d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8681193e4e934c70a3550f04c3d45d72'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:19.436284 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-08833ad1-81c0-40e8-ad12-3a80b4ee41d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8681193e4e934c70a3550f04c3d45d72'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:19.437037 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-08833ad1-81c0-40e8-ad12-3a80b4ee41d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8681193e4e934c70a3550f04c3d45d72'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:19.487575 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1025/2060] 10.222.0.86 () {58 vars in 1223 bytes} [Tue Jun 7 14:42:19 2022] DELETE /identity/v3/users/cd8cf96966cd42798eaf71a8117b773d => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:42:19.504884 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e587bb6-f6b5-4e16-b482-b6bf41277f41 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:19.507320 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-9e587bb6-f6b5-4e16-b482-b6bf41277f41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:42:19.555022 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1036/2061] 10.222.0.86 () {58 vars in 1223 bytes} [Tue Jun 7 14:42:19 2022] DELETE /identity/v3/users/8681193e4e934c70a3550f04c3d45d72 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 14:42:19.559280 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ffc4e2-2650-4c2e-a713-4dda69440a70 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:19.559657 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ffc4e2-2650-4c2e-a713-4dda69440a70 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:19.560029 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ffc4e2-2650-4c2e-a713-4dda69440a70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:19.587254 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-32ffc4e2-2650-4c2e-a713-4dda69440a70 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:42:19.588590 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-32ffc4e2-2650-4c2e-a713-4dda69440a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:42:19.606966 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e587bb6-f6b5-4e16-b482-b6bf41277f41 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:19.667999 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5925d3c8-b9e1-4fdb-b8d9-a429c1c1c139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:19.669264 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5925d3c8-b9e1-4fdb-b8d9-a429c1c1c139 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:19.669264 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5925d3c8-b9e1-4fdb-b8d9-a429c1c1c139 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:19.669501 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5925d3c8-b9e1-4fdb-b8d9-a429c1c1c139 admin admin] PATH_INFO: `/v3/users/a0dce291b905431bb0154faf228474f9` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:19.672871 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1037/2062] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:42:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:42:19.673017 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5925d3c8-b9e1-4fdb-b8d9-a429c1c1c139 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0dce291b905431bb0154faf228474f9)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:19.673017 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5925d3c8-b9e1-4fdb-b8d9-a429c1c1c139 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:19.680447 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ffc4e2-2650-4c2e-a713-4dda69440a70 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:19.682561 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-32ffc4e2-2650-4c2e-a713-4dda69440a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:42:19.737706 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ffc4e2-2650-4c2e-a713-4dda69440a70 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:19.743349 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb11e880-44a9-43bf-ba6a-d8a43f842ed1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dda603ec5517460a83c333db2af804d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:19.743349 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb11e880-44a9-43bf-ba6a-d8a43f842ed1 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:19.743349 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb11e880-44a9-43bf-ba6a-d8a43f842ed1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:19.743349 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb11e880-44a9-43bf-ba6a-d8a43f842ed1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:19.753952 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb11e880-44a9-43bf-ba6a-d8a43f842ed1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:19.755582 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb11e880-44a9-43bf-ba6a-d8a43f842ed1 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:19.766499 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1038/2063] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:42:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 14:42:19.891498 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-5925d3c8-b9e1-4fdb-b8d9-a429c1c1c139 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0dce291b905431bb0154faf228474f9'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:19.899950 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-5925d3c8-b9e1-4fdb-b8d9-a429c1c1c139 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0dce291b905431bb0154faf228474f9'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:19.900720 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-5925d3c8-b9e1-4fdb-b8d9-a429c1c1c139 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0dce291b905431bb0154faf228474f9'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:19.912754 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-5925d3c8-b9e1-4fdb-b8d9-a429c1c1c139 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0dce291b905431bb0154faf228474f9'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:19.913533 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-5925d3c8-b9e1-4fdb-b8d9-a429c1c1c139 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0dce291b905431bb0154faf228474f9'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:20.038089 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb11e880-44a9-43bf-ba6a-d8a43f842ed1 service neutron] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:20.040713 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-fb11e880-44a9-43bf-ba6a-d8a43f842ed1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:42:20.060013 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb11e880-44a9-43bf-ba6a-d8a43f842ed1 service neutron] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:20.069992 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1026/2064] 10.222.0.86 () {58 vars in 1223 bytes} [Tue Jun 7 14:42:19 2022] DELETE /identity/v3/users/a0dce291b905431bb0154faf228474f9 => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 14:42:20.073830 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e5ede6-67f9-4f91-9c96-5b4a8250fb38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:20.074715 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60868d8a-e1d2-4fcd-8e93-20b5d615a821 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:20.075015 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60868d8a-e1d2-4fcd-8e93-20b5d615a821 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:20.075299 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60868d8a-e1d2-4fcd-8e93-20b5d615a821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:20.075926 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e5ede6-67f9-4f91-9c96-5b4a8250fb38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:20.076932 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e5ede6-67f9-4f91-9c96-5b4a8250fb38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:20.077229 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e5ede6-67f9-4f91-9c96-5b4a8250fb38 admin admin] PATH_INFO: `/v3/projects/b56b9beb9fdd4526a627f34c6c9d26b1` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:20.089902 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:42:20.091466 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e5ede6-67f9-4f91-9c96-5b4a8250fb38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b56b9beb9fdd4526a627f34c6c9d26b1)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:20.094732 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e5ede6-67f9-4f91-9c96-5b4a8250fb38 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:20.104150 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-60868d8a-e1d2-4fcd-8e93-20b5d615a821 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:42:20.105464 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-60868d8a-e1d2-4fcd-8e93-20b5d615a821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:42:20.183103 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1027/2065] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:42:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:42:20.213911 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60868d8a-e1d2-4fcd-8e93-20b5d615a821 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:20.216200 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-60868d8a-e1d2-4fcd-8e93-20b5d615a821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:42:20.229076 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:42:20.234175 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-89e5ede6-67f9-4f91-9c96-5b4a8250fb38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b56b9beb9fdd4526a627f34c6c9d26b1', 'request_id': 'req-89e5ede6-67f9-4f91-9c96-5b4a8250fb38'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:20.245800 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-89e5ede6-67f9-4f91-9c96-5b4a8250fb38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b56b9beb9fdd4526a627f34c6c9d26b1', 'request_id': 'req-89e5ede6-67f9-4f91-9c96-5b4a8250fb38'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:20.298997 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60868d8a-e1d2-4fcd-8e93-20b5d615a821 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:20.348642 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6a4527-928c-4759-954d-f7e42b99ba62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dda603ec5517460a83c333db2af804d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:20.350010 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6a4527-928c-4759-954d-f7e42b99ba62 service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:20.350395 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6a4527-928c-4759-954d-f7e42b99ba62 service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:20.350774 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6a4527-928c-4759-954d-f7e42b99ba62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:20.391835 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-89e5ede6-67f9-4f91-9c96-5b4a8250fb38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b56b9beb9fdd4526a627f34c6c9d26b1', 'request_id': 'req-89e5ede6-67f9-4f91-9c96-5b4a8250fb38'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:20.408537 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-89e5ede6-67f9-4f91-9c96-5b4a8250fb38 admin admin] The token cache is being invalidate because project b56b9beb9fdd4526a627f34c6c9d26b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:42:20.408537 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-89e5ede6-67f9-4f91-9c96-5b4a8250fb38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:20.411544 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-89e5ede6-67f9-4f91-9c96-5b4a8250fb38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:20.414558 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1039/2066] 10.222.0.86 () {58 vars in 1232 bytes} [Tue Jun 7 14:42:20 2022] DELETE /identity/v3/projects/b56b9beb9fdd4526a627f34c6c9d26b1 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:42:20.420075 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5f3517-342e-4142-8535-0257c1e944ce None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:20.420378 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5f3517-342e-4142-8535-0257c1e944ce None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:20.420666 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5f3517-342e-4142-8535-0257c1e944ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:20.431264 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6a4527-928c-4759-954d-f7e42b99ba62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:20.433338 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6a4527-928c-4759-954d-f7e42b99ba62 service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:20.445047 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1028/2067] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:42:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:42:20.465735 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-1d5f3517-342e-4142-8535-0257c1e944ce None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:42:20.466977 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-1d5f3517-342e-4142-8535-0257c1e944ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:42:20.478549 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1040/2068] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:42:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:42:20.486059 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16df869-dc7d-4030-a39f-8a095bb70c19 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:20.488312 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16df869-dc7d-4030-a39f-8a095bb70c19 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:20.488312 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16df869-dc7d-4030-a39f-8a095bb70c19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:20.495107 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5f3517-342e-4142-8535-0257c1e944ce None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:20.496556 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-1d5f3517-342e-4142-8535-0257c1e944ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:42:20.510623 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5f3517-342e-4142-8535-0257c1e944ce None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:20.516135 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addcf410-48c1-4056-b3db-58714906d61a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:20.517327 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addcf410-48c1-4056-b3db-58714906d61a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:20.517724 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addcf410-48c1-4056-b3db-58714906d61a admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:20.518196 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addcf410-48c1-4056-b3db-58714906d61a admin admin] PATH_INFO: `/v3/projects/ffcb00882d2c457181ab4cf25d1304b8` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:20.520003 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addcf410-48c1-4056-b3db-58714906d61a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffcb00882d2c457181ab4cf25d1304b8)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:20.522785 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-c16df869-dc7d-4030-a39f-8a095bb70c19 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:42:20.523167 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addcf410-48c1-4056-b3db-58714906d61a admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:20.524637 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-c16df869-dc7d-4030-a39f-8a095bb70c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:42:20.540514 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1029/2069] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:42:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:42:20.542175 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16df869-dc7d-4030-a39f-8a095bb70c19 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:20.556556 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16df869-dc7d-4030-a39f-8a095bb70c19 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:20.563968 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44c64b8-1267-4cee-aaff-10742264e8fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:20.564659 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44c64b8-1267-4cee-aaff-10742264e8fd admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:20.564954 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44c64b8-1267-4cee-aaff-10742264e8fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:20.565225 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44c64b8-1267-4cee-aaff-10742264e8fd admin admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:20.566521 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44c64b8-1267-4cee-aaff-10742264e8fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:42:20.566839 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44c64b8-1267-4cee-aaff-10742264e8fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:20.569026 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44c64b8-1267-4cee-aaff-10742264e8fd admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:20.583530 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1030/2070] 10.222.0.86 () {58 vars in 1152 bytes} [Tue Jun 7 14:42:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:42:20.594069 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44c64b8-1267-4cee-aaff-10742264e8fd admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:20.602871 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44c64b8-1267-4cee-aaff-10742264e8fd admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:20.613449 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8d32d1-65f2-49ba-819f-92d8889d51a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:20.614116 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8d32d1-65f2-49ba-819f-92d8889d51a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:20.614421 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8d32d1-65f2-49ba-819f-92d8889d51a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:20.616225 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8d32d1-65f2-49ba-819f-92d8889d51a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:20.617091 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8d32d1-65f2-49ba-819f-92d8889d51a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:20.620924 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8d32d1-65f2-49ba-819f-92d8889d51a3 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:20.727001 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-addcf410-48c1-4056-b3db-58714906d61a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffcb00882d2c457181ab4cf25d1304b8', 'request_id': 'req-addcf410-48c1-4056-b3db-58714906d61a'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:20.733501 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-addcf410-48c1-4056-b3db-58714906d61a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffcb00882d2c457181ab4cf25d1304b8', 'request_id': 'req-addcf410-48c1-4056-b3db-58714906d61a'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:20.748901 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1031/2071] 10.222.0.86 () {60 vars in 1152 bytes} [Tue Jun 7 14:42:20 2022] POST /identity/v3/projects => generated 371 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:42:20.750598 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8d32d1-65f2-49ba-819f-92d8889d51a3 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:20.815025 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8d32d1-65f2-49ba-819f-92d8889d51a3 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:20.821066 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752111ec-8738-4e7a-8404-3728cf4b5e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:20.821872 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752111ec-8738-4e7a-8404-3728cf4b5e66 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:20.822159 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752111ec-8738-4e7a-8404-3728cf4b5e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:20.822435 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752111ec-8738-4e7a-8404-3728cf4b5e66 admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:20.823130 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752111ec-8738-4e7a-8404-3728cf4b5e66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:20.825080 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752111ec-8738-4e7a-8404-3728cf4b5e66 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:20.830014 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-addcf410-48c1-4056-b3db-58714906d61a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffcb00882d2c457181ab4cf25d1304b8', 'request_id': 'req-addcf410-48c1-4056-b3db-58714906d61a'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:20.857275 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-addcf410-48c1-4056-b3db-58714906d61a admin admin] The token cache is being invalidate because project ffcb00882d2c457181ab4cf25d1304b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:42:20.861831 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-addcf410-48c1-4056-b3db-58714906d61a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:20.861831 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-addcf410-48c1-4056-b3db-58714906d61a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:20.861831 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1041/2072] 10.222.0.86 () {58 vars in 1232 bytes} [Tue Jun 7 14:42:20 2022] DELETE /identity/v3/projects/ffcb00882d2c457181ab4cf25d1304b8 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:42:20.865885 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f87b897-946d-4736-95a4-512d594fa8e8 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:20.866180 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f87b897-946d-4736-95a4-512d594fa8e8 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:20.866466 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f87b897-946d-4736-95a4-512d594fa8e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:20.885344 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-7f87b897-946d-4736-95a4-512d594fa8e8 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:42:20.890560 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-7f87b897-946d-4736-95a4-512d594fa8e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:42:20.896262 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1042/2073] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:42:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:42:20.903711 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b259b1-4ad1-4877-ade8-02d5b2493524 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:20.904042 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b259b1-4ad1-4877-ade8-02d5b2493524 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:20.904331 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b259b1-4ad1-4877-ade8-02d5b2493524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:20.922367 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-69b259b1-4ad1-4877-ade8-02d5b2493524 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:42:20.923590 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-69b259b1-4ad1-4877-ade8-02d5b2493524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:42:20.932026 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1043/2074] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:42:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 14:42:20.936099 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b259b1-4ad1-4877-ade8-02d5b2493524 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:20.947008 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b259b1-4ad1-4877-ade8-02d5b2493524 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:20.952049 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b280d4a-c31e-427d-a313-f614281e40cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:20.953068 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1032/2075] 10.222.0.86 () {60 vars in 1143 bytes} [Tue Jun 7 14:42:20 2022] POST /identity/v3/users => generated 286 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 14:42:20.956713 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b280d4a-c31e-427d-a313-f614281e40cd admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:20.957186 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b280d4a-c31e-427d-a313-f614281e40cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:20.957368 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b280d4a-c31e-427d-a313-f614281e40cd admin admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:20.958145 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b280d4a-c31e-427d-a313-f614281e40cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:42:20.958530 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b280d4a-c31e-427d-a313-f614281e40cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:20.960147 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b280d4a-c31e-427d-a313-f614281e40cd admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:20.964796 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752111ec-8738-4e7a-8404-3728cf4b5e66 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:20.975967 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-752111ec-8738-4e7a-8404-3728cf4b5e66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:42:20.976222 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1044/2076] 10.222.0.86 () {58 vars in 1152 bytes} [Tue Jun 7 14:42:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:42:20.978903 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b280d4a-c31e-427d-a313-f614281e40cd admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:20.981624 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-4b280d4a-c31e-427d-a313-f614281e40cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:42:21.009750 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b280d4a-c31e-427d-a313-f614281e40cd admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:21.010499 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752111ec-8738-4e7a-8404-3728cf4b5e66 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:21.016055 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e87afbd-e674-439f-8a3c-4cef08a4776a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:21.016183 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0438632f-20ae-4e4d-b6aa-a36798d0be12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:21.016949 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0438632f-20ae-4e4d-b6aa-a36798d0be12 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:21.017069 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e87afbd-e674-439f-8a3c-4cef08a4776a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:21.017257 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e87afbd-e674-439f-8a3c-4cef08a4776a admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:21.017371 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0438632f-20ae-4e4d-b6aa-a36798d0be12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:21.017561 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0438632f-20ae-4e4d-b6aa-a36798d0be12 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:21.017659 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e87afbd-e674-439f-8a3c-4cef08a4776a admin admin] PATH_INFO: `/v3/projects/a1c329d1948e48b1a5da232bacc92a68` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:21.018753 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0438632f-20ae-4e4d-b6aa-a36798d0be12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:21.019448 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e87afbd-e674-439f-8a3c-4cef08a4776a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1c329d1948e48b1a5da232bacc92a68)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:21.027401 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0438632f-20ae-4e4d-b6aa-a36798d0be12 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:21.027666 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e87afbd-e674-439f-8a3c-4cef08a4776a admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:21.033884 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1033/2077] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:42:20 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:42:21.034711 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0438632f-20ae-4e4d-b6aa-a36798d0be12 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:21.049518 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0438632f-20ae-4e4d-b6aa-a36798d0be12 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:21.055615 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a992793-c8d2-4871-8feb-c8bc07aceb5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:21.056633 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a992793-c8d2-4871-8feb-c8bc07aceb5d admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:21.058053 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a992793-c8d2-4871-8feb-c8bc07aceb5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:21.058488 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a992793-c8d2-4871-8feb-c8bc07aceb5d admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:21.059343 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a992793-c8d2-4871-8feb-c8bc07aceb5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:21.061514 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a992793-c8d2-4871-8feb-c8bc07aceb5d admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:21.211944 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1034/2078] 10.222.0.86 () {60 vars in 1152 bytes} [Tue Jun 7 14:42:21 2022] POST /identity/v3/projects => generated 373 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:42:21.211944 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a992793-c8d2-4871-8feb-c8bc07aceb5d admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:21.219423 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-4e87afbd-e674-439f-8a3c-4cef08a4776a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1c329d1948e48b1a5da232bacc92a68', 'request_id': 'req-4e87afbd-e674-439f-8a3c-4cef08a4776a'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:21.226489 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-4e87afbd-e674-439f-8a3c-4cef08a4776a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1c329d1948e48b1a5da232bacc92a68', 'request_id': 'req-4e87afbd-e674-439f-8a3c-4cef08a4776a'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:21.273968 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a992793-c8d2-4871-8feb-c8bc07aceb5d admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:21.278857 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595490ff-662f-467a-9fca-9f23e64d0a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:21.279548 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595490ff-662f-467a-9fca-9f23e64d0a9c admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:21.279871 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595490ff-662f-467a-9fca-9f23e64d0a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:21.280156 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595490ff-662f-467a-9fca-9f23e64d0a9c admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:21.280946 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595490ff-662f-467a-9fca-9f23e64d0a9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:21.282602 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595490ff-662f-467a-9fca-9f23e64d0a9c admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:21.294446 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1035/2079] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:42:21 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:42:21.295367 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595490ff-662f-467a-9fca-9f23e64d0a9c admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:21.307196 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595490ff-662f-467a-9fca-9f23e64d0a9c admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:21.311956 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba32035-6c11-4f99-99ce-d7cb32b51942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:21.312630 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba32035-6c11-4f99-99ce-d7cb32b51942 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:21.312902 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba32035-6c11-4f99-99ce-d7cb32b51942 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:21.313177 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba32035-6c11-4f99-99ce-d7cb32b51942 admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:21.313862 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba32035-6c11-4f99-99ce-d7cb32b51942 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:21.315744 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba32035-6c11-4f99-99ce-d7cb32b51942 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:21.324812 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-4e87afbd-e674-439f-8a3c-4cef08a4776a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1c329d1948e48b1a5da232bacc92a68', 'request_id': 'req-4e87afbd-e674-439f-8a3c-4cef08a4776a'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:21.336285 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-4e87afbd-e674-439f-8a3c-4cef08a4776a admin admin] The token cache is being invalidate because project a1c329d1948e48b1a5da232bacc92a68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:42:21.336576 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-4e87afbd-e674-439f-8a3c-4cef08a4776a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:21.337217 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-4e87afbd-e674-439f-8a3c-4cef08a4776a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:21.338805 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1045/2080] 10.222.0.86 () {58 vars in 1232 bytes} [Tue Jun 7 14:42:20 2022] DELETE /identity/v3/projects/a1c329d1948e48b1a5da232bacc92a68 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:42:21.339545 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e87afbd-e674-439f-8a3c-4cef08a4776a admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:21.340886 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-4e87afbd-e674-439f-8a3c-4cef08a4776a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:42:21.404772 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e87afbd-e674-439f-8a3c-4cef08a4776a admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:21.409365 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f12180-944f-4ea9-afce-a56b5e2a1ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:21.410232 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f12180-944f-4ea9-afce-a56b5e2a1ed1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:21.410542 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f12180-944f-4ea9-afce-a56b5e2a1ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:21.410825 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f12180-944f-4ea9-afce-a56b5e2a1ed1 admin admin] PATH_INFO: `/v3/projects/79cff16d11ee4778946e2ec2ecbe003a/users/3963bdd9df304a91a9d36e76bd9bc527/roles/c17acc2a8bb348f59ba7edd22fcf0c47` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:21.424169 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f12180-944f-4ea9-afce-a56b5e2a1ed1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79cff16d11ee4778946e2ec2ecbe003a, user_id=3963bdd9df304a91a9d36e76bd9bc527, role_id=c17acc2a8bb348f59ba7edd22fcf0c47)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:21.426847 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f12180-944f-4ea9-afce-a56b5e2a1ed1 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:21.469572 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1036/2081] 10.222.0.86 () {60 vars in 1143 bytes} [Tue Jun 7 14:42:21 2022] POST /identity/v3/users => generated 287 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:42:21.470627 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba32035-6c11-4f99-99ce-d7cb32b51942 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:21.474437 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-0ba32035-6c11-4f99-99ce-d7cb32b51942 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:42:21.488043 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba32035-6c11-4f99-99ce-d7cb32b51942 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:21.491728 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1046/2082] 10.222.0.86 () {60 vars in 1482 bytes} [Tue Jun 7 14:42:21 2022] PUT /identity/v3/projects/79cff16d11ee4778946e2ec2ecbe003a/users/3963bdd9df304a91a9d36e76bd9bc527/roles/c17acc2a8bb348f59ba7edd22fcf0c47 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:42:21.492431 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f12180-944f-4ea9-afce-a56b5e2a1ed1 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:21.494173 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-f5f12180-944f-4ea9-afce-a56b5e2a1ed1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:42:21.564473 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966a355f-4130-4410-88f5-1e3f5b510f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:21.565693 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966a355f-4130-4410-88f5-1e3f5b510f21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:21.566053 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966a355f-4130-4410-88f5-1e3f5b510f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:21.566459 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966a355f-4130-4410-88f5-1e3f5b510f21 admin admin] PATH_INFO: `/v3/users/d626674292274be4821a57e7fd445d6e` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:21.569048 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966a355f-4130-4410-88f5-1e3f5b510f21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d626674292274be4821a57e7fd445d6e)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:21.571799 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966a355f-4130-4410-88f5-1e3f5b510f21 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:21.604614 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f12180-944f-4ea9-afce-a56b5e2a1ed1 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:21.607956 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed222e8e-1d94-432c-bd90-a5a2b94f0739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:21.608757 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed222e8e-1d94-432c-bd90-a5a2b94f0739 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:21.609051 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed222e8e-1d94-432c-bd90-a5a2b94f0739 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:21.609387 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed222e8e-1d94-432c-bd90-a5a2b94f0739 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:21.610133 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed222e8e-1d94-432c-bd90-a5a2b94f0739 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:21.611907 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed222e8e-1d94-432c-bd90-a5a2b94f0739 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:21.623980 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1047/2083] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:42:21 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:42:21.625494 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921a00dc-1c82-47b8-8774-123481b9e9bd None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:21.625795 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921a00dc-1c82-47b8-8774-123481b9e9bd None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:21.626078 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921a00dc-1c82-47b8-8774-123481b9e9bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:21.645007 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-921a00dc-1c82-47b8-8774-123481b9e9bd None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:42:21.646783 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-921a00dc-1c82-47b8-8774-123481b9e9bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:42:21.654582 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1048/2084] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:42:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:42:21.655366 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921a00dc-1c82-47b8-8774-123481b9e9bd None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:21.664843 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921a00dc-1c82-47b8-8774-123481b9e9bd None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:21.669555 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20f2127-460c-41bb-ad0d-cd8bc6ceaa63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:21.670199 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20f2127-460c-41bb-ad0d-cd8bc6ceaa63 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:21.670484 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20f2127-460c-41bb-ad0d-cd8bc6ceaa63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:21.670760 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20f2127-460c-41bb-ad0d-cd8bc6ceaa63 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:21.671589 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20f2127-460c-41bb-ad0d-cd8bc6ceaa63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:21.673099 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20f2127-460c-41bb-ad0d-cd8bc6ceaa63 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:21.686500 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1049/2085] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:42:21 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:42:21.686500 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20f2127-460c-41bb-ad0d-cd8bc6ceaa63 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:21.686500 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-b20f2127-460c-41bb-ad0d-cd8bc6ceaa63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:42:21.741971 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20f2127-460c-41bb-ad0d-cd8bc6ceaa63 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:21.745856 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df61747-dc07-4a35-a53a-d2a82d26208f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dda603ec5517460a83c333db2af804d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:21.746498 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df61747-dc07-4a35-a53a-d2a82d26208f service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:21.746785 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df61747-dc07-4a35-a53a-d2a82d26208f service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:21.747050 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df61747-dc07-4a35-a53a-d2a82d26208f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:21.757508 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df61747-dc07-4a35-a53a-d2a82d26208f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:21.759494 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df61747-dc07-4a35-a53a-d2a82d26208f service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:21.769458 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1050/2086] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:42:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:42:21.770351 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df61747-dc07-4a35-a53a-d2a82d26208f service neutron] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:21.780043 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df61747-dc07-4a35-a53a-d2a82d26208f service neutron] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:21.784247 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-966a355f-4130-4410-88f5-1e3f5b510f21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd626674292274be4821a57e7fd445d6e'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:21.785046 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c5d59a-a28b-459c-864f-b386f90bb67b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:21.785932 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c5d59a-a28b-459c-864f-b386f90bb67b admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:21.786333 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c5d59a-a28b-459c-864f-b386f90bb67b admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:21.786486 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c5d59a-a28b-459c-864f-b386f90bb67b admin admin] PATH_INFO: `/v3/projects/99514fa5f7f34c388e687115b09d51c4/users/2ff70dec43fa4fa8913be158a818078e/roles/c17acc2a8bb348f59ba7edd22fcf0c47` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:21.800613 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-966a355f-4130-4410-88f5-1e3f5b510f21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd626674292274be4821a57e7fd445d6e'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:21.801447 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-966a355f-4130-4410-88f5-1e3f5b510f21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd626674292274be4821a57e7fd445d6e'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:21.808038 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c5d59a-a28b-459c-864f-b386f90bb67b admin admin] RBAC: Authorizing `identity:create_grant(project_id=99514fa5f7f34c388e687115b09d51c4, user_id=2ff70dec43fa4fa8913be158a818078e, role_id=c17acc2a8bb348f59ba7edd22fcf0c47)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:21.811190 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c5d59a-a28b-459c-864f-b386f90bb67b admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:21.815453 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-966a355f-4130-4410-88f5-1e3f5b510f21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd626674292274be4821a57e7fd445d6e'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:21.816189 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-966a355f-4130-4410-88f5-1e3f5b510f21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd626674292274be4821a57e7fd445d6e'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:21.851177 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:42:21.902690 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1037/2087] 10.222.0.86 () {58 vars in 1223 bytes} [Tue Jun 7 14:42:21 2022] DELETE /identity/v3/users/d626674292274be4821a57e7fd445d6e => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:42:21.903011 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1051/2088] 10.222.0.86 () {60 vars in 1482 bytes} [Tue Jun 7 14:42:21 2022] PUT /identity/v3/projects/99514fa5f7f34c388e687115b09d51c4/users/2ff70dec43fa4fa8913be158a818078e/roles/c17acc2a8bb348f59ba7edd22fcf0c47 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:42:21.917628 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336b321f-2131-42d2-976d-1b1ecc6d0667 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:21.917951 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336b321f-2131-42d2-976d-1b1ecc6d0667 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:21.918217 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336b321f-2131-42d2-976d-1b1ecc6d0667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:21.947072 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-336b321f-2131-42d2-976d-1b1ecc6d0667 None None] MFA Rules not processed for user `2ff70dec43fa4fa8913be158a818078e`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:42:21.948339 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-336b321f-2131-42d2-976d-1b1ecc6d0667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:42:21.977328 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=81,keystone:DELETE=16,keystone:INSERT=3 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:42:22.019100 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1038/2089] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:42:21 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:42:22.030233 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c5d59a-a28b-459c-864f-b386f90bb67b admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:22.032005 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-b1c5d59a-a28b-459c-864f-b386f90bb67b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:42:22.098118 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c5d59a-a28b-459c-864f-b386f90bb67b admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:22.151137 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba33cdec-5e3a-4cd8-8aa6-3c1b13ab1689 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af5a95620a4b43538abfe09eed4bf115', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:22.151891 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba33cdec-5e3a-4cd8-8aa6-3c1b13ab1689 service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:22.152175 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba33cdec-5e3a-4cd8-8aa6-3c1b13ab1689 service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:22.152452 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba33cdec-5e3a-4cd8-8aa6-3c1b13ab1689 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:22.163176 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba33cdec-5e3a-4cd8-8aa6-3c1b13ab1689 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:22.164692 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba33cdec-5e3a-4cd8-8aa6-3c1b13ab1689 service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:22.175145 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1052/2090] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:42:22 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:42:22.245913 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:42:22.435399 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336b321f-2131-42d2-976d-1b1ecc6d0667 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:22.436882 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-336b321f-2131-42d2-976d-1b1ecc6d0667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:42:22.507582 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336b321f-2131-42d2-976d-1b1ecc6d0667 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:22.512285 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c929b95-11db-4b21-bc25-a0bc8c3c579e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:22.513142 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c929b95-11db-4b21-bc25-a0bc8c3c579e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:22.513424 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c929b95-11db-4b21-bc25-a0bc8c3c579e admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:22.513750 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c929b95-11db-4b21-bc25-a0bc8c3c579e admin admin] PATH_INFO: `/v3/projects/74ff102ac4d64a8e93a86f5e57c64f0a` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:22.515025 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c929b95-11db-4b21-bc25-a0bc8c3c579e admin admin] RBAC: Authorizing `identity:delete_project(project_id=74ff102ac4d64a8e93a86f5e57c64f0a)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:22.517447 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c929b95-11db-4b21-bc25-a0bc8c3c579e admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:22.632224 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-4c929b95-11db-4b21-bc25-a0bc8c3c579e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74ff102ac4d64a8e93a86f5e57c64f0a', 'request_id': 'req-4c929b95-11db-4b21-bc25-a0bc8c3c579e'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:22.641577 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-4c929b95-11db-4b21-bc25-a0bc8c3c579e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74ff102ac4d64a8e93a86f5e57c64f0a', 'request_id': 'req-4c929b95-11db-4b21-bc25-a0bc8c3c579e'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:22.718842 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-4c929b95-11db-4b21-bc25-a0bc8c3c579e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74ff102ac4d64a8e93a86f5e57c64f0a', 'request_id': 'req-4c929b95-11db-4b21-bc25-a0bc8c3c579e'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:22.730795 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-4c929b95-11db-4b21-bc25-a0bc8c3c579e admin admin] The token cache is being invalidate because project 74ff102ac4d64a8e93a86f5e57c64f0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:42:22.731088 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-4c929b95-11db-4b21-bc25-a0bc8c3c579e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:22.731734 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-4c929b95-11db-4b21-bc25-a0bc8c3c579e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:22.733377 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1039/2091] 10.222.0.86 () {58 vars in 1232 bytes} [Tue Jun 7 14:42:22 2022] DELETE /identity/v3/projects/74ff102ac4d64a8e93a86f5e57c64f0a => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:42:22.738537 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cbf735-cccc-4052-9c4a-49f75493511d None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:22.739056 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cbf735-cccc-4052-9c4a-49f75493511d None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:22.739150 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cbf735-cccc-4052-9c4a-49f75493511d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:22.758292 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-d8cbf735-cccc-4052-9c4a-49f75493511d None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:42:22.759498 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-d8cbf735-cccc-4052-9c4a-49f75493511d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:42:22.799733 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:42:22.819432 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1053/2092] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:42:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:42:22.827853 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18306f38-fe47-4163-ab28-8c23184f198e None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:22.828221 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18306f38-fe47-4163-ab28-8c23184f198e None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:22.828572 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18306f38-fe47-4163-ab28-8c23184f198e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:22.866704 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-18306f38-fe47-4163-ab28-8c23184f198e None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:42:22.868207 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-18306f38-fe47-4163-ab28-8c23184f198e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:42:22.876918 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1040/2093] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:42:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:42:22.881978 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cbf735-cccc-4052-9c4a-49f75493511d None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:22.893017 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cbf735-cccc-4052-9c4a-49f75493511d None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:22.900670 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7cb2b5-e35f-4f83-b93f-e15cdb687ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:22.901547 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7cb2b5-e35f-4f83-b93f-e15cdb687ac7 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:22.901837 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7cb2b5-e35f-4f83-b93f-e15cdb687ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:22.902127 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7cb2b5-e35f-4f83-b93f-e15cdb687ac7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:22.902836 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7cb2b5-e35f-4f83-b93f-e15cdb687ac7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:42:22.903300 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7cb2b5-e35f-4f83-b93f-e15cdb687ac7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:22.904933 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7cb2b5-e35f-4f83-b93f-e15cdb687ac7 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:22.917847 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1054/2094] 10.222.0.86 () {58 vars in 1152 bytes} [Tue Jun 7 14:42:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:42:22.923484 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18306f38-fe47-4163-ab28-8c23184f198e None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:22.933403 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18306f38-fe47-4163-ab28-8c23184f198e None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:22.938386 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ef988d-a818-49d9-b740-02251cd6809b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:22.944743 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef988d-a818-49d9-b740-02251cd6809b admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:22.944743 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef988d-a818-49d9-b740-02251cd6809b admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:22.944743 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef988d-a818-49d9-b740-02251cd6809b admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:22.944743 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ef988d-a818-49d9-b740-02251cd6809b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:22.944743 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ef988d-a818-49d9-b740-02251cd6809b admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:23.039598 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1041/2095] 10.222.0.86 () {60 vars in 1152 bytes} [Tue Jun 7 14:42:22 2022] POST /identity/v3/projects => generated 377 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:42:23.044148 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7cb2b5-e35f-4f83-b93f-e15cdb687ac7 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:23.054100 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7cb2b5-e35f-4f83-b93f-e15cdb687ac7 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:23.108985 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f1f69a-5b6f-4d52-b966-07f0b048defe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:23.109649 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f1f69a-5b6f-4d52-b966-07f0b048defe admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:23.109944 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f1f69a-5b6f-4d52-b966-07f0b048defe admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:23.110216 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f1f69a-5b6f-4d52-b966-07f0b048defe admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:23.110916 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f1f69a-5b6f-4d52-b966-07f0b048defe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:23.112868 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f1f69a-5b6f-4d52-b966-07f0b048defe admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:23.176476 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:42:23.267970 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1055/2096] 10.222.0.86 () {60 vars in 1143 bytes} [Tue Jun 7 14:42:23 2022] POST /identity/v3/users => generated 289 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:42:23.273068 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ef988d-a818-49d9-b740-02251cd6809b admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:23.284537 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ef988d-a818-49d9-b740-02251cd6809b admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:23.289610 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f9e95d-c301-4b55-978e-cdbcbfa397df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:23.290295 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f9e95d-c301-4b55-978e-cdbcbfa397df admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:23.290605 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f9e95d-c301-4b55-978e-cdbcbfa397df admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:23.290878 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f9e95d-c301-4b55-978e-cdbcbfa397df admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:23.291654 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f9e95d-c301-4b55-978e-cdbcbfa397df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:23.293371 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f9e95d-c301-4b55-978e-cdbcbfa397df admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:23.305021 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1042/2097] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:42:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 07 14:42:23.308902 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f1f69a-5b6f-4d52-b966-07f0b048defe admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:23.320814 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f1f69a-5b6f-4d52-b966-07f0b048defe admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:23.326420 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930d3feb-2484-4064-b153-5765a276a5be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:23.327560 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930d3feb-2484-4064-b153-5765a276a5be admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:23.327981 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930d3feb-2484-4064-b153-5765a276a5be admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:23.328572 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930d3feb-2484-4064-b153-5765a276a5be admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:23.329184 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930d3feb-2484-4064-b153-5765a276a5be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:23.330872 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930d3feb-2484-4064-b153-5765a276a5be admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:23.333318 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e883d21d-388c-42a6-adff-df3ec3701af6 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:23.333614 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e883d21d-388c-42a6-adff-df3ec3701af6 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:23.334454 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e883d21d-388c-42a6-adff-df3ec3701af6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:23.347664 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1056/2098] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:42:23 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 07 14:42:23.349243 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930d3feb-2484-4064-b153-5765a276a5be admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:23.360181 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930d3feb-2484-4064-b153-5765a276a5be admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:23.361997 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-e883d21d-388c-42a6-adff-df3ec3701af6 None None] MFA Rules not processed for user `3963bdd9df304a91a9d36e76bd9bc527`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:42:23.363876 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-e883d21d-388c-42a6-adff-df3ec3701af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:42:23.365502 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ae0d8f-158f-4183-a3c0-3b10ef7c0d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:23.366505 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ae0d8f-158f-4183-a3c0-3b10ef7c0d78 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:23.366853 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ae0d8f-158f-4183-a3c0-3b10ef7c0d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:23.367202 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ae0d8f-158f-4183-a3c0-3b10ef7c0d78 admin admin] PATH_INFO: `/v3/projects/68c2f63d6b194cc2ba1790ffebd550b2/users/f9214dc2148d4702bb6fbd47e9d933b8/roles/c17acc2a8bb348f59ba7edd22fcf0c47` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:23.382345 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ae0d8f-158f-4183-a3c0-3b10ef7c0d78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68c2f63d6b194cc2ba1790ffebd550b2, user_id=f9214dc2148d4702bb6fbd47e9d933b8, role_id=c17acc2a8bb348f59ba7edd22fcf0c47)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:23.385048 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ae0d8f-158f-4183-a3c0-3b10ef7c0d78 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:23.430368 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1043/2099] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:42:23 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 14:42:23.434787 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e883d21d-388c-42a6-adff-df3ec3701af6 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:23.436111 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-e883d21d-388c-42a6-adff-df3ec3701af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:42:23.448979 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e883d21d-388c-42a6-adff-df3ec3701af6 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:23.453687 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ead3a3-e02b-4be1-a2c6-89352f52341d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:23.454377 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ead3a3-e02b-4be1-a2c6-89352f52341d admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:23.454710 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ead3a3-e02b-4be1-a2c6-89352f52341d admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:23.454990 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ead3a3-e02b-4be1-a2c6-89352f52341d admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:23.455685 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ead3a3-e02b-4be1-a2c6-89352f52341d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:23.457679 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ead3a3-e02b-4be1-a2c6-89352f52341d admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:23.462487 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1057/2100] 10.222.0.86 () {60 vars in 1482 bytes} [Tue Jun 7 14:42:23 2022] PUT /identity/v3/projects/68c2f63d6b194cc2ba1790ffebd550b2/users/f9214dc2148d4702bb6fbd47e9d933b8/roles/c17acc2a8bb348f59ba7edd22fcf0c47 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:42:23.473760 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b703601-436b-4789-9d3e-4f7e06fc0e43 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:23.474052 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b703601-436b-4789-9d3e-4f7e06fc0e43 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:23.474924 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b703601-436b-4789-9d3e-4f7e06fc0e43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:23.502930 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-4b703601-436b-4789-9d3e-4f7e06fc0e43 None None] MFA Rules not processed for user `f9214dc2148d4702bb6fbd47e9d933b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:42:23.504196 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-4b703601-436b-4789-9d3e-4f7e06fc0e43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:42:23.531517 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1044/2101] 10.222.0.86 () {60 vars in 1152 bytes} [Tue Jun 7 14:42:23 2022] POST /identity/v3/projects => generated 371 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 14:42:23.535275 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ead3a3-e02b-4be1-a2c6-89352f52341d admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:23.568844 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1058/2102] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:42:23 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:42:23.581647 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b703601-436b-4789-9d3e-4f7e06fc0e43 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:23.586413 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-4b703601-436b-4789-9d3e-4f7e06fc0e43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:42:23.602668 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ead3a3-e02b-4be1-a2c6-89352f52341d admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:23.608824 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68a6c27-2c65-4d3c-a5f0-5da10cfe7bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:23.609606 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68a6c27-2c65-4d3c-a5f0-5da10cfe7bb8 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:23.609961 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68a6c27-2c65-4d3c-a5f0-5da10cfe7bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:23.610307 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68a6c27-2c65-4d3c-a5f0-5da10cfe7bb8 admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:23.611079 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68a6c27-2c65-4d3c-a5f0-5da10cfe7bb8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:23.613109 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68a6c27-2c65-4d3c-a5f0-5da10cfe7bb8 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:23.644177 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b703601-436b-4789-9d3e-4f7e06fc0e43 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:23.698831 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1045/2103] 10.222.0.86 () {60 vars in 1143 bytes} [Tue Jun 7 14:42:23 2022] POST /identity/v3/users => generated 292 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:42:23.702271 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68a6c27-2c65-4d3c-a5f0-5da10cfe7bb8 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:23.704281 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51af56b6-5086-47cd-8e75-a54691f43e54 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af5a95620a4b43538abfe09eed4bf115', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:23.705414 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51af56b6-5086-47cd-8e75-a54691f43e54 service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:23.705802 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51af56b6-5086-47cd-8e75-a54691f43e54 service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:23.706381 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51af56b6-5086-47cd-8e75-a54691f43e54 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:23.714718 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68a6c27-2c65-4d3c-a5f0-5da10cfe7bb8 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:23.721081 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa5b96e-35a9-4895-a848-67b38844e456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:23.722225 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa5b96e-35a9-4895-a848-67b38844e456 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:23.723419 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa5b96e-35a9-4895-a848-67b38844e456 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:23.724028 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa5b96e-35a9-4895-a848-67b38844e456 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:23.725108 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa5b96e-35a9-4895-a848-67b38844e456 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:23.726926 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa5b96e-35a9-4895-a848-67b38844e456 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:23.739355 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1046/2104] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:42:23 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 07 14:42:23.744077 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa5b96e-35a9-4895-a848-67b38844e456 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:23.756437 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa5b96e-35a9-4895-a848-67b38844e456 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:23.761908 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105de005-35e4-4177-a4f8-9c98814c2dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:23.762790 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105de005-35e4-4177-a4f8-9c98814c2dee admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:23.763129 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105de005-35e4-4177-a4f8-9c98814c2dee admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:23.763405 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105de005-35e4-4177-a4f8-9c98814c2dee admin admin] PATH_INFO: `/v3/projects/9308cf11eb39478ab02b4a8b2d549c19/users/d299bb63e8824b78be6235ef8683d20e/roles/e3bf6239f5bf477b965704b086786f11` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:23.772977 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51af56b6-5086-47cd-8e75-a54691f43e54 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:23.774790 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51af56b6-5086-47cd-8e75-a54691f43e54 service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:23.781077 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105de005-35e4-4177-a4f8-9c98814c2dee admin admin] RBAC: Authorizing `identity:create_grant(project_id=9308cf11eb39478ab02b4a8b2d549c19, user_id=d299bb63e8824b78be6235ef8683d20e, role_id=e3bf6239f5bf477b965704b086786f11)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:23.783745 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1059/2105] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:42:23 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:42:23.783885 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105de005-35e4-4177-a4f8-9c98814c2dee admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:23.851419 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1047/2106] 10.222.0.86 () {60 vars in 1482 bytes} [Tue Jun 7 14:42:23 2022] PUT /identity/v3/projects/9308cf11eb39478ab02b4a8b2d549c19/users/d299bb63e8824b78be6235ef8683d20e/roles/e3bf6239f5bf477b965704b086786f11 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 14:42:23.855340 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51af56b6-5086-47cd-8e75-a54691f43e54 service cinder] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:23.867439 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51af56b6-5086-47cd-8e75-a54691f43e54 service cinder] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:23.926249 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeb3041-325c-4a47-af88-f77d0637acdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:23.926926 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeb3041-325c-4a47-af88-f77d0637acdd admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:23.927213 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeb3041-325c-4a47-af88-f77d0637acdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:23.928057 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeb3041-325c-4a47-af88-f77d0637acdd admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:23.928852 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeeb3041-325c-4a47-af88-f77d0637acdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:23.930471 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeeb3041-325c-4a47-af88-f77d0637acdd admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:23.941445 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1060/2107] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:42:23 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:42:23.945695 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105de005-35e4-4177-a4f8-9c98814c2dee admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:23.956100 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105de005-35e4-4177-a4f8-9c98814c2dee admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:23.960876 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ebe2af-7188-441e-b1df-6439b6965792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:23.961752 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ebe2af-7188-441e-b1df-6439b6965792 admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:23.962038 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ebe2af-7188-441e-b1df-6439b6965792 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:23.962317 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ebe2af-7188-441e-b1df-6439b6965792 admin admin] PATH_INFO: `/v3/projects/9308cf11eb39478ab02b4a8b2d549c19/users/d299bb63e8824b78be6235ef8683d20e/roles/e3bf6239f5bf477b965704b086786f11` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:23.964645 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ebe2af-7188-441e-b1df-6439b6965792 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9308cf11eb39478ab02b4a8b2d549c19, user_id=d299bb63e8824b78be6235ef8683d20e, role_id=e3bf6239f5bf477b965704b086786f11)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:23.967241 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ebe2af-7188-441e-b1df-6439b6965792 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:23.977338 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1048/2108] 10.222.0.86 () {60 vars in 1482 bytes} [Tue Jun 7 14:42:23 2022] PUT /identity/v3/projects/9308cf11eb39478ab02b4a8b2d549c19/users/d299bb63e8824b78be6235ef8683d20e/roles/e3bf6239f5bf477b965704b086786f11 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:42:24.027506 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:42:24.092210 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c1187c-8776-434e-b866-d2b8084755fd None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:24.095861 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c1187c-8776-434e-b866-d2b8084755fd None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:24.095861 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c1187c-8776-434e-b866-d2b8084755fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:24.117146 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-f6c1187c-8776-434e-b866-d2b8084755fd None None] MFA Rules not processed for user `2ff70dec43fa4fa8913be158a818078e`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:42:24.118387 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-f6c1187c-8776-434e-b866-d2b8084755fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:42:24.183372 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1061/2109] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:42:24 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:42:24.273680 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:42:24.993635 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:42:25.817039 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e8d858-9cd3-4003-9082-7bd97da11870 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:25.817600 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e8d858-9cd3-4003-9082-7bd97da11870 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:25.817600 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e8d858-9cd3-4003-9082-7bd97da11870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:25.845384 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-45e8d858-9cd3-4003-9082-7bd97da11870 None None] MFA Rules not processed for user `d299bb63e8824b78be6235ef8683d20e`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:42:25.846622 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-45e8d858-9cd3-4003-9082-7bd97da11870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:42:25.917710 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:42:25.923196 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1049/2110] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:42:25 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:42:25.934261 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5a667a-a71f-452e-930e-8e3e303d88ef None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:25.934640 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5a667a-a71f-452e-930e-8e3e303d88ef None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:25.934989 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5a667a-a71f-452e-930e-8e3e303d88ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:25.954751 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-4d5a667a-a71f-452e-930e-8e3e303d88ef None None] MFA Rules not processed for user `3963bdd9df304a91a9d36e76bd9bc527`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:42:25.956085 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-4d5a667a-a71f-452e-930e-8e3e303d88ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:42:25.961700 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:42:26.015831 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1062/2111] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:42:25 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:42:26.027129 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e8d858-9cd3-4003-9082-7bd97da11870 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:26.028563 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-45e8d858-9cd3-4003-9082-7bd97da11870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:42:26.101752 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e8d858-9cd3-4003-9082-7bd97da11870 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:26.107273 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c339d1e2-ef2d-4994-a61d-93bea52127b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99cfb70f54c45c8870369359da20378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:26.107951 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c339d1e2-ef2d-4994-a61d-93bea52127b9 service nova] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:26.108237 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c339d1e2-ef2d-4994-a61d-93bea52127b9 service nova] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:26.108515 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c339d1e2-ef2d-4994-a61d-93bea52127b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:26.116831 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c339d1e2-ef2d-4994-a61d-93bea52127b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:26.118398 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c339d1e2-ef2d-4994-a61d-93bea52127b9 service nova] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:26.126915 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1050/2112] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:42:26 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:42:36.375671 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=20 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:42:36.690173 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=35 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:42:47.934781 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5a667a-a71f-452e-930e-8e3e303d88ef None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:47.998247 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5a667a-a71f-452e-930e-8e3e303d88ef None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:48.003012 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880de874-31d7-4547-a255-797fcde7cc1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:48.003939 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880de874-31d7-4547-a255-797fcde7cc1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:48.004230 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880de874-31d7-4547-a255-797fcde7cc1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:48.004519 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880de874-31d7-4547-a255-797fcde7cc1d admin admin] PATH_INFO: `/v3/users/f9214dc2148d4702bb6fbd47e9d933b8` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:48.005790 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880de874-31d7-4547-a255-797fcde7cc1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9214dc2148d4702bb6fbd47e9d933b8)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:48.007803 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880de874-31d7-4547-a255-797fcde7cc1d admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:48.217495 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-880de874-31d7-4547-a255-797fcde7cc1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9214dc2148d4702bb6fbd47e9d933b8'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:48.218240 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-880de874-31d7-4547-a255-797fcde7cc1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9214dc2148d4702bb6fbd47e9d933b8'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:48.230902 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-880de874-31d7-4547-a255-797fcde7cc1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9214dc2148d4702bb6fbd47e9d933b8'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:48.237720 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-880de874-31d7-4547-a255-797fcde7cc1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9214dc2148d4702bb6fbd47e9d933b8'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:48.238439 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-880de874-31d7-4547-a255-797fcde7cc1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9214dc2148d4702bb6fbd47e9d933b8'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:48.319105 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1063/2113] 10.222.0.86 () {58 vars in 1223 bytes} [Tue Jun 7 14:42:47 2022] DELETE /identity/v3/users/f9214dc2148d4702bb6fbd47e9d933b8 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:42:48.323642 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f56558d-5a20-40d8-a556-a891ba0fd4f8 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:48.324170 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f56558d-5a20-40d8-a556-a891ba0fd4f8 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:48.324325 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f56558d-5a20-40d8-a556-a891ba0fd4f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:48.342074 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-5f56558d-5a20-40d8-a556-a891ba0fd4f8 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:42:48.343304 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-5f56558d-5a20-40d8-a556-a891ba0fd4f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:42:48.425649 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1051/2114] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:42:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:42:48.435957 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880de874-31d7-4547-a255-797fcde7cc1d admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:48.437766 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-880de874-31d7-4547-a255-797fcde7cc1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:42:48.513331 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880de874-31d7-4547-a255-797fcde7cc1d admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:48.517247 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9f333f-592e-45a8-8ef4-47e825d60188 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dda603ec5517460a83c333db2af804d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:48.517913 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9f333f-592e-45a8-8ef4-47e825d60188 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:48.518240 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9f333f-592e-45a8-8ef4-47e825d60188 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:48.518880 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9f333f-592e-45a8-8ef4-47e825d60188 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:48.529153 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9f333f-592e-45a8-8ef4-47e825d60188 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:48.530612 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9f333f-592e-45a8-8ef4-47e825d60188 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:48.540946 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1064/2115] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:42:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:42:49.017278 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f56558d-5a20-40d8-a556-a891ba0fd4f8 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:49.019237 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-5f56558d-5a20-40d8-a556-a891ba0fd4f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:42:49.032103 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f56558d-5a20-40d8-a556-a891ba0fd4f8 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:49.038276 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20a57a9-927a-4afd-bac0-39bbed4af9c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:49.039154 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20a57a9-927a-4afd-bac0-39bbed4af9c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:49.043836 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20a57a9-927a-4afd-bac0-39bbed4af9c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:49.043836 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20a57a9-927a-4afd-bac0-39bbed4af9c9 admin admin] PATH_INFO: `/v3/projects/68c2f63d6b194cc2ba1790ffebd550b2` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:49.043836 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20a57a9-927a-4afd-bac0-39bbed4af9c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68c2f63d6b194cc2ba1790ffebd550b2)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:49.043836 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20a57a9-927a-4afd-bac0-39bbed4af9c9 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:49.196767 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-d20a57a9-927a-4afd-bac0-39bbed4af9c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68c2f63d6b194cc2ba1790ffebd550b2', 'request_id': 'req-d20a57a9-927a-4afd-bac0-39bbed4af9c9'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:49.202841 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-d20a57a9-927a-4afd-bac0-39bbed4af9c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68c2f63d6b194cc2ba1790ffebd550b2', 'request_id': 'req-d20a57a9-927a-4afd-bac0-39bbed4af9c9'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:49.272640 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-d20a57a9-927a-4afd-bac0-39bbed4af9c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68c2f63d6b194cc2ba1790ffebd550b2', 'request_id': 'req-d20a57a9-927a-4afd-bac0-39bbed4af9c9'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:49.284561 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-d20a57a9-927a-4afd-bac0-39bbed4af9c9 admin admin] The token cache is being invalidate because project 68c2f63d6b194cc2ba1790ffebd550b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:42:49.284561 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-d20a57a9-927a-4afd-bac0-39bbed4af9c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:49.284561 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-d20a57a9-927a-4afd-bac0-39bbed4af9c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:49.286408 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1052/2116] 10.222.0.86 () {58 vars in 1232 bytes} [Tue Jun 7 14:42:49 2022] DELETE /identity/v3/projects/68c2f63d6b194cc2ba1790ffebd550b2 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:42:49.291004 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67f23df-4a85-4ca8-8dcd-d9bc51125f4d None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:49.291491 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67f23df-4a85-4ca8-8dcd-d9bc51125f4d None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:49.291605 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67f23df-4a85-4ca8-8dcd-d9bc51125f4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:49.320584 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-c67f23df-4a85-4ca8-8dcd-d9bc51125f4d None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:42:49.321817 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-c67f23df-4a85-4ca8-8dcd-d9bc51125f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:42:49.330611 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:42:49.383674 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1065/2117] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:42:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:42:49.391625 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74426228-f2aa-4ef8-b579-463ab78edbbe None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:49.392164 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74426228-f2aa-4ef8-b579-463ab78edbbe None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:49.392276 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74426228-f2aa-4ef8-b579-463ab78edbbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:49.411493 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-74426228-f2aa-4ef8-b579-463ab78edbbe None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:42:49.412737 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-74426228-f2aa-4ef8-b579-463ab78edbbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:42:49.421000 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1053/2118] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:42:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:42:49.425039 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67f23df-4a85-4ca8-8dcd-d9bc51125f4d None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:49.435558 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67f23df-4a85-4ca8-8dcd-d9bc51125f4d None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:49.440334 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edbb513-f060-411a-ba75-768d18906e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:49.440993 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edbb513-f060-411a-ba75-768d18906e5f admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:49.441280 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edbb513-f060-411a-ba75-768d18906e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:49.441558 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edbb513-f060-411a-ba75-768d18906e5f admin admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:49.442362 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edbb513-f060-411a-ba75-768d18906e5f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:42:49.442729 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edbb513-f060-411a-ba75-768d18906e5f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:49.444289 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edbb513-f060-411a-ba75-768d18906e5f admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:49.459860 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1066/2119] 10.222.0.86 () {58 vars in 1152 bytes} [Tue Jun 7 14:42:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:42:49.461309 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74426228-f2aa-4ef8-b579-463ab78edbbe None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:49.470754 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74426228-f2aa-4ef8-b579-463ab78edbbe None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:49.475921 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5170f021-d778-43fe-abbf-c940db587e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:49.476576 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5170f021-d778-43fe-abbf-c940db587e43 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:49.476861 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5170f021-d778-43fe-abbf-c940db587e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:49.477201 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5170f021-d778-43fe-abbf-c940db587e43 admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:49.477958 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5170f021-d778-43fe-abbf-c940db587e43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:49.479926 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5170f021-d778-43fe-abbf-c940db587e43 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:49.620046 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1054/2120] 10.222.0.86 () {60 vars in 1152 bytes} [Tue Jun 7 14:42:49 2022] POST /identity/v3/projects => generated 373 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:42:49.628893 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edbb513-f060-411a-ba75-768d18906e5f admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:49.640792 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edbb513-f060-411a-ba75-768d18906e5f admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:49.713369 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14834712-3a7b-4625-8d80-16b101944c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:49.714036 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14834712-3a7b-4625-8d80-16b101944c3c admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:49.714317 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14834712-3a7b-4625-8d80-16b101944c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:49.714591 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14834712-3a7b-4625-8d80-16b101944c3c admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:49.715270 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14834712-3a7b-4625-8d80-16b101944c3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:49.717257 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14834712-3a7b-4625-8d80-16b101944c3c admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:49.848180 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1067/2121] 10.222.0.86 () {60 vars in 1143 bytes} [Tue Jun 7 14:42:49 2022] POST /identity/v3/users => generated 287 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:42:49.850096 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5170f021-d778-43fe-abbf-c940db587e43 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:49.860204 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5170f021-d778-43fe-abbf-c940db587e43 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:49.865327 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b145b89-b8b9-417b-95e6-b607ad46a89c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:49.865975 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b145b89-b8b9-417b-95e6-b607ad46a89c admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:49.866256 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b145b89-b8b9-417b-95e6-b607ad46a89c admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:49.866533 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b145b89-b8b9-417b-95e6-b607ad46a89c admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:49.867254 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b145b89-b8b9-417b-95e6-b607ad46a89c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:49.868863 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b145b89-b8b9-417b-95e6-b607ad46a89c admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:49.879476 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1055/2122] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:42:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:42:49.883678 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14834712-3a7b-4625-8d80-16b101944c3c admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:49.894018 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14834712-3a7b-4625-8d80-16b101944c3c admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:49.899323 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fd5405-b721-4756-ac8b-d17117e15bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:49.900128 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fd5405-b721-4756-ac8b-d17117e15bec admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:49.900410 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fd5405-b721-4756-ac8b-d17117e15bec admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:49.900686 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fd5405-b721-4756-ac8b-d17117e15bec admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:49.901409 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fd5405-b721-4756-ac8b-d17117e15bec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:49.902981 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fd5405-b721-4756-ac8b-d17117e15bec admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:49.913013 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1068/2123] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:42:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:42:49.917079 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b145b89-b8b9-417b-95e6-b607ad46a89c admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:49.927616 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b145b89-b8b9-417b-95e6-b607ad46a89c admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:49.933020 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4339a1fa-4a3b-4a37-97fe-5f2bda09b43c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:49.933563 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4339a1fa-4a3b-4a37-97fe-5f2bda09b43c admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:49.933846 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4339a1fa-4a3b-4a37-97fe-5f2bda09b43c admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:49.934123 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4339a1fa-4a3b-4a37-97fe-5f2bda09b43c admin admin] PATH_INFO: `/v3/projects/d17b6f38f85143ff93d2e5dc7d4fac54/users/ace5be0026ab4c85932d358fcbcbf35e/roles/c17acc2a8bb348f59ba7edd22fcf0c47` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:49.950274 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4339a1fa-4a3b-4a37-97fe-5f2bda09b43c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d17b6f38f85143ff93d2e5dc7d4fac54, user_id=ace5be0026ab4c85932d358fcbcbf35e, role_id=c17acc2a8bb348f59ba7edd22fcf0c47)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:49.953275 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4339a1fa-4a3b-4a37-97fe-5f2bda09b43c admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:50.034018 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1056/2124] 10.222.0.86 () {60 vars in 1482 bytes} [Tue Jun 7 14:42:49 2022] PUT /identity/v3/projects/d17b6f38f85143ff93d2e5dc7d4fac54/users/ace5be0026ab4c85932d358fcbcbf35e/roles/c17acc2a8bb348f59ba7edd22fcf0c47 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:42:50.039421 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b47ab5-456a-4ebd-a979-5539c55caf0a None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:50.039712 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b47ab5-456a-4ebd-a979-5539c55caf0a None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:50.040021 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b47ab5-456a-4ebd-a979-5539c55caf0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:50.058418 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-06b47ab5-456a-4ebd-a979-5539c55caf0a None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:42:50.059610 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-06b47ab5-456a-4ebd-a979-5539c55caf0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:42:50.123027 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1069/2125] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:42:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:42:50.132664 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4339a1fa-4a3b-4a37-97fe-5f2bda09b43c admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:50.134384 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-4339a1fa-4a3b-4a37-97fe-5f2bda09b43c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:42:50.156961 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:42:50.204791 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4339a1fa-4a3b-4a37-97fe-5f2bda09b43c admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:50.209186 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0cd693-d0b8-46d2-b137-a4d825a37aca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dda603ec5517460a83c333db2af804d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:50.209850 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0cd693-d0b8-46d2-b137-a4d825a37aca service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:50.210116 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0cd693-d0b8-46d2-b137-a4d825a37aca service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:50.210392 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0cd693-d0b8-46d2-b137-a4d825a37aca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:50.240071 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0cd693-d0b8-46d2-b137-a4d825a37aca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:50.241510 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0cd693-d0b8-46d2-b137-a4d825a37aca service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:50.252120 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1057/2126] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:42:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:42:51.755281 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35144cc-f831-4870-9934-473e0b38ed21 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:51.756004 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35144cc-f831-4870-9934-473e0b38ed21 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:51.756004 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35144cc-f831-4870-9934-473e0b38ed21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:51.786425 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-c35144cc-f831-4870-9934-473e0b38ed21 None None] MFA Rules not processed for user `ace5be0026ab4c85932d358fcbcbf35e`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:42:51.787700 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-c35144cc-f831-4870-9934-473e0b38ed21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:42:51.796099 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:42:51.854681 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1070/2127] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:42:51 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:42:51.865289 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0cd693-d0b8-46d2-b137-a4d825a37aca service neutron] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:51.866687 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-df0cd693-d0b8-46d2-b137-a4d825a37aca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:42:51.945813 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0cd693-d0b8-46d2-b137-a4d825a37aca service neutron] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:51.949557 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385106ab-9c28-4907-a1d7-cfd3582e1d24 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af5a95620a4b43538abfe09eed4bf115', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:51.950201 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385106ab-9c28-4907-a1d7-cfd3582e1d24 service cinder] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:51.950485 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385106ab-9c28-4907-a1d7-cfd3582e1d24 service cinder] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:51.950768 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385106ab-9c28-4907-a1d7-cfd3582e1d24 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:51.959552 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385106ab-9c28-4907-a1d7-cfd3582e1d24 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:51.961013 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385106ab-9c28-4907-a1d7-cfd3582e1d24 service cinder] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:51.969842 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1058/2128] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:42:51 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:42:52.984943 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35144cc-f831-4870-9934-473e0b38ed21 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:52.986547 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-c35144cc-f831-4870-9934-473e0b38ed21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:42:53.002352 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35144cc-f831-4870-9934-473e0b38ed21 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:53.007108 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbd287d-6c45-45bc-a462-4b665e695164 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af5a95620a4b43538abfe09eed4bf115', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:53.007288 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda35c5a-dceb-4af0-b124-9da953c19fa4 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:53.007903 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda35c5a-dceb-4af0-b124-9da953c19fa4 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:53.007903 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda35c5a-dceb-4af0-b124-9da953c19fa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:53.008118 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbd287d-6c45-45bc-a462-4b665e695164 service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:53.008380 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbd287d-6c45-45bc-a462-4b665e695164 service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:53.008919 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbd287d-6c45-45bc-a462-4b665e695164 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:53.010883 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-6fbd287d-6c45-45bc-a462-4b665e695164 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:42:53.027651 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-fda35c5a-dceb-4af0-b124-9da953c19fa4 None None] MFA Rules not processed for user `68698bf3cf7a4dee9daa865e9d6454ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:42:53.028926 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-fda35c5a-dceb-4af0-b124-9da953c19fa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:42:53.080191 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbd287d-6c45-45bc-a462-4b665e695164 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:53.081762 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbd287d-6c45-45bc-a462-4b665e695164 service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:53.087783 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1059/2129] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:42:53 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:42:53.091568 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1071/2130] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:42:52 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:42:54.942582 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03997b2e-e47e-4281-bb42-48177229c09e None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:54.943092 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03997b2e-e47e-4281-bb42-48177229c09e None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:54.945877 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03997b2e-e47e-4281-bb42-48177229c09e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:54.961325 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-03997b2e-e47e-4281-bb42-48177229c09e None None] MFA Rules not processed for user `ace5be0026ab4c85932d358fcbcbf35e`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:42:54.962564 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-03997b2e-e47e-4281-bb42-48177229c09e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:42:54.970492 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1060/2131] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:42:54 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:42:57.037543 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbd287d-6c45-45bc-a462-4b665e695164 service cinder] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:57.039584 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-6fbd287d-6c45-45bc-a462-4b665e695164 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:42:57.054220 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbd287d-6c45-45bc-a462-4b665e695164 service cinder] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:57.059235 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336bce08-38cb-4ba4-9726-83a04ada5f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:57.060146 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336bce08-38cb-4ba4-9726-83a04ada5f84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:57.060436 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336bce08-38cb-4ba4-9726-83a04ada5f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:57.060713 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336bce08-38cb-4ba4-9726-83a04ada5f84 admin admin] PATH_INFO: `/v3/users/39de829aec0a4dd3be9e3e00ca006357` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:57.062528 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336bce08-38cb-4ba4-9726-83a04ada5f84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39de829aec0a4dd3be9e3e00ca006357)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:57.064666 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336bce08-38cb-4ba4-9726-83a04ada5f84 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:57.315601 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-336bce08-38cb-4ba4-9726-83a04ada5f84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39de829aec0a4dd3be9e3e00ca006357'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:57.316301 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-336bce08-38cb-4ba4-9726-83a04ada5f84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39de829aec0a4dd3be9e3e00ca006357'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:57.325445 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-336bce08-38cb-4ba4-9726-83a04ada5f84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39de829aec0a4dd3be9e3e00ca006357'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:57.339227 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-336bce08-38cb-4ba4-9726-83a04ada5f84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39de829aec0a4dd3be9e3e00ca006357'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:57.340132 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-336bce08-38cb-4ba4-9726-83a04ada5f84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39de829aec0a4dd3be9e3e00ca006357'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:57.438490 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1072/2132] 10.222.0.86 () {58 vars in 1223 bytes} [Tue Jun 7 14:42:57 2022] DELETE /identity/v3/users/39de829aec0a4dd3be9e3e00ca006357 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:42:57.444113 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df11e2d4-e735-441c-8682-ed8891337e3d None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:57.444598 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df11e2d4-e735-441c-8682-ed8891337e3d None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:57.444692 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df11e2d4-e735-441c-8682-ed8891337e3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:57.472846 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-df11e2d4-e735-441c-8682-ed8891337e3d None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:42:57.474090 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-df11e2d4-e735-441c-8682-ed8891337e3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:42:57.484322 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45040e23-1ce5-4607-90cd-d10853a8847d None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:57.484621 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45040e23-1ce5-4607-90cd-d10853a8847d None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:57.484900 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45040e23-1ce5-4607-90cd-d10853a8847d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:57.511559 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:42:57.517149 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-45040e23-1ce5-4607-90cd-d10853a8847d None None] MFA Rules not processed for user `d7b598c6a3f642ef9edc971ad3ebbe31`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:42:57.518521 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-45040e23-1ce5-4607-90cd-d10853a8847d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:42:57.531487 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:42:57.552397 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1061/2133] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:42:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:42:57.562160 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df11e2d4-e735-441c-8682-ed8891337e3d None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:57.563585 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-df11e2d4-e735-441c-8682-ed8891337e3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:42:57.586142 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1073/2134] 10.222.0.86 () {58 vars in 1009 bytes} [Tue Jun 7 14:42:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 14:42:57.634681 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45040e23-1ce5-4607-90cd-d10853a8847d None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:57.636367 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-45040e23-1ce5-4607-90cd-d10853a8847d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:42:57.641342 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df11e2d4-e735-441c-8682-ed8891337e3d None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:57.648136 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dacccd-9fd0-42f6-aa0f-9260db65a493 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dda603ec5517460a83c333db2af804d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:57.649342 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dacccd-9fd0-42f6-aa0f-9260db65a493 service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:57.649635 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dacccd-9fd0-42f6-aa0f-9260db65a493 service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:57.650213 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dacccd-9fd0-42f6-aa0f-9260db65a493 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:57.662861 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dacccd-9fd0-42f6-aa0f-9260db65a493 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:57.664480 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dacccd-9fd0-42f6-aa0f-9260db65a493 service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:57.675047 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1062/2135] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:42:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 14:42:57.723557 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45040e23-1ce5-4607-90cd-d10853a8847d None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:57.729912 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750e1533-b65e-4c37-a0c3-fd8591dc95fe service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9774349dd2b4ec092ef04c3df050a7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:57.730583 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750e1533-b65e-4c37-a0c3-fd8591dc95fe service swift] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:57.730868 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750e1533-b65e-4c37-a0c3-fd8591dc95fe service swift] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:57.731201 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750e1533-b65e-4c37-a0c3-fd8591dc95fe service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:57.740897 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750e1533-b65e-4c37-a0c3-fd8591dc95fe service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:57.742568 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750e1533-b65e-4c37-a0c3-fd8591dc95fe service swift] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:57.754286 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1074/2136] 10.222.0.86 () {60 vars in 1384 bytes} [Tue Jun 7 14:42:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 07 14:42:58.290031 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dacccd-9fd0-42f6-aa0f-9260db65a493 service neutron] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:58.291528 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-a7dacccd-9fd0-42f6-aa0f-9260db65a493 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:42:58.305782 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dacccd-9fd0-42f6-aa0f-9260db65a493 service neutron] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:58.311109 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ad7566-1189-4ebb-8eac-2ce045d87035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:58.316002 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ad7566-1189-4ebb-8eac-2ce045d87035 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:58.316002 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ad7566-1189-4ebb-8eac-2ce045d87035 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:58.316002 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ad7566-1189-4ebb-8eac-2ce045d87035 admin admin] PATH_INFO: `/v3/projects/f9d78cdf610f421684e8417f87a9d3a9` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:58.316002 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ad7566-1189-4ebb-8eac-2ce045d87035 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9d78cdf610f421684e8417f87a9d3a9)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:58.316833 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ad7566-1189-4ebb-8eac-2ce045d87035 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:58.503448 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-16ad7566-1189-4ebb-8eac-2ce045d87035 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9d78cdf610f421684e8417f87a9d3a9', 'request_id': 'req-16ad7566-1189-4ebb-8eac-2ce045d87035'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:58.511176 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-16ad7566-1189-4ebb-8eac-2ce045d87035 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9d78cdf610f421684e8417f87a9d3a9', 'request_id': 'req-16ad7566-1189-4ebb-8eac-2ce045d87035'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:58.599116 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-16ad7566-1189-4ebb-8eac-2ce045d87035 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9d78cdf610f421684e8417f87a9d3a9', 'request_id': 'req-16ad7566-1189-4ebb-8eac-2ce045d87035'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:58.621733 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-16ad7566-1189-4ebb-8eac-2ce045d87035 admin admin] The token cache is being invalidate because project f9d78cdf610f421684e8417f87a9d3a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:42:58.622215 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-16ad7566-1189-4ebb-8eac-2ce045d87035 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:58.623129 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-16ad7566-1189-4ebb-8eac-2ce045d87035 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:42:58.625108 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1063/2137] 10.222.0.86 () {58 vars in 1232 bytes} [Tue Jun 7 14:42:58 2022] DELETE /identity/v3/projects/f9d78cdf610f421684e8417f87a9d3a9 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:42:58.977901 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d98975-50f8-4897-8462-0d3bb8522249 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:58.978374 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d98975-50f8-4897-8462-0d3bb8522249 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:58.978479 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d98975-50f8-4897-8462-0d3bb8522249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:59.015665 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-06d98975-50f8-4897-8462-0d3bb8522249 None None] MFA Rules not processed for user `d7b598c6a3f642ef9edc971ad3ebbe31`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:42:59.016997 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-06d98975-50f8-4897-8462-0d3bb8522249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:42:59.103154 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1075/2138] 10.222.0.86 () {58 vars in 967 bytes} [Tue Jun 7 14:42:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:42:59.119544 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ad7566-1189-4ebb-8eac-2ce045d87035 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:42:59.121242 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-16ad7566-1189-4ebb-8eac-2ce045d87035 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:42:59.218228 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ad7566-1189-4ebb-8eac-2ce045d87035 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:42:59.224656 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c96152-2826-4793-922b-dfcea13522a2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9774349dd2b4ec092ef04c3df050a7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:42:59.225319 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c96152-2826-4793-922b-dfcea13522a2 service swift] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:42:59.228360 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c96152-2826-4793-922b-dfcea13522a2 service swift] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:42:59.228360 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c96152-2826-4793-922b-dfcea13522a2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:42:59.242103 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c96152-2826-4793-922b-dfcea13522a2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:42:59.244461 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c96152-2826-4793-922b-dfcea13522a2 service swift] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:42:59.249709 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:42:59.253237 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1064/2139] 10.222.0.86 () {60 vars in 1384 bytes} [Tue Jun 7 14:42:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 07 14:43:00.050800 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83181c12-ae79-4bc4-afbc-59aa4cac1461 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:43:00.050800 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83181c12-ae79-4bc4-afbc-59aa4cac1461 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:43:00.050800 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83181c12-ae79-4bc4-afbc-59aa4cac1461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:43:00.083517 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-83181c12-ae79-4bc4-afbc-59aa4cac1461 None None] MFA Rules not processed for user `d7b598c6a3f642ef9edc971ad3ebbe31`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:43:00.084893 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-83181c12-ae79-4bc4-afbc-59aa4cac1461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:43:00.097249 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1076/2140] 10.222.0.86 () {58 vars in 1009 bytes} [Tue Jun 7 14:43:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:43:00.110913 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c96152-2826-4793-922b-dfcea13522a2 service swift] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:43:00.123087 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c96152-2826-4793-922b-dfcea13522a2 service swift] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:43:00.130448 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22cd7e8-06a0-43c6-aea2-c2d75104507c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9774349dd2b4ec092ef04c3df050a7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:43:00.131472 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22cd7e8-06a0-43c6-aea2-c2d75104507c service swift] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:43:00.131995 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22cd7e8-06a0-43c6-aea2-c2d75104507c service swift] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:43:00.132578 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22cd7e8-06a0-43c6-aea2-c2d75104507c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:43:00.143420 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22cd7e8-06a0-43c6-aea2-c2d75104507c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:43:00.145123 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22cd7e8-06a0-43c6-aea2-c2d75104507c service swift] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:43:00.162378 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1065/2141] 10.222.0.86 () {60 vars in 1384 bytes} [Tue Jun 7 14:43:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 07 14:43:00.905749 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afc1a38-79f7-47d4-aa20-ed580e7055ad None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:43:00.906044 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afc1a38-79f7-47d4-aa20-ed580e7055ad None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:43:00.906332 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afc1a38-79f7-47d4-aa20-ed580e7055ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:43:00.924889 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-6afc1a38-79f7-47d4-aa20-ed580e7055ad None None] MFA Rules not processed for user `d7b598c6a3f642ef9edc971ad3ebbe31`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:43:00.926138 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-6afc1a38-79f7-47d4-aa20-ed580e7055ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:43:00.935316 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1077/2142] 10.222.0.86 () {58 vars in 967 bytes} [Tue Jun 7 14:43:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:43:00.948082 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22cd7e8-06a0-43c6-aea2-c2d75104507c service swift] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:43:00.958992 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22cd7e8-06a0-43c6-aea2-c2d75104507c service swift] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:43:00.966391 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877ca109-fd97-450d-be04-2381bcaf7e55 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9774349dd2b4ec092ef04c3df050a7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:43:00.967205 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877ca109-fd97-450d-be04-2381bcaf7e55 service swift] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:43:00.967711 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877ca109-fd97-450d-be04-2381bcaf7e55 service swift] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:43:00.968146 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877ca109-fd97-450d-be04-2381bcaf7e55 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:43:00.978785 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877ca109-fd97-450d-be04-2381bcaf7e55 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:43:00.981196 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877ca109-fd97-450d-be04-2381bcaf7e55 service swift] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:43:00.993580 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1066/2143] 10.222.0.86 () {60 vars in 1384 bytes} [Tue Jun 7 14:43:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 07 14:43:03.801232 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afc1a38-79f7-47d4-aa20-ed580e7055ad None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:43:03.802657 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-6afc1a38-79f7-47d4-aa20-ed580e7055ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:43:03.833392 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:43:03.866998 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afc1a38-79f7-47d4-aa20-ed580e7055ad None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:43:03.871551 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b53b7f-b681-40a4-80e7-9cd63331764c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:43:03.872454 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b53b7f-b681-40a4-80e7-9cd63331764c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:43:03.872737 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b53b7f-b681-40a4-80e7-9cd63331764c admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:43:03.873024 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b53b7f-b681-40a4-80e7-9cd63331764c admin admin] PATH_INFO: `/v3/users/2ff70dec43fa4fa8913be158a818078e` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:43:03.874208 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b53b7f-b681-40a4-80e7-9cd63331764c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ff70dec43fa4fa8913be158a818078e)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:43:03.876172 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b53b7f-b681-40a4-80e7-9cd63331764c admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:43:04.211529 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-45b53b7f-b681-40a4-80e7-9cd63331764c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ff70dec43fa4fa8913be158a818078e'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:43:04.212444 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-45b53b7f-b681-40a4-80e7-9cd63331764c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ff70dec43fa4fa8913be158a818078e'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:43:04.220257 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-45b53b7f-b681-40a4-80e7-9cd63331764c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ff70dec43fa4fa8913be158a818078e'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:43:04.239860 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-45b53b7f-b681-40a4-80e7-9cd63331764c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ff70dec43fa4fa8913be158a818078e'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:43:04.240575 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-45b53b7f-b681-40a4-80e7-9cd63331764c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ff70dec43fa4fa8913be158a818078e'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:43:04.364666 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1078/2144] 10.222.0.86 () {58 vars in 1223 bytes} [Tue Jun 7 14:43:03 2022] DELETE /identity/v3/users/2ff70dec43fa4fa8913be158a818078e => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:43:04.384420 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a898cc1-95aa-4c74-acf5-b922b1e36d56 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:43:04.384917 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a898cc1-95aa-4c74-acf5-b922b1e36d56 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:43:04.385028 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a898cc1-95aa-4c74-acf5-b922b1e36d56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:43:04.402469 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-4a898cc1-95aa-4c74-acf5-b922b1e36d56 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:43:04.403668 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-4a898cc1-95aa-4c74-acf5-b922b1e36d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:43:04.463489 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1067/2145] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:43:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:43:04.478887 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b53b7f-b681-40a4-80e7-9cd63331764c admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:43:04.480350 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-45b53b7f-b681-40a4-80e7-9cd63331764c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:43:04.538150 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b53b7f-b681-40a4-80e7-9cd63331764c admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:43:04.541631 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326f070e-3360-40fd-8f9e-0de22343afd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dda603ec5517460a83c333db2af804d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:43:04.542272 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326f070e-3360-40fd-8f9e-0de22343afd1 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:43:04.542553 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326f070e-3360-40fd-8f9e-0de22343afd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:43:04.542827 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326f070e-3360-40fd-8f9e-0de22343afd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:43:04.552160 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326f070e-3360-40fd-8f9e-0de22343afd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:43:04.553574 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326f070e-3360-40fd-8f9e-0de22343afd1 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:43:04.562955 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1079/2146] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:43:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:43:04.783146 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a898cc1-95aa-4c74-acf5-b922b1e36d56 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:43:04.784670 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-4a898cc1-95aa-4c74-acf5-b922b1e36d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:43:04.802130 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a898cc1-95aa-4c74-acf5-b922b1e36d56 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:43:04.806890 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf16368-0b11-4dde-8c3d-f0e80070ff2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:43:04.807873 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf16368-0b11-4dde-8c3d-f0e80070ff2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:43:04.808162 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf16368-0b11-4dde-8c3d-f0e80070ff2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:43:04.808441 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf16368-0b11-4dde-8c3d-f0e80070ff2b admin admin] PATH_INFO: `/v3/projects/99514fa5f7f34c388e687115b09d51c4` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:43:04.809741 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf16368-0b11-4dde-8c3d-f0e80070ff2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=99514fa5f7f34c388e687115b09d51c4)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:43:04.811644 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf16368-0b11-4dde-8c3d-f0e80070ff2b admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:43:04.953370 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-5bf16368-0b11-4dde-8c3d-f0e80070ff2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99514fa5f7f34c388e687115b09d51c4', 'request_id': 'req-5bf16368-0b11-4dde-8c3d-f0e80070ff2b'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:43:04.959787 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-5bf16368-0b11-4dde-8c3d-f0e80070ff2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99514fa5f7f34c388e687115b09d51c4', 'request_id': 'req-5bf16368-0b11-4dde-8c3d-f0e80070ff2b'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:43:05.037949 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-5bf16368-0b11-4dde-8c3d-f0e80070ff2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99514fa5f7f34c388e687115b09d51c4', 'request_id': 'req-5bf16368-0b11-4dde-8c3d-f0e80070ff2b'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:43:05.050372 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-5bf16368-0b11-4dde-8c3d-f0e80070ff2b admin admin] The token cache is being invalidate because project 99514fa5f7f34c388e687115b09d51c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:43:05.050595 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-5bf16368-0b11-4dde-8c3d-f0e80070ff2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:43:05.052279 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-5bf16368-0b11-4dde-8c3d-f0e80070ff2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:43:05.053904 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1068/2147] 10.222.0.86 () {58 vars in 1232 bytes} [Tue Jun 7 14:43:04 2022] DELETE /identity/v3/projects/99514fa5f7f34c388e687115b09d51c4 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:43:05.059155 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b9dfb1-1590-4a28-baca-c820248783f6 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:43:05.059541 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b9dfb1-1590-4a28-baca-c820248783f6 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:43:05.060127 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b9dfb1-1590-4a28-baca-c820248783f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:43:05.084847 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-52b9dfb1-1590-4a28-baca-c820248783f6 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:43:05.086362 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-52b9dfb1-1590-4a28-baca-c820248783f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:43:05.135114 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:43:05.154845 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1080/2148] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:43:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:43:05.163371 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0457f68-fbc5-4acd-80f4-00c1a7ba52c2 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:43:05.163671 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0457f68-fbc5-4acd-80f4-00c1a7ba52c2 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:43:05.163982 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0457f68-fbc5-4acd-80f4-00c1a7ba52c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:43:05.184906 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-a0457f68-fbc5-4acd-80f4-00c1a7ba52c2 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:43:05.186137 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-a0457f68-fbc5-4acd-80f4-00c1a7ba52c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:43:05.195103 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1069/2149] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:43:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:43:05.199311 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b9dfb1-1590-4a28-baca-c820248783f6 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:43:05.215634 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b9dfb1-1590-4a28-baca-c820248783f6 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:43:05.221181 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9c96c1-3f48-41d3-be82-7a71ac698adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:43:05.222054 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9c96c1-3f48-41d3-be82-7a71ac698adb admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:43:05.222700 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9c96c1-3f48-41d3-be82-7a71ac698adb admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:43:05.223193 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9c96c1-3f48-41d3-be82-7a71ac698adb admin admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:43:05.224318 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9c96c1-3f48-41d3-be82-7a71ac698adb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:43:05.224809 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9c96c1-3f48-41d3-be82-7a71ac698adb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:43:05.226424 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9c96c1-3f48-41d3-be82-7a71ac698adb admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:43:05.244783 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1081/2150] 10.222.0.86 () {58 vars in 1152 bytes} [Tue Jun 7 14:43:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:43:05.248333 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0457f68-fbc5-4acd-80f4-00c1a7ba52c2 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:43:05.258451 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0457f68-fbc5-4acd-80f4-00c1a7ba52c2 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:43:05.263711 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9f2768-3502-40b8-8885-0684604d56c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:43:05.264411 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9f2768-3502-40b8-8885-0684604d56c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:43:05.264705 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9f2768-3502-40b8-8885-0684604d56c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:43:05.265027 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9f2768-3502-40b8-8885-0684604d56c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:43:05.265746 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9f2768-3502-40b8-8885-0684604d56c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:43:05.267646 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9f2768-3502-40b8-8885-0684604d56c4 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:43:05.399791 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1070/2151] 10.222.0.86 () {60 vars in 1152 bytes} [Tue Jun 7 14:43:05 2022] POST /identity/v3/projects => generated 391 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:43:05.403980 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9c96c1-3f48-41d3-be82-7a71ac698adb admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:43:05.415217 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9c96c1-3f48-41d3-be82-7a71ac698adb admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:43:05.480860 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f31088d-15e0-4007-8585-d60c1bccf1d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:43:05.484028 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f31088d-15e0-4007-8585-d60c1bccf1d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:43:05.486318 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f31088d-15e0-4007-8585-d60c1bccf1d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:43:05.486318 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f31088d-15e0-4007-8585-d60c1bccf1d1 admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:43:05.486318 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f31088d-15e0-4007-8585-d60c1bccf1d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:43:05.487677 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f31088d-15e0-4007-8585-d60c1bccf1d1 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:43:05.575774 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1082/2152] 10.222.0.86 () {60 vars in 1143 bytes} [Tue Jun 7 14:43:05 2022] POST /identity/v3/users => generated 296 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 14:43:05.579739 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9f2768-3502-40b8-8885-0684604d56c4 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:43:05.590043 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9f2768-3502-40b8-8885-0684604d56c4 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:43:05.594732 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79cdde3-2006-41c3-8af5-ed265c8ea218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:43:05.595381 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79cdde3-2006-41c3-8af5-ed265c8ea218 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:43:05.595667 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79cdde3-2006-41c3-8af5-ed265c8ea218 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:43:05.595979 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79cdde3-2006-41c3-8af5-ed265c8ea218 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:43:05.596719 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79cdde3-2006-41c3-8af5-ed265c8ea218 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:43:05.598808 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79cdde3-2006-41c3-8af5-ed265c8ea218 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:43:05.609173 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1071/2153] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:43:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:43:05.613007 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f31088d-15e0-4007-8585-d60c1bccf1d1 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:43:05.623921 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f31088d-15e0-4007-8585-d60c1bccf1d1 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:43:05.628662 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd34d0ab-74ab-4374-80f8-2ec0482da989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:43:05.629341 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd34d0ab-74ab-4374-80f8-2ec0482da989 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:43:05.629625 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd34d0ab-74ab-4374-80f8-2ec0482da989 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:43:05.629955 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd34d0ab-74ab-4374-80f8-2ec0482da989 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:43:05.630684 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd34d0ab-74ab-4374-80f8-2ec0482da989 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:43:05.632335 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd34d0ab-74ab-4374-80f8-2ec0482da989 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:43:05.642487 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1083/2154] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:43:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:43:05.647243 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79cdde3-2006-41c3-8af5-ed265c8ea218 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:43:05.657168 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79cdde3-2006-41c3-8af5-ed265c8ea218 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:43:05.662624 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76183e3-01fe-44a6-91af-bc14165cbe0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:43:05.663485 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76183e3-01fe-44a6-91af-bc14165cbe0f admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:43:05.663786 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76183e3-01fe-44a6-91af-bc14165cbe0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:43:05.664059 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76183e3-01fe-44a6-91af-bc14165cbe0f admin admin] PATH_INFO: `/v3/projects/a7b2fa47a7f94a7283489981b4fd0f18/users/81bd5f82a00a48e7b15cead44752572a/roles/c17acc2a8bb348f59ba7edd22fcf0c47` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:43:05.679579 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76183e3-01fe-44a6-91af-bc14165cbe0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7b2fa47a7f94a7283489981b4fd0f18, user_id=81bd5f82a00a48e7b15cead44752572a, role_id=c17acc2a8bb348f59ba7edd22fcf0c47)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:43:05.682242 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76183e3-01fe-44a6-91af-bc14165cbe0f admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:43:05.684712 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:43:05.746053 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1072/2155] 10.222.0.86 () {60 vars in 1482 bytes} [Tue Jun 7 14:43:05 2022] PUT /identity/v3/projects/a7b2fa47a7f94a7283489981b4fd0f18/users/81bd5f82a00a48e7b15cead44752572a/roles/c17acc2a8bb348f59ba7edd22fcf0c47 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:43:05.756221 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc597f2-6028-4047-801d-4423a9c48bf7 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:43:05.756605 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc597f2-6028-4047-801d-4423a9c48bf7 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:43:05.756903 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc597f2-6028-4047-801d-4423a9c48bf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:43:05.783843 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-3dc597f2-6028-4047-801d-4423a9c48bf7 None None] MFA Rules not processed for user `81bd5f82a00a48e7b15cead44752572a`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:43:05.785081 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-3dc597f2-6028-4047-801d-4423a9c48bf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:43:05.849723 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1084/2156] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:43:05 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:43:05.860288 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76183e3-01fe-44a6-91af-bc14165cbe0f admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:43:05.861992 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-a76183e3-01fe-44a6-91af-bc14165cbe0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:43:05.918301 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76183e3-01fe-44a6-91af-bc14165cbe0f admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:43:05.922090 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f806f2-0bfc-44af-ab50-f171af8b13ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af5a95620a4b43538abfe09eed4bf115', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:43:05.922730 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f806f2-0bfc-44af-ab50-f171af8b13ca service cinder] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:43:05.923015 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f806f2-0bfc-44af-ab50-f171af8b13ca service cinder] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:43:05.923286 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f806f2-0bfc-44af-ab50-f171af8b13ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:43:05.932188 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f806f2-0bfc-44af-ab50-f171af8b13ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:43:05.933607 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f806f2-0bfc-44af-ab50-f171af8b13ca service cinder] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:43:05.942813 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1073/2157] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:43:05 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:43:15.845926 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=77,keystone:INSERT=3 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:43:16.191144 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:INSERT=1,keystone:SELECT=28 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:43:21.169502 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad1af33-9854-45f1-8087-f8ddf5f28385 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:43:21.169990 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad1af33-9854-45f1-8087-f8ddf5f28385 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:43:21.170083 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad1af33-9854-45f1-8087-f8ddf5f28385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:43:21.188065 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-1ad1af33-9854-45f1-8087-f8ddf5f28385 None None] MFA Rules not processed for user `ace5be0026ab4c85932d358fcbcbf35e`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:43:21.189285 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-1ad1af33-9854-45f1-8087-f8ddf5f28385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:43:21.255095 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1085/2158] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:43:21 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:43:21.975689 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f806f2-0bfc-44af-ab50-f171af8b13ca service cinder] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:43:22.057409 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f806f2-0bfc-44af-ab50-f171af8b13ca service cinder] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:43:22.062175 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7d110f-c94b-4bac-86cc-9eb373caa2de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:43:22.063076 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7d110f-c94b-4bac-86cc-9eb373caa2de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:43:22.063359 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7d110f-c94b-4bac-86cc-9eb373caa2de admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:43:22.063658 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7d110f-c94b-4bac-86cc-9eb373caa2de admin admin] PATH_INFO: `/v3/users/81bd5f82a00a48e7b15cead44752572a` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:43:22.064883 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7d110f-c94b-4bac-86cc-9eb373caa2de admin admin] RBAC: Authorizing `identity:delete_user(user_id=81bd5f82a00a48e7b15cead44752572a)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:43:22.067332 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7d110f-c94b-4bac-86cc-9eb373caa2de admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:43:22.322611 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-2d7d110f-c94b-4bac-86cc-9eb373caa2de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81bd5f82a00a48e7b15cead44752572a'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:43:22.329695 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-2d7d110f-c94b-4bac-86cc-9eb373caa2de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81bd5f82a00a48e7b15cead44752572a'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:43:22.330401 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-2d7d110f-c94b-4bac-86cc-9eb373caa2de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81bd5f82a00a48e7b15cead44752572a'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:43:22.345331 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-2d7d110f-c94b-4bac-86cc-9eb373caa2de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81bd5f82a00a48e7b15cead44752572a'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:43:22.345331 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-2d7d110f-c94b-4bac-86cc-9eb373caa2de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81bd5f82a00a48e7b15cead44752572a'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:43:22.465243 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1074/2159] 10.222.0.86 () {58 vars in 1223 bytes} [Tue Jun 7 14:43:21 2022] DELETE /identity/v3/users/81bd5f82a00a48e7b15cead44752572a => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:43:22.466853 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876a64a2-4f59-4daa-874c-4ede10938e2a None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:43:22.467323 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876a64a2-4f59-4daa-874c-4ede10938e2a None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:43:22.467419 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876a64a2-4f59-4daa-874c-4ede10938e2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:43:22.485426 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-876a64a2-4f59-4daa-874c-4ede10938e2a None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:43:22.486561 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-876a64a2-4f59-4daa-874c-4ede10938e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:43:22.546447 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1086/2160] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:43:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:43:22.556678 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7d110f-c94b-4bac-86cc-9eb373caa2de admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:43:22.558073 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-2d7d110f-c94b-4bac-86cc-9eb373caa2de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:43:22.614538 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7d110f-c94b-4bac-86cc-9eb373caa2de admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:43:22.618209 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d3ba62-1fb3-44ec-9e94-b060b0149555 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dda603ec5517460a83c333db2af804d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:43:22.618904 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d3ba62-1fb3-44ec-9e94-b060b0149555 service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:43:22.619214 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d3ba62-1fb3-44ec-9e94-b060b0149555 service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:43:22.619564 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d3ba62-1fb3-44ec-9e94-b060b0149555 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:43:22.628801 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d3ba62-1fb3-44ec-9e94-b060b0149555 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:43:22.630294 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d3ba62-1fb3-44ec-9e94-b060b0149555 service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:43:22.639862 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1075/2161] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:43:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:43:23.098002 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876a64a2-4f59-4daa-874c-4ede10938e2a None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:43:23.099776 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-876a64a2-4f59-4daa-874c-4ede10938e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:43:23.131827 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876a64a2-4f59-4daa-874c-4ede10938e2a None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:43:23.138284 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328da174-81bf-40ca-9282-b5bb81557e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:43:23.138284 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328da174-81bf-40ca-9282-b5bb81557e59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:43:23.138477 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328da174-81bf-40ca-9282-b5bb81557e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:43:23.139388 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328da174-81bf-40ca-9282-b5bb81557e59 admin admin] PATH_INFO: `/v3/projects/a7b2fa47a7f94a7283489981b4fd0f18` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:43:23.141882 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328da174-81bf-40ca-9282-b5bb81557e59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7b2fa47a7f94a7283489981b4fd0f18)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:43:23.144926 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328da174-81bf-40ca-9282-b5bb81557e59 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:43:23.341162 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-328da174-81bf-40ca-9282-b5bb81557e59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7b2fa47a7f94a7283489981b4fd0f18', 'request_id': 'req-328da174-81bf-40ca-9282-b5bb81557e59'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:43:23.348253 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-328da174-81bf-40ca-9282-b5bb81557e59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7b2fa47a7f94a7283489981b4fd0f18', 'request_id': 'req-328da174-81bf-40ca-9282-b5bb81557e59'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:43:23.431630 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-328da174-81bf-40ca-9282-b5bb81557e59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7b2fa47a7f94a7283489981b4fd0f18', 'request_id': 'req-328da174-81bf-40ca-9282-b5bb81557e59'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:43:23.443068 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-328da174-81bf-40ca-9282-b5bb81557e59 admin admin] The token cache is being invalidate because project a7b2fa47a7f94a7283489981b4fd0f18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:43:23.443360 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-328da174-81bf-40ca-9282-b5bb81557e59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:43:23.444075 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-328da174-81bf-40ca-9282-b5bb81557e59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:43:23.445657 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1087/2162] 10.222.0.86 () {58 vars in 1232 bytes} [Tue Jun 7 14:43:23 2022] DELETE /identity/v3/projects/a7b2fa47a7f94a7283489981b4fd0f18 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:43:23.450667 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c59d4a-e2c0-450c-88af-1a91e10c6cef None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:43:23.451126 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c59d4a-e2c0-450c-88af-1a91e10c6cef None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:43:23.451283 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c59d4a-e2c0-450c-88af-1a91e10c6cef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:43:23.492837 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-68c59d4a-e2c0-450c-88af-1a91e10c6cef None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:43:23.494075 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-68c59d4a-e2c0-450c-88af-1a91e10c6cef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:43:23.514102 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:43:23.568073 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1076/2163] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:43:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:43:23.634098 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff482e6d-3d81-4f3f-b2f2-bbfcdafcbffa None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:43:23.634657 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff482e6d-3d81-4f3f-b2f2-bbfcdafcbffa None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:43:23.634751 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff482e6d-3d81-4f3f-b2f2-bbfcdafcbffa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:43:23.654419 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-ff482e6d-3d81-4f3f-b2f2-bbfcdafcbffa None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:43:23.655851 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-ff482e6d-3d81-4f3f-b2f2-bbfcdafcbffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:43:23.664596 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1088/2164] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:43:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:43:23.668874 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c59d4a-e2c0-450c-88af-1a91e10c6cef None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:43:23.678936 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c59d4a-e2c0-450c-88af-1a91e10c6cef None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:43:23.683736 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c0d42d-42e7-4aa5-9906-0d97e5f25d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:43:23.687707 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c0d42d-42e7-4aa5-9906-0d97e5f25d86 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:43:23.687707 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c0d42d-42e7-4aa5-9906-0d97e5f25d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:43:23.687707 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c0d42d-42e7-4aa5-9906-0d97e5f25d86 admin admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:43:23.687707 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c0d42d-42e7-4aa5-9906-0d97e5f25d86 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:43:23.687707 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c0d42d-42e7-4aa5-9906-0d97e5f25d86 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:43:23.687707 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c0d42d-42e7-4aa5-9906-0d97e5f25d86 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:43:23.699163 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1077/2165] 10.222.0.86 () {58 vars in 1152 bytes} [Tue Jun 7 14:43:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:43:23.703683 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff482e6d-3d81-4f3f-b2f2-bbfcdafcbffa None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:43:23.713606 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff482e6d-3d81-4f3f-b2f2-bbfcdafcbffa None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:43:23.718407 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046873f2-7970-428c-9d12-44dea4f9013a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:43:23.719059 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046873f2-7970-428c-9d12-44dea4f9013a admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:43:23.719344 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046873f2-7970-428c-9d12-44dea4f9013a admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:43:23.719636 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046873f2-7970-428c-9d12-44dea4f9013a admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:43:23.720357 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046873f2-7970-428c-9d12-44dea4f9013a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:43:23.722880 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046873f2-7970-428c-9d12-44dea4f9013a admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:43:23.844832 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:43:23.852025 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1089/2166] 10.222.0.86 () {60 vars in 1152 bytes} [Tue Jun 7 14:43:23 2022] POST /identity/v3/projects => generated 399 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:43:23.856747 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c0d42d-42e7-4aa5-9906-0d97e5f25d86 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:43:23.866883 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c0d42d-42e7-4aa5-9906-0d97e5f25d86 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:43:23.928537 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41edf84-2dca-42ce-a825-ec015db419a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:43:23.929210 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41edf84-2dca-42ce-a825-ec015db419a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:43:23.929495 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41edf84-2dca-42ce-a825-ec015db419a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:43:23.929776 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41edf84-2dca-42ce-a825-ec015db419a7 admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:43:23.930468 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41edf84-2dca-42ce-a825-ec015db419a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:43:23.932417 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41edf84-2dca-42ce-a825-ec015db419a7 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:43:24.034950 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1078/2167] 10.222.0.86 () {60 vars in 1143 bytes} [Tue Jun 7 14:43:23 2022] POST /identity/v3/users => generated 300 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:43:24.036215 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046873f2-7970-428c-9d12-44dea4f9013a admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:43:24.046448 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046873f2-7970-428c-9d12-44dea4f9013a admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:43:24.051414 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8e5e23-7a4f-412d-9f60-a63dfb28b870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:43:24.052197 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8e5e23-7a4f-412d-9f60-a63dfb28b870 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:43:24.052484 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8e5e23-7a4f-412d-9f60-a63dfb28b870 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:43:24.052761 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8e5e23-7a4f-412d-9f60-a63dfb28b870 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:43:24.053537 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8e5e23-7a4f-412d-9f60-a63dfb28b870 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:43:24.055389 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8e5e23-7a4f-412d-9f60-a63dfb28b870 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:43:24.067138 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1090/2168] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:43:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:43:24.071272 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41edf84-2dca-42ce-a825-ec015db419a7 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:43:24.081379 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41edf84-2dca-42ce-a825-ec015db419a7 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:43:24.086887 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5edd11-6b53-43a6-8cd3-bb4695a53ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:43:24.087700 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5edd11-6b53-43a6-8cd3-bb4695a53ecd admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:43:24.088018 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5edd11-6b53-43a6-8cd3-bb4695a53ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:43:24.088331 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5edd11-6b53-43a6-8cd3-bb4695a53ecd admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:43:24.089105 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5edd11-6b53-43a6-8cd3-bb4695a53ecd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:43:24.090688 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5edd11-6b53-43a6-8cd3-bb4695a53ecd admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:43:24.104453 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1079/2169] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:43:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 07 14:43:24.106169 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8e5e23-7a4f-412d-9f60-a63dfb28b870 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:43:24.117257 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8e5e23-7a4f-412d-9f60-a63dfb28b870 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:43:24.122352 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dec6cc-3dce-49e6-b6d7-1289d6280140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:43:24.123243 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dec6cc-3dce-49e6-b6d7-1289d6280140 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:43:24.123524 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dec6cc-3dce-49e6-b6d7-1289d6280140 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:43:24.123860 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dec6cc-3dce-49e6-b6d7-1289d6280140 admin admin] PATH_INFO: `/v3/projects/9b2adf0f663f4d668f53275ab12a3bc4/users/fb6ff57e21df48f299ef37b7fcfc9172/roles/c17acc2a8bb348f59ba7edd22fcf0c47` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:43:24.142552 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dec6cc-3dce-49e6-b6d7-1289d6280140 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b2adf0f663f4d668f53275ab12a3bc4, user_id=fb6ff57e21df48f299ef37b7fcfc9172, role_id=c17acc2a8bb348f59ba7edd22fcf0c47)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:43:24.146180 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dec6cc-3dce-49e6-b6d7-1289d6280140 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:43:24.179921 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5edd11-6b53-43a6-8cd3-bb4695a53ecd admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:43:24.181737 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-2e5edd11-6b53-43a6-8cd3-bb4695a53ecd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:43:24.195377 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5edd11-6b53-43a6-8cd3-bb4695a53ecd admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:43:24.203218 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a04cf9-7aef-48cb-a432-4cee356e4b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:43:24.204259 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a04cf9-7aef-48cb-a432-4cee356e4b5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:43:24.204548 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a04cf9-7aef-48cb-a432-4cee356e4b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:43:24.204961 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a04cf9-7aef-48cb-a432-4cee356e4b5c admin admin] PATH_INFO: `/v3/users/3963bdd9df304a91a9d36e76bd9bc527` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:43:24.206206 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a04cf9-7aef-48cb-a432-4cee356e4b5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3963bdd9df304a91a9d36e76bd9bc527)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:43:24.208311 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a04cf9-7aef-48cb-a432-4cee356e4b5c admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:43:24.249574 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1091/2170] 10.222.0.86 () {60 vars in 1482 bytes} [Tue Jun 7 14:43:24 2022] PUT /identity/v3/projects/9b2adf0f663f4d668f53275ab12a3bc4/users/fb6ff57e21df48f299ef37b7fcfc9172/roles/c17acc2a8bb348f59ba7edd22fcf0c47 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:43:24.259574 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2ba06b-0a1b-4a26-8db8-eec6d208e9a6 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:43:24.259926 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2ba06b-0a1b-4a26-8db8-eec6d208e9a6 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:43:24.260215 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2ba06b-0a1b-4a26-8db8-eec6d208e9a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:43:24.286454 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-1c2ba06b-0a1b-4a26-8db8-eec6d208e9a6 None None] MFA Rules not processed for user `fb6ff57e21df48f299ef37b7fcfc9172`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:43:24.287673 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-1c2ba06b-0a1b-4a26-8db8-eec6d208e9a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:43:24.357993 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1092/2171] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:43:24 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 14:43:24.377776 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2ba06b-0a1b-4a26-8db8-eec6d208e9a6 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:43:24.379294 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-1c2ba06b-0a1b-4a26-8db8-eec6d208e9a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:43:24.433415 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-f7a04cf9-7aef-48cb-a432-4cee356e4b5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3963bdd9df304a91a9d36e76bd9bc527'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:43:24.447636 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2ba06b-0a1b-4a26-8db8-eec6d208e9a6 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:43:24.451659 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a41958-6923-41ad-b518-e94c0ed495a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af5a95620a4b43538abfe09eed4bf115', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:43:24.452685 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a41958-6923-41ad-b518-e94c0ed495a6 service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:43:24.452968 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a41958-6923-41ad-b518-e94c0ed495a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:43:24.453273 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a41958-6923-41ad-b518-e94c0ed495a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:43:24.454427 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-f7a04cf9-7aef-48cb-a432-4cee356e4b5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3963bdd9df304a91a9d36e76bd9bc527'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:43:24.457023 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-f7a04cf9-7aef-48cb-a432-4cee356e4b5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3963bdd9df304a91a9d36e76bd9bc527'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:43:24.463800 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a41958-6923-41ad-b518-e94c0ed495a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:43:24.469178 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a41958-6923-41ad-b518-e94c0ed495a6 service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:43:24.472825 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-f7a04cf9-7aef-48cb-a432-4cee356e4b5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3963bdd9df304a91a9d36e76bd9bc527'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:43:24.475395 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-f7a04cf9-7aef-48cb-a432-4cee356e4b5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3963bdd9df304a91a9d36e76bd9bc527'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:43:24.486774 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1093/2172] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:43:24 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 14:43:24.600969 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:43:24.605776 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1080/2173] 10.222.0.86 () {58 vars in 1223 bytes} [Tue Jun 7 14:43:24 2022] DELETE /identity/v3/users/3963bdd9df304a91a9d36e76bd9bc527 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 14:43:24.938719 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a41958-6923-41ad-b518-e94c0ed495a6 service cinder] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:43:25.011166 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:43:25.016038 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a41958-6923-41ad-b518-e94c0ed495a6 service cinder] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:43:25.083193 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c54c69-d8cb-4606-9aa7-51688975ab2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:43:25.084155 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c54c69-d8cb-4606-9aa7-51688975ab2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:43:25.084439 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c54c69-d8cb-4606-9aa7-51688975ab2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:43:25.084764 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c54c69-d8cb-4606-9aa7-51688975ab2d admin admin] PATH_INFO: `/v3/projects/79cff16d11ee4778946e2ec2ecbe003a` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:43:25.085988 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c54c69-d8cb-4606-9aa7-51688975ab2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=79cff16d11ee4778946e2ec2ecbe003a)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:43:25.088165 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c54c69-d8cb-4606-9aa7-51688975ab2d admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:43:25.282647 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-40c54c69-d8cb-4606-9aa7-51688975ab2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79cff16d11ee4778946e2ec2ecbe003a', 'request_id': 'req-40c54c69-d8cb-4606-9aa7-51688975ab2d'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:43:25.296308 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-40c54c69-d8cb-4606-9aa7-51688975ab2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79cff16d11ee4778946e2ec2ecbe003a', 'request_id': 'req-40c54c69-d8cb-4606-9aa7-51688975ab2d'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:43:25.427104 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-40c54c69-d8cb-4606-9aa7-51688975ab2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79cff16d11ee4778946e2ec2ecbe003a', 'request_id': 'req-40c54c69-d8cb-4606-9aa7-51688975ab2d'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:43:25.438490 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-40c54c69-d8cb-4606-9aa7-51688975ab2d admin admin] The token cache is being invalidate because project 79cff16d11ee4778946e2ec2ecbe003a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:43:25.442167 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-40c54c69-d8cb-4606-9aa7-51688975ab2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:43:25.442167 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-40c54c69-d8cb-4606-9aa7-51688975ab2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:43:25.442167 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1094/2174] 10.222.0.86 () {58 vars in 1232 bytes} [Tue Jun 7 14:43:24 2022] DELETE /identity/v3/projects/79cff16d11ee4778946e2ec2ecbe003a => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:43:25.446161 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a04cf9-7aef-48cb-a432-4cee356e4b5c admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:43:25.447585 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-f7a04cf9-7aef-48cb-a432-4cee356e4b5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:43:25.460550 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a04cf9-7aef-48cb-a432-4cee356e4b5c admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:43:25.517234 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d40c9d1-4a6a-41ce-861a-a91dc222fb6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:43:25.518371 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d40c9d1-4a6a-41ce-861a-a91dc222fb6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:43:25.518651 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d40c9d1-4a6a-41ce-861a-a91dc222fb6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:43:25.518921 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d40c9d1-4a6a-41ce-861a-a91dc222fb6e admin admin] PATH_INFO: `/v3/users/d299bb63e8824b78be6235ef8683d20e` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:43:25.520161 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d40c9d1-4a6a-41ce-861a-a91dc222fb6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d299bb63e8824b78be6235ef8683d20e)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:43:25.522184 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d40c9d1-4a6a-41ce-861a-a91dc222fb6e admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:43:25.737245 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-5d40c9d1-4a6a-41ce-861a-a91dc222fb6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd299bb63e8824b78be6235ef8683d20e'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:43:25.745415 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-5d40c9d1-4a6a-41ce-861a-a91dc222fb6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd299bb63e8824b78be6235ef8683d20e'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:43:25.746122 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-5d40c9d1-4a6a-41ce-861a-a91dc222fb6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd299bb63e8824b78be6235ef8683d20e'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:43:25.758645 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-5d40c9d1-4a6a-41ce-861a-a91dc222fb6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd299bb63e8824b78be6235ef8683d20e'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:43:25.759314 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-5d40c9d1-4a6a-41ce-861a-a91dc222fb6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd299bb63e8824b78be6235ef8683d20e'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:43:25.832862 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1081/2175] 10.222.0.86 () {58 vars in 1223 bytes} [Tue Jun 7 14:43:25 2022] DELETE /identity/v3/users/d299bb63e8824b78be6235ef8683d20e => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:43:26.120158 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c54c69-d8cb-4606-9aa7-51688975ab2d admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:43:26.122350 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-40c54c69-d8cb-4606-9aa7-51688975ab2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:43:26.138814 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c54c69-d8cb-4606-9aa7-51688975ab2d admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:43:26.250694 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ff9c62-cf7f-4540-981b-363371073e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:43:26.251837 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ff9c62-cf7f-4540-981b-363371073e0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:43:26.251999 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ff9c62-cf7f-4540-981b-363371073e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:43:26.252518 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ff9c62-cf7f-4540-981b-363371073e0b admin admin] PATH_INFO: `/v3/projects/9308cf11eb39478ab02b4a8b2d549c19` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:43:26.254729 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ff9c62-cf7f-4540-981b-363371073e0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=9308cf11eb39478ab02b4a8b2d549c19)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:43:26.256885 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ff9c62-cf7f-4540-981b-363371073e0b admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:43:26.389849 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:43:26.398832 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-46ff9c62-cf7f-4540-981b-363371073e0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9308cf11eb39478ab02b4a8b2d549c19', 'request_id': 'req-46ff9c62-cf7f-4540-981b-363371073e0b'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:43:26.405026 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-46ff9c62-cf7f-4540-981b-363371073e0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9308cf11eb39478ab02b4a8b2d549c19', 'request_id': 'req-46ff9c62-cf7f-4540-981b-363371073e0b'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:43:26.489037 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-46ff9c62-cf7f-4540-981b-363371073e0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9308cf11eb39478ab02b4a8b2d549c19', 'request_id': 'req-46ff9c62-cf7f-4540-981b-363371073e0b'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:43:26.501235 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-46ff9c62-cf7f-4540-981b-363371073e0b admin admin] The token cache is being invalidate because project 9308cf11eb39478ab02b4a8b2d549c19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:43:26.501598 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-46ff9c62-cf7f-4540-981b-363371073e0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:43:26.502411 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-46ff9c62-cf7f-4540-981b-363371073e0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:43:26.504860 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1095/2176] 10.222.0.86 () {58 vars in 1232 bytes} [Tue Jun 7 14:43:26 2022] DELETE /identity/v3/projects/9308cf11eb39478ab02b4a8b2d549c19 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:43:26.509462 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4a8946-f5f4-467a-a73d-d707d0221edf None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:43:26.509916 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4a8946-f5f4-467a-a73d-d707d0221edf None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:43:26.510083 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4a8946-f5f4-467a-a73d-d707d0221edf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:43:26.530724 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-db4a8946-f5f4-467a-a73d-d707d0221edf None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:43:26.532612 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-db4a8946-f5f4-467a-a73d-d707d0221edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:43:26.598877 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1082/2177] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:43:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:43:26.609798 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cdaf9f-c623-45b5-9e08-1fcdd35cdd99 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:43:26.610188 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cdaf9f-c623-45b5-9e08-1fcdd35cdd99 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:43:26.610630 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cdaf9f-c623-45b5-9e08-1fcdd35cdd99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:43:26.632022 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-30cdaf9f-c623-45b5-9e08-1fcdd35cdd99 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:43:26.633239 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-30cdaf9f-c623-45b5-9e08-1fcdd35cdd99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:43:26.643050 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1096/2178] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:43:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:43:26.646864 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4a8946-f5f4-467a-a73d-d707d0221edf None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:43:26.656714 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4a8946-f5f4-467a-a73d-d707d0221edf None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:43:26.662266 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747e5f60-8d09-41fc-bd31-0c741d26a01d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:43:26.662938 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747e5f60-8d09-41fc-bd31-0c741d26a01d admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:43:26.663229 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747e5f60-8d09-41fc-bd31-0c741d26a01d admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:43:26.663570 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747e5f60-8d09-41fc-bd31-0c741d26a01d admin admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:43:26.664348 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747e5f60-8d09-41fc-bd31-0c741d26a01d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:43:26.664662 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747e5f60-8d09-41fc-bd31-0c741d26a01d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:43:26.667999 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747e5f60-8d09-41fc-bd31-0c741d26a01d admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:43:26.679279 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1083/2179] 10.222.0.86 () {58 vars in 1152 bytes} [Tue Jun 7 14:43:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:43:26.683616 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cdaf9f-c623-45b5-9e08-1fcdd35cdd99 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:43:26.694084 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cdaf9f-c623-45b5-9e08-1fcdd35cdd99 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:43:26.700516 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4343d7-af05-4c0c-ad58-9c993adab0c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:43:26.700516 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4343d7-af05-4c0c-ad58-9c993adab0c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:43:26.700516 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4343d7-af05-4c0c-ad58-9c993adab0c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:43:26.700516 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4343d7-af05-4c0c-ad58-9c993adab0c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:43:26.700880 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4343d7-af05-4c0c-ad58-9c993adab0c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:43:26.702573 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4343d7-af05-4c0c-ad58-9c993adab0c9 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:43:26.816161 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1097/2180] 10.222.0.86 () {60 vars in 1152 bytes} [Tue Jun 7 14:43:26 2022] POST /identity/v3/projects => generated 385 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:43:26.819633 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747e5f60-8d09-41fc-bd31-0c741d26a01d admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:43:26.829963 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747e5f60-8d09-41fc-bd31-0c741d26a01d admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:43:26.834065 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:43:26.887672 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c27c0ce-89f5-41d4-ae3d-3040e4533944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:43:26.888385 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c27c0ce-89f5-41d4-ae3d-3040e4533944 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:43:26.888674 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c27c0ce-89f5-41d4-ae3d-3040e4533944 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:43:26.888955 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c27c0ce-89f5-41d4-ae3d-3040e4533944 admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:43:26.889662 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c27c0ce-89f5-41d4-ae3d-3040e4533944 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:43:26.891629 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c27c0ce-89f5-41d4-ae3d-3040e4533944 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:43:26.990028 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1084/2181] 10.222.0.86 () {60 vars in 1143 bytes} [Tue Jun 7 14:43:26 2022] POST /identity/v3/users => generated 293 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:43:26.991271 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4343d7-af05-4c0c-ad58-9c993adab0c9 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:43:27.001793 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4343d7-af05-4c0c-ad58-9c993adab0c9 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:43:27.007497 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e629f3-d5f3-4966-a5aa-406ad27e5d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:43:27.008230 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e629f3-d5f3-4966-a5aa-406ad27e5d45 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:43:27.008520 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e629f3-d5f3-4966-a5aa-406ad27e5d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:43:27.008795 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e629f3-d5f3-4966-a5aa-406ad27e5d45 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:43:27.010390 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e629f3-d5f3-4966-a5aa-406ad27e5d45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:43:27.011284 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e629f3-d5f3-4966-a5aa-406ad27e5d45 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:43:27.033186 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1098/2182] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:43:26 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:43:27.034435 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c27c0ce-89f5-41d4-ae3d-3040e4533944 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:43:27.045231 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c27c0ce-89f5-41d4-ae3d-3040e4533944 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:43:27.050102 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b55b76f-c666-4016-9e49-ffe76a2cc780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:43:27.051335 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b55b76f-c666-4016-9e49-ffe76a2cc780 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:43:27.051621 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b55b76f-c666-4016-9e49-ffe76a2cc780 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:43:27.051935 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b55b76f-c666-4016-9e49-ffe76a2cc780 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:43:27.052857 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b55b76f-c666-4016-9e49-ffe76a2cc780 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:43:27.054458 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b55b76f-c666-4016-9e49-ffe76a2cc780 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:43:27.067105 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1085/2183] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:43:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:43:27.071445 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e629f3-d5f3-4966-a5aa-406ad27e5d45 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:43:27.081382 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e629f3-d5f3-4966-a5aa-406ad27e5d45 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:43:27.086036 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692f4941-a7ed-4987-966c-3fceb4bd161f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:43:27.086917 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692f4941-a7ed-4987-966c-3fceb4bd161f admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:43:27.087201 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692f4941-a7ed-4987-966c-3fceb4bd161f admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:43:27.087484 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692f4941-a7ed-4987-966c-3fceb4bd161f admin admin] PATH_INFO: `/v3/projects/05eb69c3a05244349a60b0327bd93d6c/users/25c3089eaec242a9b4e3d5816fce77c2/roles/c17acc2a8bb348f59ba7edd22fcf0c47` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:43:27.103602 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692f4941-a7ed-4987-966c-3fceb4bd161f admin admin] RBAC: Authorizing `identity:create_grant(project_id=05eb69c3a05244349a60b0327bd93d6c, user_id=25c3089eaec242a9b4e3d5816fce77c2, role_id=c17acc2a8bb348f59ba7edd22fcf0c47)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:43:27.106284 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692f4941-a7ed-4987-966c-3fceb4bd161f admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:43:27.198771 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1099/2184] 10.222.0.86 () {60 vars in 1482 bytes} [Tue Jun 7 14:43:27 2022] PUT /identity/v3/projects/05eb69c3a05244349a60b0327bd93d6c/users/25c3089eaec242a9b4e3d5816fce77c2/roles/c17acc2a8bb348f59ba7edd22fcf0c47 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 14:43:27.209808 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4869a3d-21c7-42e9-babe-b82c28ff3e9b None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:43:27.210104 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4869a3d-21c7-42e9-babe-b82c28ff3e9b None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:43:27.210410 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4869a3d-21c7-42e9-babe-b82c28ff3e9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:43:27.243888 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-e4869a3d-21c7-42e9-babe-b82c28ff3e9b None None] MFA Rules not processed for user `25c3089eaec242a9b4e3d5816fce77c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:43:27.245971 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-e4869a3d-21c7-42e9-babe-b82c28ff3e9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:43:27.314946 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1086/2185] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:43:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:43:27.320058 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692f4941-a7ed-4987-966c-3fceb4bd161f admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:43:27.385402 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692f4941-a7ed-4987-966c-3fceb4bd161f admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:43:27.390278 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195cb818-a59e-4791-b4c6-0dbf782f390e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:43:27.390947 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195cb818-a59e-4791-b4c6-0dbf782f390e admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:43:27.391234 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195cb818-a59e-4791-b4c6-0dbf782f390e admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:43:27.391515 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195cb818-a59e-4791-b4c6-0dbf782f390e admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:43:27.392259 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195cb818-a59e-4791-b4c6-0dbf782f390e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:43:27.394530 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195cb818-a59e-4791-b4c6-0dbf782f390e admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:43:27.509020 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1100/2186] 10.222.0.86 () {60 vars in 1152 bytes} [Tue Jun 7 14:43:27 2022] POST /identity/v3/projects => generated 383 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:43:27.517176 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4869a3d-21c7-42e9-babe-b82c28ff3e9b None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:43:27.527805 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4869a3d-21c7-42e9-babe-b82c28ff3e9b None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:43:27.583363 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ad7a77-c77b-422b-81fe-2c56835073aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:43:27.584123 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ad7a77-c77b-422b-81fe-2c56835073aa admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:43:27.584407 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ad7a77-c77b-422b-81fe-2c56835073aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:43:27.584709 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ad7a77-c77b-422b-81fe-2c56835073aa admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:43:27.585378 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ad7a77-c77b-422b-81fe-2c56835073aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:43:27.587378 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ad7a77-c77b-422b-81fe-2c56835073aa admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:43:27.676885 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1087/2187] 10.222.0.86 () {60 vars in 1143 bytes} [Tue Jun 7 14:43:27 2022] POST /identity/v3/users => generated 298 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:43:27.680643 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195cb818-a59e-4791-b4c6-0dbf782f390e admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:43:27.693189 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195cb818-a59e-4791-b4c6-0dbf782f390e admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:43:27.699258 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689cfac4-ddd8-4e29-92a8-9b7596eafaa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:43:27.699687 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689cfac4-ddd8-4e29-92a8-9b7596eafaa2 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:43:27.700071 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689cfac4-ddd8-4e29-92a8-9b7596eafaa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:43:27.700353 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689cfac4-ddd8-4e29-92a8-9b7596eafaa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:43:27.701252 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689cfac4-ddd8-4e29-92a8-9b7596eafaa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:43:27.702867 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689cfac4-ddd8-4e29-92a8-9b7596eafaa2 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:43:27.715644 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1101/2188] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:43:27 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 07 14:43:27.719989 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ad7a77-c77b-422b-81fe-2c56835073aa admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:43:27.741208 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ad7a77-c77b-422b-81fe-2c56835073aa admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:43:27.746705 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc47da18-3cd4-45e3-9572-9d64d943d55c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:43:27.747908 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc47da18-3cd4-45e3-9572-9d64d943d55c admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:43:27.748377 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc47da18-3cd4-45e3-9572-9d64d943d55c admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:43:27.748803 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc47da18-3cd4-45e3-9572-9d64d943d55c admin admin] PATH_INFO: `/v3/projects/9d5236e5dfd04fcd8b193b8d9282bdfa/users/0faa7cdd794d404c9199f3cc9292194f/roles/e3bf6239f5bf477b965704b086786f11` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:43:27.765675 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc47da18-3cd4-45e3-9572-9d64d943d55c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d5236e5dfd04fcd8b193b8d9282bdfa, user_id=0faa7cdd794d404c9199f3cc9292194f, role_id=e3bf6239f5bf477b965704b086786f11)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:43:27.768891 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc47da18-3cd4-45e3-9572-9d64d943d55c admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:43:27.797973 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:43:27.866891 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1088/2189] 10.222.0.86 () {60 vars in 1482 bytes} [Tue Jun 7 14:43:27 2022] PUT /identity/v3/projects/9d5236e5dfd04fcd8b193b8d9282bdfa/users/0faa7cdd794d404c9199f3cc9292194f/roles/e3bf6239f5bf477b965704b086786f11 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:43:27.870875 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689cfac4-ddd8-4e29-92a8-9b7596eafaa2 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:43:27.880853 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689cfac4-ddd8-4e29-92a8-9b7596eafaa2 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:43:27.925138 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:43:27.948955 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983087cb-d031-46f7-941c-096d87c7e0f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:43:27.949637 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983087cb-d031-46f7-941c-096d87c7e0f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:43:27.949932 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983087cb-d031-46f7-941c-096d87c7e0f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:43:27.950230 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983087cb-d031-46f7-941c-096d87c7e0f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:43:27.950954 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983087cb-d031-46f7-941c-096d87c7e0f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:43:27.952639 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983087cb-d031-46f7-941c-096d87c7e0f1 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:43:27.962338 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1102/2190] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:43:27 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:43:27.966292 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc47da18-3cd4-45e3-9572-9d64d943d55c admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:43:27.977034 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc47da18-3cd4-45e3-9572-9d64d943d55c admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:43:27.981636 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab08454-343f-4322-9596-f6946eefbc5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:43:27.984382 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab08454-343f-4322-9596-f6946eefbc5a admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:43:27.984382 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab08454-343f-4322-9596-f6946eefbc5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:43:27.984382 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab08454-343f-4322-9596-f6946eefbc5a admin admin] PATH_INFO: `/v3/projects/9d5236e5dfd04fcd8b193b8d9282bdfa/users/0faa7cdd794d404c9199f3cc9292194f/roles/e3bf6239f5bf477b965704b086786f11` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:43:27.985005 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab08454-343f-4322-9596-f6946eefbc5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d5236e5dfd04fcd8b193b8d9282bdfa, user_id=0faa7cdd794d404c9199f3cc9292194f, role_id=e3bf6239f5bf477b965704b086786f11)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:43:27.987605 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab08454-343f-4322-9596-f6946eefbc5a admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:43:27.998149 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1089/2191] 10.222.0.86 () {60 vars in 1482 bytes} [Tue Jun 7 14:43:27 2022] PUT /identity/v3/projects/9d5236e5dfd04fcd8b193b8d9282bdfa/users/0faa7cdd794d404c9199f3cc9292194f/roles/e3bf6239f5bf477b965704b086786f11 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:43:28.009467 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0660bc-e500-4da7-bff3-ff3640b037ea None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:43:28.009914 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0660bc-e500-4da7-bff3-ff3640b037ea None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:43:28.010297 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0660bc-e500-4da7-bff3-ff3640b037ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:43:28.036990 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-ca0660bc-e500-4da7-bff3-ff3640b037ea None None] MFA Rules not processed for user `0faa7cdd794d404c9199f3cc9292194f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:43:28.038242 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-ca0660bc-e500-4da7-bff3-ff3640b037ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:43:28.104182 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1103/2192] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:43:28 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:43:28.320087 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab08454-343f-4322-9596-f6946eefbc5a admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:43:28.321897 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-2ab08454-343f-4322-9596-f6946eefbc5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:43:28.395017 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab08454-343f-4322-9596-f6946eefbc5a admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:43:28.407122 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426f781e-f558-40c8-9999-d0f2521f3187 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af5a95620a4b43538abfe09eed4bf115', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:43:28.407944 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426f781e-f558-40c8-9999-d0f2521f3187 service cinder] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:43:28.408232 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426f781e-f558-40c8-9999-d0f2521f3187 service cinder] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:43:28.408536 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426f781e-f558-40c8-9999-d0f2521f3187 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:43:28.474531 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426f781e-f558-40c8-9999-d0f2521f3187 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:43:28.476086 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426f781e-f558-40c8-9999-d0f2521f3187 service cinder] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:43:28.495439 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1090/2193] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:43:28 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:43:33.039600 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0660bc-e500-4da7-bff3-ff3640b037ea None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:43:33.041327 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-ca0660bc-e500-4da7-bff3-ff3640b037ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:43:33.105934 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0660bc-e500-4da7-bff3-ff3640b037ea None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:43:33.111415 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2241cc-3ae1-4ae7-92e3-d5542edf1851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:43:33.111415 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2241cc-3ae1-4ae7-92e3-d5542edf1851 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:43:33.111713 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2241cc-3ae1-4ae7-92e3-d5542edf1851 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:43:33.112020 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2241cc-3ae1-4ae7-92e3-d5542edf1851 admin admin] PATH_INFO: `/v3/users/fb6ff57e21df48f299ef37b7fcfc9172` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:43:33.113252 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2241cc-3ae1-4ae7-92e3-d5542edf1851 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb6ff57e21df48f299ef37b7fcfc9172)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:43:33.115152 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2241cc-3ae1-4ae7-92e3-d5542edf1851 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:43:33.343122 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-fa2241cc-3ae1-4ae7-92e3-d5542edf1851 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb6ff57e21df48f299ef37b7fcfc9172'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:43:33.343732 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-fa2241cc-3ae1-4ae7-92e3-d5542edf1851 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb6ff57e21df48f299ef37b7fcfc9172'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:43:33.351279 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-fa2241cc-3ae1-4ae7-92e3-d5542edf1851 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb6ff57e21df48f299ef37b7fcfc9172'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:43:33.353630 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:43:33.364110 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-fa2241cc-3ae1-4ae7-92e3-d5542edf1851 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb6ff57e21df48f299ef37b7fcfc9172'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:43:33.364855 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-fa2241cc-3ae1-4ae7-92e3-d5542edf1851 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb6ff57e21df48f299ef37b7fcfc9172'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:43:33.478238 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1104/2194] 10.222.0.86 () {58 vars in 1223 bytes} [Tue Jun 7 14:43:33 2022] DELETE /identity/v3/users/fb6ff57e21df48f299ef37b7fcfc9172 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:43:33.482734 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21343f2-0ea2-4c32-852f-2de4f849ec1f None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:43:33.483209 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21343f2-0ea2-4c32-852f-2de4f849ec1f None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:43:33.483299 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21343f2-0ea2-4c32-852f-2de4f849ec1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:43:33.501029 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-e21343f2-0ea2-4c32-852f-2de4f849ec1f None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:43:33.502265 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-e21343f2-0ea2-4c32-852f-2de4f849ec1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:43:33.563217 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1091/2195] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:43:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:43:33.573396 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2241cc-3ae1-4ae7-92e3-d5542edf1851 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:43:33.574781 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-fa2241cc-3ae1-4ae7-92e3-d5542edf1851 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:43:33.630091 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2241cc-3ae1-4ae7-92e3-d5542edf1851 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:43:33.633651 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f9521b-3055-458e-95c3-887b5031ab07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dda603ec5517460a83c333db2af804d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:43:33.634294 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f9521b-3055-458e-95c3-887b5031ab07 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:43:33.634577 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f9521b-3055-458e-95c3-887b5031ab07 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:43:33.634851 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f9521b-3055-458e-95c3-887b5031ab07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:43:33.644315 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f9521b-3055-458e-95c3-887b5031ab07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:43:33.645758 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f9521b-3055-458e-95c3-887b5031ab07 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:43:33.654902 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1105/2196] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:43:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:43:34.106227 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21343f2-0ea2-4c32-852f-2de4f849ec1f None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:43:34.108063 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-e21343f2-0ea2-4c32-852f-2de4f849ec1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:43:34.124422 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21343f2-0ea2-4c32-852f-2de4f849ec1f None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:43:34.131831 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548b3e00-7bf4-4f23-9f47-d6a60917cee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:43:34.133005 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548b3e00-7bf4-4f23-9f47-d6a60917cee7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:43:34.133381 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548b3e00-7bf4-4f23-9f47-d6a60917cee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:43:34.133754 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548b3e00-7bf4-4f23-9f47-d6a60917cee7 admin admin] PATH_INFO: `/v3/projects/9b2adf0f663f4d668f53275ab12a3bc4` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:43:34.135308 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548b3e00-7bf4-4f23-9f47-d6a60917cee7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b2adf0f663f4d668f53275ab12a3bc4)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:43:34.137737 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548b3e00-7bf4-4f23-9f47-d6a60917cee7 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:43:34.160902 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:43:34.282166 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-548b3e00-7bf4-4f23-9f47-d6a60917cee7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b2adf0f663f4d668f53275ab12a3bc4', 'request_id': 'req-548b3e00-7bf4-4f23-9f47-d6a60917cee7'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:43:34.290211 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-548b3e00-7bf4-4f23-9f47-d6a60917cee7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b2adf0f663f4d668f53275ab12a3bc4', 'request_id': 'req-548b3e00-7bf4-4f23-9f47-d6a60917cee7'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:43:34.384232 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-548b3e00-7bf4-4f23-9f47-d6a60917cee7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b2adf0f663f4d668f53275ab12a3bc4', 'request_id': 'req-548b3e00-7bf4-4f23-9f47-d6a60917cee7'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:43:34.397410 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-548b3e00-7bf4-4f23-9f47-d6a60917cee7 admin admin] The token cache is being invalidate because project 9b2adf0f663f4d668f53275ab12a3bc4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:43:34.397706 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-548b3e00-7bf4-4f23-9f47-d6a60917cee7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:43:34.398392 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-548b3e00-7bf4-4f23-9f47-d6a60917cee7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:43:34.399989 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1092/2197] 10.222.0.86 () {58 vars in 1232 bytes} [Tue Jun 7 14:43:34 2022] DELETE /identity/v3/projects/9b2adf0f663f4d668f53275ab12a3bc4 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:43:37.111128 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f9521b-3055-458e-95c3-887b5031ab07 service neutron] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:43:37.116920 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-79f9521b-3055-458e-95c3-887b5031ab07 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:43:37.180548 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f9521b-3055-458e-95c3-887b5031ab07 service neutron] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:43:37.237107 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec53a175-484b-416b-b81d-16b4b0836484 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af5a95620a4b43538abfe09eed4bf115', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:43:37.238438 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec53a175-484b-416b-b81d-16b4b0836484 service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:43:37.238730 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec53a175-484b-416b-b81d-16b4b0836484 service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:43:37.239454 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec53a175-484b-416b-b81d-16b4b0836484 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:43:37.241428 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-ec53a175-484b-416b-b81d-16b4b0836484 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:43:37.290834 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:43:37.306818 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec53a175-484b-416b-b81d-16b4b0836484 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:43:37.308285 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec53a175-484b-416b-b81d-16b4b0836484 service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:43:37.318316 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1106/2198] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:43:37 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:43:38.555522 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e03c9f-185a-42e2-a719-cefc4b4a5879 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:43:38.556056 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e03c9f-185a-42e2-a719-cefc4b4a5879 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:43:38.556170 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e03c9f-185a-42e2-a719-cefc4b4a5879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:43:38.573798 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-f1e03c9f-185a-42e2-a719-cefc4b4a5879 None None] MFA Rules not processed for user `bd70563183ab43d68df41f1be27cadc3`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:43:38.574974 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-f1e03c9f-185a-42e2-a719-cefc4b4a5879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:43:38.629978 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1093/2199] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:43:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:43:42.049677 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec53a175-484b-416b-b81d-16b4b0836484 service cinder] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:43:42.051017 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-ec53a175-484b-416b-b81d-16b4b0836484 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:43:42.142849 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec53a175-484b-416b-b81d-16b4b0836484 service cinder] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:43:42.148775 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f35896-4818-4f0a-bac6-766dd6e8aed3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e042f9d4a9345bb947e6a30f64a59ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:43:42.149471 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f35896-4818-4f0a-bac6-766dd6e8aed3 service placement] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:43:42.149760 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f35896-4818-4f0a-bac6-766dd6e8aed3 service placement] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:43:42.150042 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f35896-4818-4f0a-bac6-766dd6e8aed3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:43:42.151853 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-b4f35896-4818-4f0a-bac6-766dd6e8aed3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:43:42.163232 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f35896-4818-4f0a-bac6-766dd6e8aed3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:43:42.164837 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f35896-4818-4f0a-bac6-766dd6e8aed3 service placement] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:43:42.174676 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1107/2200] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:43:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:43:44.459425 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e03c9f-185a-42e2-a719-cefc4b4a5879 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:43:44.460959 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-f1e03c9f-185a-42e2-a719-cefc4b4a5879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:43:44.526898 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e03c9f-185a-42e2-a719-cefc4b4a5879 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:43:44.531802 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4314bd-e961-42d9-b9ac-08b8b8716132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:43:44.532674 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4314bd-e961-42d9-b9ac-08b8b8716132 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:43:44.532956 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4314bd-e961-42d9-b9ac-08b8b8716132 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:43:44.533234 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4314bd-e961-42d9-b9ac-08b8b8716132 admin admin] PATH_INFO: `/v3/users/25c3089eaec242a9b4e3d5816fce77c2` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:43:44.534454 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4314bd-e961-42d9-b9ac-08b8b8716132 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25c3089eaec242a9b4e3d5816fce77c2)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:43:44.536510 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4314bd-e961-42d9-b9ac-08b8b8716132 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:43:44.732277 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-9b4314bd-e961-42d9-b9ac-08b8b8716132 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25c3089eaec242a9b4e3d5816fce77c2'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:43:44.737209 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:43:44.740255 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-9b4314bd-e961-42d9-b9ac-08b8b8716132 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25c3089eaec242a9b4e3d5816fce77c2'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:43:44.741064 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-9b4314bd-e961-42d9-b9ac-08b8b8716132 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25c3089eaec242a9b4e3d5816fce77c2'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:43:44.758868 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-9b4314bd-e961-42d9-b9ac-08b8b8716132 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25c3089eaec242a9b4e3d5816fce77c2'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:43:44.759617 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-9b4314bd-e961-42d9-b9ac-08b8b8716132 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25c3089eaec242a9b4e3d5816fce77c2'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:43:44.869376 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1094/2201] 10.222.0.86 () {58 vars in 1223 bytes} [Tue Jun 7 14:43:44 2022] DELETE /identity/v3/users/25c3089eaec242a9b4e3d5816fce77c2 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:43:44.876165 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4df8cd-6662-48ed-9bd3-6be99364fd5a None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:43:44.876165 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4df8cd-6662-48ed-9bd3-6be99364fd5a None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:43:44.876165 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4df8cd-6662-48ed-9bd3-6be99364fd5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:43:44.889720 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-bb4df8cd-6662-48ed-9bd3-6be99364fd5a None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:43:44.890970 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-bb4df8cd-6662-48ed-9bd3-6be99364fd5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:43:44.962505 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1108/2202] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:43:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:43:44.974802 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4314bd-e961-42d9-b9ac-08b8b8716132 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:43:44.976628 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-9b4314bd-e961-42d9-b9ac-08b8b8716132 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:43:45.057387 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4314bd-e961-42d9-b9ac-08b8b8716132 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:43:45.061060 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ebbee0-56f5-4a2a-af80-eb14b5ee99a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dda603ec5517460a83c333db2af804d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:43:45.061711 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ebbee0-56f5-4a2a-af80-eb14b5ee99a8 service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:43:45.061996 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ebbee0-56f5-4a2a-af80-eb14b5ee99a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:43:45.062273 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ebbee0-56f5-4a2a-af80-eb14b5ee99a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:43:45.071309 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ebbee0-56f5-4a2a-af80-eb14b5ee99a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:43:45.072763 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ebbee0-56f5-4a2a-af80-eb14b5ee99a8 service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:43:45.082771 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1095/2203] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:43:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:43:45.781314 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4df8cd-6662-48ed-9bd3-6be99364fd5a None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:43:45.782811 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-bb4df8cd-6662-48ed-9bd3-6be99364fd5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:43:45.797852 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4df8cd-6662-48ed-9bd3-6be99364fd5a None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:43:45.809756 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fddb517-f1ab-4fdb-a429-8ea04368c813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:43:45.809756 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fddb517-f1ab-4fdb-a429-8ea04368c813 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:43:45.809756 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fddb517-f1ab-4fdb-a429-8ea04368c813 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:43:45.809756 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fddb517-f1ab-4fdb-a429-8ea04368c813 admin admin] PATH_INFO: `/v3/projects/05eb69c3a05244349a60b0327bd93d6c` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:43:45.810662 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fddb517-f1ab-4fdb-a429-8ea04368c813 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05eb69c3a05244349a60b0327bd93d6c)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:43:45.813782 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fddb517-f1ab-4fdb-a429-8ea04368c813 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:43:45.931543 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-6fddb517-f1ab-4fdb-a429-8ea04368c813 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05eb69c3a05244349a60b0327bd93d6c', 'request_id': 'req-6fddb517-f1ab-4fdb-a429-8ea04368c813'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:43:45.932750 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:43:45.940147 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-6fddb517-f1ab-4fdb-a429-8ea04368c813 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05eb69c3a05244349a60b0327bd93d6c', 'request_id': 'req-6fddb517-f1ab-4fdb-a429-8ea04368c813'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:43:46.020059 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-6fddb517-f1ab-4fdb-a429-8ea04368c813 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05eb69c3a05244349a60b0327bd93d6c', 'request_id': 'req-6fddb517-f1ab-4fdb-a429-8ea04368c813'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:43:46.044794 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-6fddb517-f1ab-4fdb-a429-8ea04368c813 admin admin] The token cache is being invalidate because project 05eb69c3a05244349a60b0327bd93d6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:43:46.045092 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-6fddb517-f1ab-4fdb-a429-8ea04368c813 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:43:46.047083 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-6fddb517-f1ab-4fdb-a429-8ea04368c813 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:43:46.058614 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1109/2204] 10.222.0.86 () {58 vars in 1232 bytes} [Tue Jun 7 14:43:45 2022] DELETE /identity/v3/projects/05eb69c3a05244349a60b0327bd93d6c => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 14:43:46.061069 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ebbee0-56f5-4a2a-af80-eb14b5ee99a8 service neutron] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:43:46.071403 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ebbee0-56f5-4a2a-af80-eb14b5ee99a8 service neutron] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:43:46.136729 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087d0438-1497-49e5-983a-9532794c0b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:43:46.137677 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087d0438-1497-49e5-983a-9532794c0b51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:43:46.138080 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087d0438-1497-49e5-983a-9532794c0b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:43:46.138449 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087d0438-1497-49e5-983a-9532794c0b51 admin admin] PATH_INFO: `/v3/users/0faa7cdd794d404c9199f3cc9292194f` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:43:46.139737 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087d0438-1497-49e5-983a-9532794c0b51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0faa7cdd794d404c9199f3cc9292194f)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:43:46.141736 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087d0438-1497-49e5-983a-9532794c0b51 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:43:46.357217 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-087d0438-1497-49e5-983a-9532794c0b51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0faa7cdd794d404c9199f3cc9292194f'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:43:46.364166 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-087d0438-1497-49e5-983a-9532794c0b51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0faa7cdd794d404c9199f3cc9292194f'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:43:46.364839 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-087d0438-1497-49e5-983a-9532794c0b51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0faa7cdd794d404c9199f3cc9292194f'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:43:46.381088 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-087d0438-1497-49e5-983a-9532794c0b51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0faa7cdd794d404c9199f3cc9292194f'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:43:46.381744 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-087d0438-1497-49e5-983a-9532794c0b51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0faa7cdd794d404c9199f3cc9292194f'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:43:46.383493 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:43:46.524813 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1096/2205] 10.222.0.86 () {58 vars in 1223 bytes} [Tue Jun 7 14:43:46 2022] DELETE /identity/v3/users/0faa7cdd794d404c9199f3cc9292194f => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:43:46.937095 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeffdba7-6726-475c-9e9d-502d275aae85 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:43:46.937591 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeffdba7-6726-475c-9e9d-502d275aae85 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:43:46.937690 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeffdba7-6726-475c-9e9d-502d275aae85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:43:46.993287 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-aeffdba7-6726-475c-9e9d-502d275aae85 None None] MFA Rules not processed for user `d7b598c6a3f642ef9edc971ad3ebbe31`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:43:46.994523 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-aeffdba7-6726-475c-9e9d-502d275aae85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:43:47.070850 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1110/2206] 10.222.0.86 () {58 vars in 1009 bytes} [Tue Jun 7 14:43:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 14:43:47.083583 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087d0438-1497-49e5-983a-9532794c0b51 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:43:47.085288 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-087d0438-1497-49e5-983a-9532794c0b51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:43:47.181851 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087d0438-1497-49e5-983a-9532794c0b51 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:43:47.186769 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d348d94-1ca1-4e32-bbf2-d195d15991e2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9774349dd2b4ec092ef04c3df050a7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:43:47.187418 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d348d94-1ca1-4e32-bbf2-d195d15991e2 service swift] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:43:47.187703 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d348d94-1ca1-4e32-bbf2-d195d15991e2 service swift] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:43:47.188007 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d348d94-1ca1-4e32-bbf2-d195d15991e2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:43:47.196627 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d348d94-1ca1-4e32-bbf2-d195d15991e2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:43:47.198327 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d348d94-1ca1-4e32-bbf2-d195d15991e2 service swift] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:43:47.208912 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1097/2207] 10.222.0.86 () {60 vars in 1384 bytes} [Tue Jun 7 14:43:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 07 14:43:47.458524 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4309db2-2c56-4828-b13a-06394463a77f None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:43:47.458825 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4309db2-2c56-4828-b13a-06394463a77f None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:43:47.459110 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4309db2-2c56-4828-b13a-06394463a77f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:43:47.466259 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d348d94-1ca1-4e32-bbf2-d195d15991e2 service swift] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:43:47.467875 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-7d348d94-1ca1-4e32-bbf2-d195d15991e2 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:43:47.488306 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-b4309db2-2c56-4828-b13a-06394463a77f None None] MFA Rules not processed for user `d7b598c6a3f642ef9edc971ad3ebbe31`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:43:47.489547 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-b4309db2-2c56-4828-b13a-06394463a77f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:43:47.507357 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1111/2208] 10.222.0.86 () {58 vars in 1009 bytes} [Tue Jun 7 14:43:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:43:47.517874 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4309db2-2c56-4828-b13a-06394463a77f None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:43:47.536709 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4309db2-2c56-4828-b13a-06394463a77f None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:43:47.544675 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1313fc6-3eb2-4f32-97e8-2e77c5657ed4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9774349dd2b4ec092ef04c3df050a7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:43:47.546355 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1313fc6-3eb2-4f32-97e8-2e77c5657ed4 service swift] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:43:47.547166 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1313fc6-3eb2-4f32-97e8-2e77c5657ed4 service swift] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:43:47.547808 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1313fc6-3eb2-4f32-97e8-2e77c5657ed4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:43:47.560136 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1313fc6-3eb2-4f32-97e8-2e77c5657ed4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:43:47.562436 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1313fc6-3eb2-4f32-97e8-2e77c5657ed4 service swift] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:43:47.578630 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1112/2209] 10.222.0.86 () {60 vars in 1384 bytes} [Tue Jun 7 14:43:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 07 14:43:47.598802 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d348d94-1ca1-4e32-bbf2-d195d15991e2 service swift] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:43:47.604396 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75acd35-142f-449e-a6df-8eddc997b493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:43:47.605492 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75acd35-142f-449e-a6df-8eddc997b493 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:43:47.605850 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75acd35-142f-449e-a6df-8eddc997b493 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:43:47.606222 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75acd35-142f-449e-a6df-8eddc997b493 admin admin] PATH_INFO: `/v3/projects/9d5236e5dfd04fcd8b193b8d9282bdfa` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:43:47.607487 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75acd35-142f-449e-a6df-8eddc997b493 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d5236e5dfd04fcd8b193b8d9282bdfa)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:43:47.609530 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75acd35-142f-449e-a6df-8eddc997b493 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:43:47.738058 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-f75acd35-142f-449e-a6df-8eddc997b493 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d5236e5dfd04fcd8b193b8d9282bdfa', 'request_id': 'req-f75acd35-142f-449e-a6df-8eddc997b493'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:43:47.755656 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-f75acd35-142f-449e-a6df-8eddc997b493 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d5236e5dfd04fcd8b193b8d9282bdfa', 'request_id': 'req-f75acd35-142f-449e-a6df-8eddc997b493'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:43:47.831891 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-f75acd35-142f-449e-a6df-8eddc997b493 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d5236e5dfd04fcd8b193b8d9282bdfa', 'request_id': 'req-f75acd35-142f-449e-a6df-8eddc997b493'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:43:47.834438 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:INSERT=2,keystone:DELETE=7,keystone:SELECT=91 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:43:47.849404 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-f75acd35-142f-449e-a6df-8eddc997b493 admin admin] The token cache is being invalidate because project 9d5236e5dfd04fcd8b193b8d9282bdfa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:43:47.850057 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-f75acd35-142f-449e-a6df-8eddc997b493 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:43:47.850923 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-f75acd35-142f-449e-a6df-8eddc997b493 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:43:47.853108 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1098/2210] 10.222.0.86 () {58 vars in 1232 bytes} [Tue Jun 7 14:43:47 2022] DELETE /identity/v3/projects/9d5236e5dfd04fcd8b193b8d9282bdfa => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:43:47.859659 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b272c88f-8980-4890-8fc1-26fb970435bf None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:43:47.860094 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b272c88f-8980-4890-8fc1-26fb970435bf None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:43:47.860439 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b272c88f-8980-4890-8fc1-26fb970435bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:43:47.893179 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-b272c88f-8980-4890-8fc1-26fb970435bf None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:43:47.896214 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-b272c88f-8980-4890-8fc1-26fb970435bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:43:47.978101 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1113/2211] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:43:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:43:47.990657 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b244d1b-25a4-46ad-8c65-5d7805e915f3 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:43:47.990657 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b244d1b-25a4-46ad-8c65-5d7805e915f3 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:43:47.990657 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b244d1b-25a4-46ad-8c65-5d7805e915f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:43:48.021232 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-8b244d1b-25a4-46ad-8c65-5d7805e915f3 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:43:48.023156 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-8b244d1b-25a4-46ad-8c65-5d7805e915f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:43:48.049356 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1099/2212] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:43:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 14:43:48.051973 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b272c88f-8980-4890-8fc1-26fb970435bf None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:43:48.064854 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b272c88f-8980-4890-8fc1-26fb970435bf None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:43:48.071278 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3960982c-e267-498c-a1da-1e17be1a5572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:43:48.071910 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3960982c-e267-498c-a1da-1e17be1a5572 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:43:48.072844 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3960982c-e267-498c-a1da-1e17be1a5572 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:43:48.072844 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3960982c-e267-498c-a1da-1e17be1a5572 admin admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:43:48.073459 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3960982c-e267-498c-a1da-1e17be1a5572 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:43:48.073966 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3960982c-e267-498c-a1da-1e17be1a5572 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:43:48.077919 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3960982c-e267-498c-a1da-1e17be1a5572 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:43:48.093643 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1114/2213] 10.222.0.86 () {58 vars in 1152 bytes} [Tue Jun 7 14:43:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:43:48.097883 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b244d1b-25a4-46ad-8c65-5d7805e915f3 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:43:48.114997 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b244d1b-25a4-46ad-8c65-5d7805e915f3 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:43:48.121615 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552251ea-bdfc-4771-a1a7-e49003fa2574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:43:48.122982 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552251ea-bdfc-4771-a1a7-e49003fa2574 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:43:48.123424 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552251ea-bdfc-4771-a1a7-e49003fa2574 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:43:48.123936 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552251ea-bdfc-4771-a1a7-e49003fa2574 admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:43:48.124816 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552251ea-bdfc-4771-a1a7-e49003fa2574 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:43:48.131380 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552251ea-bdfc-4771-a1a7-e49003fa2574 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:43:48.226105 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1100/2214] 10.222.0.86 () {60 vars in 1152 bytes} [Tue Jun 7 14:43:48 2022] POST /identity/v3/projects => generated 373 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:43:48.230377 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3960982c-e267-498c-a1da-1e17be1a5572 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:43:48.255509 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3960982c-e267-498c-a1da-1e17be1a5572 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:43:48.289604 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:43:48.443041 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a17d76-b441-4e66-90d5-a47f3a770e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:43:48.444348 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a17d76-b441-4e66-90d5-a47f3a770e38 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:43:48.444880 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a17d76-b441-4e66-90d5-a47f3a770e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:43:48.445382 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a17d76-b441-4e66-90d5-a47f3a770e38 admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:43:48.447019 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a17d76-b441-4e66-90d5-a47f3a770e38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:43:48.449459 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a17d76-b441-4e66-90d5-a47f3a770e38 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:43:48.729501 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1115/2215] 10.222.0.86 () {60 vars in 1143 bytes} [Tue Jun 7 14:43:48 2022] POST /identity/v3/users => generated 287 bytes in 500 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:43:48.734520 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552251ea-bdfc-4771-a1a7-e49003fa2574 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:43:48.752475 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552251ea-bdfc-4771-a1a7-e49003fa2574 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:43:48.764295 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98301b3c-8d54-440b-868f-a7a7e0683c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:43:48.768430 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98301b3c-8d54-440b-868f-a7a7e0683c51 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:43:48.768430 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98301b3c-8d54-440b-868f-a7a7e0683c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:43:48.768430 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98301b3c-8d54-440b-868f-a7a7e0683c51 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:43:48.770179 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98301b3c-8d54-440b-868f-a7a7e0683c51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:43:48.772868 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98301b3c-8d54-440b-868f-a7a7e0683c51 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:43:48.810155 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1101/2216] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:43:48 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:43:48.811090 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a17d76-b441-4e66-90d5-a47f3a770e38 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:43:48.826621 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a17d76-b441-4e66-90d5-a47f3a770e38 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:43:48.835595 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c7101d-8698-4a5a-ab14-ebcd81fed799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:43:48.836343 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c7101d-8698-4a5a-ab14-ebcd81fed799 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:43:48.836628 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c7101d-8698-4a5a-ab14-ebcd81fed799 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:43:48.836904 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c7101d-8698-4a5a-ab14-ebcd81fed799 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:43:48.839056 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c7101d-8698-4a5a-ab14-ebcd81fed799 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:43:48.840760 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c7101d-8698-4a5a-ab14-ebcd81fed799 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:43:48.862757 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1116/2217] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:43:48 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:43:48.863947 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98301b3c-8d54-440b-868f-a7a7e0683c51 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:43:48.879034 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98301b3c-8d54-440b-868f-a7a7e0683c51 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:43:48.896737 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c1dbff-5f16-4896-a9fb-b0ce3a57ca7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:43:48.897891 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c1dbff-5f16-4896-a9fb-b0ce3a57ca7a admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:43:48.898408 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c1dbff-5f16-4896-a9fb-b0ce3a57ca7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:43:48.898969 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c1dbff-5f16-4896-a9fb-b0ce3a57ca7a admin admin] PATH_INFO: `/v3/projects/a7a6c42397c44cab93c1013e2f6163e2/users/c848849d47574f7f82003563c7a7c1b0/roles/c17acc2a8bb348f59ba7edd22fcf0c47` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:43:48.922671 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c1dbff-5f16-4896-a9fb-b0ce3a57ca7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7a6c42397c44cab93c1013e2f6163e2, user_id=c848849d47574f7f82003563c7a7c1b0, role_id=c17acc2a8bb348f59ba7edd22fcf0c47)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:43:48.926788 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c1dbff-5f16-4896-a9fb-b0ce3a57ca7a admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:43:49.035824 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1102/2218] 10.222.0.86 () {60 vars in 1482 bytes} [Tue Jun 7 14:43:48 2022] PUT /identity/v3/projects/a7a6c42397c44cab93c1013e2f6163e2/users/c848849d47574f7f82003563c7a7c1b0/roles/c17acc2a8bb348f59ba7edd22fcf0c47 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:43:49.112517 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2905422a-b392-4e43-9dae-31d04c77aedb None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:43:49.113109 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2905422a-b392-4e43-9dae-31d04c77aedb None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:43:49.113109 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2905422a-b392-4e43-9dae-31d04c77aedb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:43:49.155860 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-2905422a-b392-4e43-9dae-31d04c77aedb None None] MFA Rules not processed for user `c848849d47574f7f82003563c7a7c1b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:43:49.157081 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-2905422a-b392-4e43-9dae-31d04c77aedb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:43:49.289588 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1117/2219] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:43:49 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:43:49.296743 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c1dbff-5f16-4896-a9fb-b0ce3a57ca7a admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:43:49.299947 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-32c1dbff-5f16-4896-a9fb-b0ce3a57ca7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:43:49.469405 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c1dbff-5f16-4896-a9fb-b0ce3a57ca7a admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:43:49.479590 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb96aac0-3199-4bc5-8f96-ffdd9117a6ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af5a95620a4b43538abfe09eed4bf115', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:43:49.480435 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb96aac0-3199-4bc5-8f96-ffdd9117a6ac service cinder] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:43:49.480811 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb96aac0-3199-4bc5-8f96-ffdd9117a6ac service cinder] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:43:49.481272 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb96aac0-3199-4bc5-8f96-ffdd9117a6ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:43:49.517023 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb96aac0-3199-4bc5-8f96-ffdd9117a6ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:43:49.519503 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb96aac0-3199-4bc5-8f96-ffdd9117a6ac service cinder] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:43:49.547854 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1103/2220] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:43:49 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:43:49.570043 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2905422a-b392-4e43-9dae-31d04c77aedb None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:43:49.727866 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2905422a-b392-4e43-9dae-31d04c77aedb None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:43:49.740695 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17efb201-47ee-4bf9-b762-277a00b1f4a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:43:49.742301 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17efb201-47ee-4bf9-b762-277a00b1f4a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:43:49.742809 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17efb201-47ee-4bf9-b762-277a00b1f4a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:43:49.743310 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17efb201-47ee-4bf9-b762-277a00b1f4a9 admin admin] PATH_INFO: `/v3/users/c848849d47574f7f82003563c7a7c1b0` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:43:49.744821 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17efb201-47ee-4bf9-b762-277a00b1f4a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c848849d47574f7f82003563c7a7c1b0)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:43:49.750589 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17efb201-47ee-4bf9-b762-277a00b1f4a9 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:43:49.882207 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:43:50.030455 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-17efb201-47ee-4bf9-b762-277a00b1f4a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c848849d47574f7f82003563c7a7c1b0'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:43:50.031327 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-17efb201-47ee-4bf9-b762-277a00b1f4a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c848849d47574f7f82003563c7a7c1b0'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:43:50.047268 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-17efb201-47ee-4bf9-b762-277a00b1f4a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c848849d47574f7f82003563c7a7c1b0'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:43:50.068523 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-17efb201-47ee-4bf9-b762-277a00b1f4a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c848849d47574f7f82003563c7a7c1b0'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:43:50.071085 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-17efb201-47ee-4bf9-b762-277a00b1f4a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c848849d47574f7f82003563c7a7c1b0'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:43:50.169913 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1118/2221] 10.222.0.86 () {58 vars in 1223 bytes} [Tue Jun 7 14:43:49 2022] DELETE /identity/v3/users/c848849d47574f7f82003563c7a7c1b0 => generated 0 bytes in 598 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:43:50.172341 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b5bf18-49ce-4b9a-95c6-dcc5d4e278dc None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:43:50.172640 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b5bf18-49ce-4b9a-95c6-dcc5d4e278dc None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:43:50.173037 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b5bf18-49ce-4b9a-95c6-dcc5d4e278dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:43:50.216770 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-09b5bf18-49ce-4b9a-95c6-dcc5d4e278dc None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:43:50.234693 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-09b5bf18-49ce-4b9a-95c6-dcc5d4e278dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:43:50.375993 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1104/2222] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:43:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:43:50.382903 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17efb201-47ee-4bf9-b762-277a00b1f4a9 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:43:50.385868 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-17efb201-47ee-4bf9-b762-277a00b1f4a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:43:50.535845 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17efb201-47ee-4bf9-b762-277a00b1f4a9 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:43:50.539715 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6632a6e-537c-43ab-9dc5-d9d868fe44d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dda603ec5517460a83c333db2af804d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:43:50.540405 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6632a6e-537c-43ab-9dc5-d9d868fe44d1 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:43:50.540721 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6632a6e-537c-43ab-9dc5-d9d868fe44d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:43:50.540979 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6632a6e-537c-43ab-9dc5-d9d868fe44d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:43:50.557324 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6632a6e-537c-43ab-9dc5-d9d868fe44d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:43:50.559966 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6632a6e-537c-43ab-9dc5-d9d868fe44d1 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:43:50.586214 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1119/2223] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:43:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:43:51.692140 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b5bf18-49ce-4b9a-95c6-dcc5d4e278dc None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:43:51.695401 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-09b5bf18-49ce-4b9a-95c6-dcc5d4e278dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:43:51.706967 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b5bf18-49ce-4b9a-95c6-dcc5d4e278dc None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:43:51.713238 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dbf716-9432-4e04-b454-094b48a74e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:43:51.713238 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dbf716-9432-4e04-b454-094b48a74e55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:43:51.713530 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dbf716-9432-4e04-b454-094b48a74e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:43:51.713622 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dbf716-9432-4e04-b454-094b48a74e55 admin admin] PATH_INFO: `/v3/projects/a7a6c42397c44cab93c1013e2f6163e2` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:43:51.716564 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dbf716-9432-4e04-b454-094b48a74e55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7a6c42397c44cab93c1013e2f6163e2)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:43:51.717026 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dbf716-9432-4e04-b454-094b48a74e55 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:43:51.879213 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:43:51.895542 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-91dbf716-9432-4e04-b454-094b48a74e55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7a6c42397c44cab93c1013e2f6163e2', 'request_id': 'req-91dbf716-9432-4e04-b454-094b48a74e55'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:43:51.909578 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-91dbf716-9432-4e04-b454-094b48a74e55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7a6c42397c44cab93c1013e2f6163e2', 'request_id': 'req-91dbf716-9432-4e04-b454-094b48a74e55'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:43:52.014799 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-91dbf716-9432-4e04-b454-094b48a74e55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7a6c42397c44cab93c1013e2f6163e2', 'request_id': 'req-91dbf716-9432-4e04-b454-094b48a74e55'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:43:52.041714 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-91dbf716-9432-4e04-b454-094b48a74e55 admin admin] The token cache is being invalidate because project a7a6c42397c44cab93c1013e2f6163e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:43:52.042266 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-91dbf716-9432-4e04-b454-094b48a74e55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:43:52.043134 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-91dbf716-9432-4e04-b454-094b48a74e55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:43:52.045274 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1105/2224] 10.222.0.86 () {58 vars in 1232 bytes} [Tue Jun 7 14:43:51 2022] DELETE /identity/v3/projects/a7a6c42397c44cab93c1013e2f6163e2 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:43:52.051035 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f24a71-052d-4eef-b59c-12d3d2120784 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:43:52.051507 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f24a71-052d-4eef-b59c-12d3d2120784 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:43:52.051591 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f24a71-052d-4eef-b59c-12d3d2120784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:43:52.082763 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-57f24a71-052d-4eef-b59c-12d3d2120784 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:43:52.084917 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-57f24a71-052d-4eef-b59c-12d3d2120784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:43:52.170849 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1120/2225] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:43:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:43:52.178162 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15421b3-7d23-4b30-b47d-5bfb541e361e None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:43:52.178832 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15421b3-7d23-4b30-b47d-5bfb541e361e None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:43:52.179423 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15421b3-7d23-4b30-b47d-5bfb541e361e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:43:52.208088 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-e15421b3-7d23-4b30-b47d-5bfb541e361e None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:43:52.209558 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-e15421b3-7d23-4b30-b47d-5bfb541e361e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:43:52.219706 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1106/2226] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:43:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:43:52.225258 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f24a71-052d-4eef-b59c-12d3d2120784 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:43:52.245116 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f24a71-052d-4eef-b59c-12d3d2120784 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:43:52.250145 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4997bd8-05ce-4ed6-8e16-eddc3afe41fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:43:52.250816 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4997bd8-05ce-4ed6-8e16-eddc3afe41fc admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:43:52.251106 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4997bd8-05ce-4ed6-8e16-eddc3afe41fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:43:52.251385 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4997bd8-05ce-4ed6-8e16-eddc3afe41fc admin admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:43:52.252149 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4997bd8-05ce-4ed6-8e16-eddc3afe41fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:43:52.252569 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4997bd8-05ce-4ed6-8e16-eddc3afe41fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:43:52.254403 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4997bd8-05ce-4ed6-8e16-eddc3afe41fc admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:43:52.271573 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1121/2227] 10.222.0.86 () {58 vars in 1152 bytes} [Tue Jun 7 14:43:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:43:52.275721 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15421b3-7d23-4b30-b47d-5bfb541e361e None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:43:52.295454 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15421b3-7d23-4b30-b47d-5bfb541e361e None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:43:52.309738 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d703d92-ce4f-4bd3-8073-0536ac261616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:43:52.311207 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d703d92-ce4f-4bd3-8073-0536ac261616 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:43:52.311504 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d703d92-ce4f-4bd3-8073-0536ac261616 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:43:52.313943 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d703d92-ce4f-4bd3-8073-0536ac261616 admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:43:52.314684 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d703d92-ce4f-4bd3-8073-0536ac261616 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:43:52.321348 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d703d92-ce4f-4bd3-8073-0536ac261616 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:43:52.494746 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1107/2228] 10.222.0.86 () {60 vars in 1152 bytes} [Tue Jun 7 14:43:52 2022] POST /identity/v3/projects => generated 383 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:43:52.503043 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4997bd8-05ce-4ed6-8e16-eddc3afe41fc admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:43:52.536637 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4997bd8-05ce-4ed6-8e16-eddc3afe41fc admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:43:52.636520 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:43:52.726215 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59307162-7391-464d-bdbd-fe3a4b4a1bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:43:52.726914 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59307162-7391-464d-bdbd-fe3a4b4a1bca admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:43:52.727316 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59307162-7391-464d-bdbd-fe3a4b4a1bca admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:43:52.727603 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59307162-7391-464d-bdbd-fe3a4b4a1bca admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:43:52.730540 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59307162-7391-464d-bdbd-fe3a4b4a1bca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:43:52.751647 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59307162-7391-464d-bdbd-fe3a4b4a1bca admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:43:52.858900 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1122/2229] 10.222.0.86 () {60 vars in 1143 bytes} [Tue Jun 7 14:43:52 2022] POST /identity/v3/users => generated 292 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:43:52.861548 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d703d92-ce4f-4bd3-8073-0536ac261616 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:43:52.874703 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d703d92-ce4f-4bd3-8073-0536ac261616 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:43:52.880863 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a349746-00b6-460a-9874-d98a6f6f8996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:43:52.881719 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a349746-00b6-460a-9874-d98a6f6f8996 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:43:52.882168 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a349746-00b6-460a-9874-d98a6f6f8996 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:43:52.882798 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a349746-00b6-460a-9874-d98a6f6f8996 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:43:52.884546 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a349746-00b6-460a-9874-d98a6f6f8996 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:43:52.886498 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a349746-00b6-460a-9874-d98a6f6f8996 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:43:52.937550 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1108/2230] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:43:52 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:43:52.938266 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59307162-7391-464d-bdbd-fe3a4b4a1bca admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:43:52.959901 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59307162-7391-464d-bdbd-fe3a4b4a1bca admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:43:52.980548 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61946421-288f-4617-ad8c-283c0ef42ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:43:52.981924 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61946421-288f-4617-ad8c-283c0ef42ec9 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:43:52.982217 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61946421-288f-4617-ad8c-283c0ef42ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:43:52.982502 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61946421-288f-4617-ad8c-283c0ef42ec9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:43:52.983255 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61946421-288f-4617-ad8c-283c0ef42ec9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:43:52.984917 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61946421-288f-4617-ad8c-283c0ef42ec9 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:43:53.011513 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1123/2231] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:43:52 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 07 14:43:53.012702 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a349746-00b6-460a-9874-d98a6f6f8996 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:43:53.034439 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a349746-00b6-460a-9874-d98a6f6f8996 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:43:53.045960 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e660b82-bee6-434f-92cc-3f48d024012e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:43:53.047130 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e660b82-bee6-434f-92cc-3f48d024012e admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:43:53.047130 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e660b82-bee6-434f-92cc-3f48d024012e admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:43:53.047536 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e660b82-bee6-434f-92cc-3f48d024012e admin admin] PATH_INFO: `/v3/projects/f2f01c15aef843fe988a936986d48125/users/39e48dd49e964f3ca25340941a824e8c/roles/c17acc2a8bb348f59ba7edd22fcf0c47` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:43:53.077683 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e660b82-bee6-434f-92cc-3f48d024012e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2f01c15aef843fe988a936986d48125, user_id=39e48dd49e964f3ca25340941a824e8c, role_id=c17acc2a8bb348f59ba7edd22fcf0c47)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:43:53.080383 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e660b82-bee6-434f-92cc-3f48d024012e admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:43:53.186722 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1109/2232] 10.222.0.86 () {60 vars in 1482 bytes} [Tue Jun 7 14:43:53 2022] PUT /identity/v3/projects/f2f01c15aef843fe988a936986d48125/users/39e48dd49e964f3ca25340941a824e8c/roles/c17acc2a8bb348f59ba7edd22fcf0c47 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:43:53.196993 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9b50cd-5914-4f30-aaf8-f026aeda380c None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:43:53.197759 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9b50cd-5914-4f30-aaf8-f026aeda380c None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:43:53.197759 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9b50cd-5914-4f30-aaf8-f026aeda380c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:43:53.322010 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-eb9b50cd-5914-4f30-aaf8-f026aeda380c None None] MFA Rules not processed for user `39e48dd49e964f3ca25340941a824e8c`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:43:53.323268 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-eb9b50cd-5914-4f30-aaf8-f026aeda380c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:43:53.557250 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1124/2233] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:43:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:43:53.574172 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e660b82-bee6-434f-92cc-3f48d024012e admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:43:53.574172 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-4e660b82-bee6-434f-92cc-3f48d024012e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:43:53.761264 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e660b82-bee6-434f-92cc-3f48d024012e admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:43:53.765860 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1912bae3-54e0-47ac-98e2-26f3de5d7553 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af5a95620a4b43538abfe09eed4bf115', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:43:53.766527 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1912bae3-54e0-47ac-98e2-26f3de5d7553 service cinder] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:43:53.766814 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1912bae3-54e0-47ac-98e2-26f3de5d7553 service cinder] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:43:53.767354 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1912bae3-54e0-47ac-98e2-26f3de5d7553 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:43:53.778988 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1912bae3-54e0-47ac-98e2-26f3de5d7553 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:43:53.780511 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1912bae3-54e0-47ac-98e2-26f3de5d7553 service cinder] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:43:53.809961 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1110/2234] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:43:53 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:44:02.730779 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9b50cd-5914-4f30-aaf8-f026aeda380c None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:44:02.797293 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9b50cd-5914-4f30-aaf8-f026aeda380c None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:44:02.802619 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d3640c-1b57-4c83-8eb4-cb7513a760e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:44:02.803504 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d3640c-1b57-4c83-8eb4-cb7513a760e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:44:02.803925 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d3640c-1b57-4c83-8eb4-cb7513a760e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:44:02.804202 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d3640c-1b57-4c83-8eb4-cb7513a760e3 admin admin] PATH_INFO: `/v3/users/39e48dd49e964f3ca25340941a824e8c` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:44:02.805393 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d3640c-1b57-4c83-8eb4-cb7513a760e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39e48dd49e964f3ca25340941a824e8c)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:44:02.808287 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d3640c-1b57-4c83-8eb4-cb7513a760e3 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:44:02.977888 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:44:02.979716 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-66d3640c-1b57-4c83-8eb4-cb7513a760e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39e48dd49e964f3ca25340941a824e8c'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:44:02.980474 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-66d3640c-1b57-4c83-8eb4-cb7513a760e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39e48dd49e964f3ca25340941a824e8c'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:44:02.988630 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-66d3640c-1b57-4c83-8eb4-cb7513a760e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39e48dd49e964f3ca25340941a824e8c'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:44:03.003802 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-66d3640c-1b57-4c83-8eb4-cb7513a760e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39e48dd49e964f3ca25340941a824e8c'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:44:03.009062 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-66d3640c-1b57-4c83-8eb4-cb7513a760e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39e48dd49e964f3ca25340941a824e8c'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:44:03.118288 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1125/2235] 10.222.0.86 () {58 vars in 1223 bytes} [Tue Jun 7 14:44:02 2022] DELETE /identity/v3/users/39e48dd49e964f3ca25340941a824e8c => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:44:03.122799 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273d7c66-0d0a-45ff-9cd2-e59f2c99a2e1 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:44:03.123321 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273d7c66-0d0a-45ff-9cd2-e59f2c99a2e1 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:44:03.125771 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273d7c66-0d0a-45ff-9cd2-e59f2c99a2e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:44:03.144853 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-273d7c66-0d0a-45ff-9cd2-e59f2c99a2e1 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:44:03.146208 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-273d7c66-0d0a-45ff-9cd2-e59f2c99a2e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:44:03.202094 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:44:03.217294 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1111/2236] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:44:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:44:03.230290 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d3640c-1b57-4c83-8eb4-cb7513a760e3 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:44:03.232166 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-66d3640c-1b57-4c83-8eb4-cb7513a760e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:44:03.305203 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d3640c-1b57-4c83-8eb4-cb7513a760e3 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:44:03.308984 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2943959-f397-4602-bbcd-5e7404f08194 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dda603ec5517460a83c333db2af804d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:44:03.309734 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2943959-f397-4602-bbcd-5e7404f08194 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:44:03.310095 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2943959-f397-4602-bbcd-5e7404f08194 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:44:03.312596 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2943959-f397-4602-bbcd-5e7404f08194 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:44:03.323445 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2943959-f397-4602-bbcd-5e7404f08194 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:44:03.333461 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2943959-f397-4602-bbcd-5e7404f08194 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:44:03.337704 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1126/2237] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:44:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:44:03.805564 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273d7c66-0d0a-45ff-9cd2-e59f2c99a2e1 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:44:03.809410 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-273d7c66-0d0a-45ff-9cd2-e59f2c99a2e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:44:03.832429 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273d7c66-0d0a-45ff-9cd2-e59f2c99a2e1 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:44:03.839904 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384d8984-c967-4f27-b8c4-e650c9015726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:44:03.841193 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384d8984-c967-4f27-b8c4-e650c9015726 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:44:03.841723 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384d8984-c967-4f27-b8c4-e650c9015726 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:44:03.842213 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384d8984-c967-4f27-b8c4-e650c9015726 admin admin] PATH_INFO: `/v3/projects/f2f01c15aef843fe988a936986d48125` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:44:03.843321 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384d8984-c967-4f27-b8c4-e650c9015726 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2f01c15aef843fe988a936986d48125)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:44:03.845463 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384d8984-c967-4f27-b8c4-e650c9015726 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:44:03.965221 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-384d8984-c967-4f27-b8c4-e650c9015726 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2f01c15aef843fe988a936986d48125', 'request_id': 'req-384d8984-c967-4f27-b8c4-e650c9015726'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:44:03.972595 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-384d8984-c967-4f27-b8c4-e650c9015726 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2f01c15aef843fe988a936986d48125', 'request_id': 'req-384d8984-c967-4f27-b8c4-e650c9015726'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:44:04.059990 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-384d8984-c967-4f27-b8c4-e650c9015726 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2f01c15aef843fe988a936986d48125', 'request_id': 'req-384d8984-c967-4f27-b8c4-e650c9015726'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:44:04.076762 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-384d8984-c967-4f27-b8c4-e650c9015726 admin admin] The token cache is being invalidate because project f2f01c15aef843fe988a936986d48125 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:44:04.077059 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-384d8984-c967-4f27-b8c4-e650c9015726 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:44:04.077784 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-384d8984-c967-4f27-b8c4-e650c9015726 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:44:04.079623 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1112/2238] 10.222.0.86 () {58 vars in 1232 bytes} [Tue Jun 7 14:44:03 2022] DELETE /identity/v3/projects/f2f01c15aef843fe988a936986d48125 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:44:04.084997 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcafa28-e8a1-4725-8dfb-cb5e16b718f6 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:44:04.085957 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcafa28-e8a1-4725-8dfb-cb5e16b718f6 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:44:04.086299 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcafa28-e8a1-4725-8dfb-cb5e16b718f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:44:04.109289 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-2dcafa28-e8a1-4725-8dfb-cb5e16b718f6 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:44:04.110950 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-2dcafa28-e8a1-4725-8dfb-cb5e16b718f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:44:04.180919 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1127/2239] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:44:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:44:04.189440 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b73157f-01f2-4e9d-9312-a7eadb89ac7c None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:44:04.189988 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b73157f-01f2-4e9d-9312-a7eadb89ac7c None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:44:04.190110 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b73157f-01f2-4e9d-9312-a7eadb89ac7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:44:04.227285 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-5b73157f-01f2-4e9d-9312-a7eadb89ac7c None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:44:04.227285 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-5b73157f-01f2-4e9d-9312-a7eadb89ac7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:44:04.237794 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1113/2240] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:44:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:44:04.239402 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcafa28-e8a1-4725-8dfb-cb5e16b718f6 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:44:04.249129 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcafa28-e8a1-4725-8dfb-cb5e16b718f6 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:44:04.253892 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b02f9b-3498-4bca-8b3b-51041e8aa2e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:44:04.254554 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b02f9b-3498-4bca-8b3b-51041e8aa2e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:44:04.254841 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b02f9b-3498-4bca-8b3b-51041e8aa2e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:44:04.255120 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b02f9b-3498-4bca-8b3b-51041e8aa2e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:44:04.255886 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b02f9b-3498-4bca-8b3b-51041e8aa2e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:44:04.256199 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b02f9b-3498-4bca-8b3b-51041e8aa2e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:44:04.257814 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b02f9b-3498-4bca-8b3b-51041e8aa2e7 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:44:04.271139 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1128/2241] 10.222.0.86 () {58 vars in 1152 bytes} [Tue Jun 7 14:44:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:44:04.275473 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b73157f-01f2-4e9d-9312-a7eadb89ac7c None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:44:04.284981 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b73157f-01f2-4e9d-9312-a7eadb89ac7c None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:44:04.289694 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef0f88b-6cb3-4960-9523-1fc2b3039f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:44:04.290351 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef0f88b-6cb3-4960-9523-1fc2b3039f01 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:44:04.290635 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef0f88b-6cb3-4960-9523-1fc2b3039f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:44:04.290916 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef0f88b-6cb3-4960-9523-1fc2b3039f01 admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:44:04.291612 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef0f88b-6cb3-4960-9523-1fc2b3039f01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:44:04.293582 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef0f88b-6cb3-4960-9523-1fc2b3039f01 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:44:04.458571 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1114/2242] 10.222.0.86 () {60 vars in 1152 bytes} [Tue Jun 7 14:44:04 2022] POST /identity/v3/projects => generated 383 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:44:04.459131 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b02f9b-3498-4bca-8b3b-51041e8aa2e7 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:44:04.470364 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b02f9b-3498-4bca-8b3b-51041e8aa2e7 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:44:04.525772 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:44:04.536188 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa48f8d4-f177-4e72-a9ba-7dc2562a8507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:44:04.539622 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa48f8d4-f177-4e72-a9ba-7dc2562a8507 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:44:04.539622 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa48f8d4-f177-4e72-a9ba-7dc2562a8507 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:44:04.539622 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa48f8d4-f177-4e72-a9ba-7dc2562a8507 admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:44:04.539622 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa48f8d4-f177-4e72-a9ba-7dc2562a8507 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:44:04.540309 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa48f8d4-f177-4e72-a9ba-7dc2562a8507 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:44:04.684696 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef0f88b-6cb3-4960-9523-1fc2b3039f01 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:44:04.696334 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1129/2243] 10.222.0.86 () {60 vars in 1143 bytes} [Tue Jun 7 14:44:04 2022] POST /identity/v3/users => generated 292 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 14:44:04.738377 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef0f88b-6cb3-4960-9523-1fc2b3039f01 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:44:04.752528 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79278fe-0ab2-40de-b647-1c90a24fed5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:44:04.755396 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79278fe-0ab2-40de-b647-1c90a24fed5a admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:44:04.760460 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79278fe-0ab2-40de-b647-1c90a24fed5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:44:04.760460 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79278fe-0ab2-40de-b647-1c90a24fed5a admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:44:04.760460 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79278fe-0ab2-40de-b647-1c90a24fed5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:44:04.760460 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79278fe-0ab2-40de-b647-1c90a24fed5a admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:44:04.781385 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1115/2244] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:44:04 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:44:04.787068 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa48f8d4-f177-4e72-a9ba-7dc2562a8507 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:44:04.812267 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa48f8d4-f177-4e72-a9ba-7dc2562a8507 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:44:04.818351 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce05782-37dd-4490-b6f1-cb8e2cd78c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:44:04.819143 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce05782-37dd-4490-b6f1-cb8e2cd78c90 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:44:04.819959 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce05782-37dd-4490-b6f1-cb8e2cd78c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:44:04.820639 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce05782-37dd-4490-b6f1-cb8e2cd78c90 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:44:04.822216 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce05782-37dd-4490-b6f1-cb8e2cd78c90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:44:04.825993 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce05782-37dd-4490-b6f1-cb8e2cd78c90 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:44:04.840840 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1130/2245] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:44:04 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:44:04.845594 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79278fe-0ab2-40de-b647-1c90a24fed5a admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:44:04.859059 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79278fe-0ab2-40de-b647-1c90a24fed5a admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:44:04.875316 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36491907-08e4-4cf3-be78-ea3c9934a05f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:44:04.876343 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36491907-08e4-4cf3-be78-ea3c9934a05f admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:44:04.876697 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36491907-08e4-4cf3-be78-ea3c9934a05f admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:44:04.877080 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36491907-08e4-4cf3-be78-ea3c9934a05f admin admin] PATH_INFO: `/v3/projects/c364a26868b04cf784e7febabbccccb7/users/fe9a637e616b4e5b8927571b5b60ebb4/roles/c17acc2a8bb348f59ba7edd22fcf0c47` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:44:04.897820 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36491907-08e4-4cf3-be78-ea3c9934a05f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c364a26868b04cf784e7febabbccccb7, user_id=fe9a637e616b4e5b8927571b5b60ebb4, role_id=c17acc2a8bb348f59ba7edd22fcf0c47)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:44:04.900780 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36491907-08e4-4cf3-be78-ea3c9934a05f admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:44:04.969956 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1116/2246] 10.222.0.86 () {60 vars in 1482 bytes} [Tue Jun 7 14:44:04 2022] PUT /identity/v3/projects/c364a26868b04cf784e7febabbccccb7/users/fe9a637e616b4e5b8927571b5b60ebb4/roles/c17acc2a8bb348f59ba7edd22fcf0c47 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:44:04.981234 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84e3f4f-83c3-4de6-a8b8-4d469f873feb None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:44:04.981602 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84e3f4f-83c3-4de6-a8b8-4d469f873feb None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:44:04.981972 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84e3f4f-83c3-4de6-a8b8-4d469f873feb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:44:05.012749 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-f84e3f4f-83c3-4de6-a8b8-4d469f873feb None None] MFA Rules not processed for user `fe9a637e616b4e5b8927571b5b60ebb4`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:44:05.014083 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-f84e3f4f-83c3-4de6-a8b8-4d469f873feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:44:05.105736 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1131/2247] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:44:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:44:05.110197 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36491907-08e4-4cf3-be78-ea3c9934a05f admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:44:05.178856 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36491907-08e4-4cf3-be78-ea3c9934a05f admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:44:05.183935 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2619b9bf-042b-4936-a3ec-f36280d5ef6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:44:05.184899 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2619b9bf-042b-4936-a3ec-f36280d5ef6a admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:44:05.185198 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2619b9bf-042b-4936-a3ec-f36280d5ef6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:44:05.185480 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2619b9bf-042b-4936-a3ec-f36280d5ef6a admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:44:05.186165 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2619b9bf-042b-4936-a3ec-f36280d5ef6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:44:05.188097 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2619b9bf-042b-4936-a3ec-f36280d5ef6a admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:44:05.272056 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:44:05.283451 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1117/2248] 10.222.0.86 () {60 vars in 1152 bytes} [Tue Jun 7 14:44:05 2022] POST /identity/v3/projects => generated 385 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 14:44:05.284995 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84e3f4f-83c3-4de6-a8b8-4d469f873feb None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:44:05.297297 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84e3f4f-83c3-4de6-a8b8-4d469f873feb None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:44:05.383065 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa14a12-8425-4922-9f7a-e7efd9b1d30d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:44:05.384002 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa14a12-8425-4922-9f7a-e7efd9b1d30d admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:44:05.384356 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa14a12-8425-4922-9f7a-e7efd9b1d30d admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:44:05.384714 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa14a12-8425-4922-9f7a-e7efd9b1d30d admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:44:05.385507 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa14a12-8425-4922-9f7a-e7efd9b1d30d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:44:05.387511 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa14a12-8425-4922-9f7a-e7efd9b1d30d admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:44:05.466504 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2619b9bf-042b-4936-a3ec-f36280d5ef6a admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:44:05.472380 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1132/2249] 10.222.0.86 () {60 vars in 1143 bytes} [Tue Jun 7 14:44:05 2022] POST /identity/v3/users => generated 293 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:44:05.477916 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2619b9bf-042b-4936-a3ec-f36280d5ef6a admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:44:05.484367 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff81b3b7-00ab-45a2-a23f-ef0583ab97e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:44:05.485323 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff81b3b7-00ab-45a2-a23f-ef0583ab97e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:44:05.485837 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff81b3b7-00ab-45a2-a23f-ef0583ab97e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:44:05.486187 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff81b3b7-00ab-45a2-a23f-ef0583ab97e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:44:05.487226 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff81b3b7-00ab-45a2-a23f-ef0583ab97e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:44:05.488975 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff81b3b7-00ab-45a2-a23f-ef0583ab97e6 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:44:05.504944 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1118/2250] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:44:05 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:44:05.508004 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa14a12-8425-4922-9f7a-e7efd9b1d30d admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:44:05.521547 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa14a12-8425-4922-9f7a-e7efd9b1d30d admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:44:05.526826 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41b4db9-252d-4693-85b1-901c13191603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:44:05.527628 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41b4db9-252d-4693-85b1-901c13191603 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:44:05.527959 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41b4db9-252d-4693-85b1-901c13191603 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:44:05.528289 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41b4db9-252d-4693-85b1-901c13191603 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:44:05.529092 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41b4db9-252d-4693-85b1-901c13191603 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:44:05.530875 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41b4db9-252d-4693-85b1-901c13191603 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:44:05.542464 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1133/2251] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:44:05 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:44:05.546606 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff81b3b7-00ab-45a2-a23f-ef0583ab97e6 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:44:05.557105 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff81b3b7-00ab-45a2-a23f-ef0583ab97e6 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:44:05.563344 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d806ea8-8dd9-44d4-81ba-ff85b247c3e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:44:05.564349 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d806ea8-8dd9-44d4-81ba-ff85b247c3e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:44:05.565185 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d806ea8-8dd9-44d4-81ba-ff85b247c3e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:44:05.565659 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d806ea8-8dd9-44d4-81ba-ff85b247c3e7 admin admin] PATH_INFO: `/v3/projects/4abcf4a4bf744681aa940e30454edcf0/users/cd4c1562a3ed470bb80b602eae45bf1b/roles/c17acc2a8bb348f59ba7edd22fcf0c47` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:44:05.583184 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d806ea8-8dd9-44d4-81ba-ff85b247c3e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4abcf4a4bf744681aa940e30454edcf0, user_id=cd4c1562a3ed470bb80b602eae45bf1b, role_id=c17acc2a8bb348f59ba7edd22fcf0c47)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:44:05.586200 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d806ea8-8dd9-44d4-81ba-ff85b247c3e7 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:44:05.645701 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1119/2252] 10.222.0.86 () {60 vars in 1482 bytes} [Tue Jun 7 14:44:05 2022] PUT /identity/v3/projects/4abcf4a4bf744681aa940e30454edcf0/users/cd4c1562a3ed470bb80b602eae45bf1b/roles/c17acc2a8bb348f59ba7edd22fcf0c47 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:44:05.660461 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f27652-c8dc-43d4-b52b-99dd77b37ac9 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:44:05.661175 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f27652-c8dc-43d4-b52b-99dd77b37ac9 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:44:05.661693 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f27652-c8dc-43d4-b52b-99dd77b37ac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:44:05.692973 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-87f27652-c8dc-43d4-b52b-99dd77b37ac9 None None] MFA Rules not processed for user `cd4c1562a3ed470bb80b602eae45bf1b`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:44:05.693554 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-87f27652-c8dc-43d4-b52b-99dd77b37ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:44:05.735988 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:44:05.777174 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1134/2253] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:44:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:44:05.782983 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d806ea8-8dd9-44d4-81ba-ff85b247c3e7 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:44:05.848443 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d806ea8-8dd9-44d4-81ba-ff85b247c3e7 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:44:05.854562 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcb0715-aac9-4422-8120-e28e38520599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:44:05.855617 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcb0715-aac9-4422-8120-e28e38520599 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:44:05.856133 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcb0715-aac9-4422-8120-e28e38520599 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:44:05.856603 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcb0715-aac9-4422-8120-e28e38520599 admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:44:05.857347 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcb0715-aac9-4422-8120-e28e38520599 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:44:05.859221 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcb0715-aac9-4422-8120-e28e38520599 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:44:05.964797 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1120/2254] 10.222.0.86 () {60 vars in 1152 bytes} [Tue Jun 7 14:44:05 2022] POST /identity/v3/projects => generated 385 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:44:05.974238 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f27652-c8dc-43d4-b52b-99dd77b37ac9 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:44:05.986737 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f27652-c8dc-43d4-b52b-99dd77b37ac9 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:44:06.066059 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1e7dcc-b6a5-4a61-a817-117d0b959335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:44:06.068187 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1e7dcc-b6a5-4a61-a817-117d0b959335 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:44:06.068187 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1e7dcc-b6a5-4a61-a817-117d0b959335 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:44:06.068187 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1e7dcc-b6a5-4a61-a817-117d0b959335 admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:44:06.068856 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1e7dcc-b6a5-4a61-a817-117d0b959335 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:44:06.071023 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1e7dcc-b6a5-4a61-a817-117d0b959335 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:44:06.152086 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1135/2255] 10.222.0.86 () {60 vars in 1143 bytes} [Tue Jun 7 14:44:05 2022] POST /identity/v3/users => generated 299 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:44:06.157498 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcb0715-aac9-4422-8120-e28e38520599 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:44:06.172512 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcb0715-aac9-4422-8120-e28e38520599 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:44:06.182742 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd54ff3f-4fb1-4621-9105-f85ca15ba882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:44:06.182742 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd54ff3f-4fb1-4621-9105-f85ca15ba882 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:44:06.182742 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd54ff3f-4fb1-4621-9105-f85ca15ba882 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:44:06.182742 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd54ff3f-4fb1-4621-9105-f85ca15ba882 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:44:06.183157 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd54ff3f-4fb1-4621-9105-f85ca15ba882 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:44:06.187275 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd54ff3f-4fb1-4621-9105-f85ca15ba882 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:44:06.208298 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1121/2256] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:44:06 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:44:06.209842 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1e7dcc-b6a5-4a61-a817-117d0b959335 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:44:06.220844 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1e7dcc-b6a5-4a61-a817-117d0b959335 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:44:06.226789 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21f4d2c-07b5-4024-9c7a-71035e896c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:44:06.227973 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21f4d2c-07b5-4024-9c7a-71035e896c89 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:44:06.228337 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21f4d2c-07b5-4024-9c7a-71035e896c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:44:06.228822 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21f4d2c-07b5-4024-9c7a-71035e896c89 admin admin] PATH_INFO: `/v3/projects/54dd30d67d6b42ef9824bec4579a60b4/users/2f6ed7460cef42dda3b6b6bf5d37e79b/roles/e3bf6239f5bf477b965704b086786f11` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:44:06.250920 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21f4d2c-07b5-4024-9c7a-71035e896c89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54dd30d67d6b42ef9824bec4579a60b4, user_id=2f6ed7460cef42dda3b6b6bf5d37e79b, role_id=e3bf6239f5bf477b965704b086786f11)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:44:06.254215 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21f4d2c-07b5-4024-9c7a-71035e896c89 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:44:06.354823 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1136/2257] 10.222.0.86 () {60 vars in 1482 bytes} [Tue Jun 7 14:44:06 2022] PUT /identity/v3/projects/54dd30d67d6b42ef9824bec4579a60b4/users/2f6ed7460cef42dda3b6b6bf5d37e79b/roles/e3bf6239f5bf477b965704b086786f11 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:44:06.359733 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd54ff3f-4fb1-4621-9105-f85ca15ba882 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:44:06.373518 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd54ff3f-4fb1-4621-9105-f85ca15ba882 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:44:06.440268 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0687bcf-dae8-401f-9e45-522d0a011360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:44:06.441063 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0687bcf-dae8-401f-9e45-522d0a011360 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:44:06.441387 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0687bcf-dae8-401f-9e45-522d0a011360 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:44:06.441673 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0687bcf-dae8-401f-9e45-522d0a011360 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:44:06.442451 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0687bcf-dae8-401f-9e45-522d0a011360 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:44:06.444099 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0687bcf-dae8-401f-9e45-522d0a011360 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:44:06.456372 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1122/2258] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:44:06 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:44:06.461831 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21f4d2c-07b5-4024-9c7a-71035e896c89 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:44:06.474419 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21f4d2c-07b5-4024-9c7a-71035e896c89 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:44:06.481760 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fa28df-9b9a-40ad-b537-a4e02b61e518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:44:06.482887 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fa28df-9b9a-40ad-b537-a4e02b61e518 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:44:06.483288 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fa28df-9b9a-40ad-b537-a4e02b61e518 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:44:06.483686 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fa28df-9b9a-40ad-b537-a4e02b61e518 admin admin] PATH_INFO: `/v3/projects/54dd30d67d6b42ef9824bec4579a60b4/users/2f6ed7460cef42dda3b6b6bf5d37e79b/roles/e3bf6239f5bf477b965704b086786f11` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:44:06.487127 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fa28df-9b9a-40ad-b537-a4e02b61e518 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54dd30d67d6b42ef9824bec4579a60b4, user_id=2f6ed7460cef42dda3b6b6bf5d37e79b, role_id=e3bf6239f5bf477b965704b086786f11)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:44:06.490025 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fa28df-9b9a-40ad-b537-a4e02b61e518 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:44:06.505541 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1137/2259] 10.222.0.86 () {60 vars in 1482 bytes} [Tue Jun 7 14:44:06 2022] PUT /identity/v3/projects/54dd30d67d6b42ef9824bec4579a60b4/users/2f6ed7460cef42dda3b6b6bf5d37e79b/roles/e3bf6239f5bf477b965704b086786f11 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 14:44:06.518398 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac16bd9-6bee-4e61-a75e-452b43a3b939 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:44:06.518809 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac16bd9-6bee-4e61-a75e-452b43a3b939 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:44:06.519163 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac16bd9-6bee-4e61-a75e-452b43a3b939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:44:06.553951 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-4ac16bd9-6bee-4e61-a75e-452b43a3b939 None None] MFA Rules not processed for user `2f6ed7460cef42dda3b6b6bf5d37e79b`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:44:06.556093 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-4ac16bd9-6bee-4e61-a75e-452b43a3b939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:44:06.584245 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:44:06.652744 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1123/2260] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:44:06 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:44:06.666038 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fa28df-9b9a-40ad-b537-a4e02b61e518 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:44:06.667837 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-a4fa28df-9b9a-40ad-b537-a4e02b61e518 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:44:06.774031 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fa28df-9b9a-40ad-b537-a4e02b61e518 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:44:06.786011 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09327d08-94ef-4a12-9b5f-0ac0abc391b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af5a95620a4b43538abfe09eed4bf115', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:44:06.787029 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09327d08-94ef-4a12-9b5f-0ac0abc391b6 service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:44:06.787427 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09327d08-94ef-4a12-9b5f-0ac0abc391b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:44:06.787999 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09327d08-94ef-4a12-9b5f-0ac0abc391b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:44:06.858328 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:44:06.903613 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09327d08-94ef-4a12-9b5f-0ac0abc391b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:44:06.907582 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09327d08-94ef-4a12-9b5f-0ac0abc391b6 service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:44:06.923569 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1138/2261] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:44:06 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:44:09.245410 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db8b7f3-e118-4075-a206-f90e62398f51 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:44:09.245972 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db8b7f3-e118-4075-a206-f90e62398f51 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:44:09.245972 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db8b7f3-e118-4075-a206-f90e62398f51 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:44:09.247538 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1124/2262] 10.222.0.86 () {54 vars in 921 bytes} [Tue Jun 7 14:44:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:44:09.254143 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f46034d-819a-4475-9278-297fcda7d88c None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:44:09.254620 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f46034d-819a-4475-9278-297fcda7d88c None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:44:09.254734 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f46034d-819a-4475-9278-297fcda7d88c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:44:09.310206 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-1f46034d-819a-4475-9278-297fcda7d88c None None] MFA Rules not processed for user `b99cfb70f54c45c8870369359da20378`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:44:09.311426 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-1f46034d-819a-4475-9278-297fcda7d88c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:44:09.386398 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1139/2263] 10.222.0.86 () {58 vars in 1018 bytes} [Tue Jun 7 14:44:09 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:44:09.399235 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db8b7f3-e118-4075-a206-f90e62398f51 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:44:09.401017 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-4db8b7f3-e118-4075-a206-f90e62398f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:44:09.478357 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db8b7f3-e118-4075-a206-f90e62398f51 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:44:09.481918 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d616a5-f9fb-4b51-86e1-0d6a4e8f7bf2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b910435e5585436996ba5b5aeb7184bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:44:09.482567 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d616a5-f9fb-4b51-86e1-0d6a4e8f7bf2 service glance] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:44:09.482848 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d616a5-f9fb-4b51-86e1-0d6a4e8f7bf2 service glance] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:44:09.483131 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d616a5-f9fb-4b51-86e1-0d6a4e8f7bf2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:44:09.493717 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d616a5-f9fb-4b51-86e1-0d6a4e8f7bf2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:44:09.495138 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d616a5-f9fb-4b51-86e1-0d6a4e8f7bf2 service glance] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:44:09.506269 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1125/2264] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:44:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:44:09.717841 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3a0493-dffe-41cf-9592-b99c0e89ba24 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:44:09.718064 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3a0493-dffe-41cf-9592-b99c0e89ba24 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:44:09.718355 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3a0493-dffe-41cf-9592-b99c0e89ba24 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:44:09.719822 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1140/2265] 10.222.0.86 () {54 vars in 921 bytes} [Tue Jun 7 14:44:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:44:09.724896 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac3b678-7ff5-4491-93bf-2a94bbb84547 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:44:09.725191 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac3b678-7ff5-4491-93bf-2a94bbb84547 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:44:09.725476 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac3b678-7ff5-4491-93bf-2a94bbb84547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:44:09.744242 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-dac3b678-7ff5-4491-93bf-2a94bbb84547 None None] MFA Rules not processed for user `dda603ec5517460a83c333db2af804d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:44:09.745445 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-dac3b678-7ff5-4491-93bf-2a94bbb84547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:44:09.796144 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1126/2266] 10.222.0.86 () {58 vars in 1018 bytes} [Tue Jun 7 14:44:09 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:44:09.808320 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3a0493-dffe-41cf-9592-b99c0e89ba24 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:44:09.810047 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-5d3a0493-dffe-41cf-9592-b99c0e89ba24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:44:09.823110 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3a0493-dffe-41cf-9592-b99c0e89ba24 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:44:09.826660 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89453926-f34b-4f70-9209-c31f7925c2ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dda603ec5517460a83c333db2af804d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:44:09.827288 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89453926-f34b-4f70-9209-c31f7925c2ab service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:44:09.827573 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89453926-f34b-4f70-9209-c31f7925c2ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:44:09.827888 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89453926-f34b-4f70-9209-c31f7925c2ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:44:09.835020 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89453926-f34b-4f70-9209-c31f7925c2ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:44:09.836475 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89453926-f34b-4f70-9209-c31f7925c2ab service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:44:09.844320 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1141/2267] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:44:09 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:44:09.931780 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60312ea-1abe-4806-822d-af6ff792f49f None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:44:09.932207 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60312ea-1abe-4806-822d-af6ff792f49f None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:44:09.932571 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60312ea-1abe-4806-822d-af6ff792f49f None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:44:09.934038 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1127/2268] 10.222.0.86 () {54 vars in 921 bytes} [Tue Jun 7 14:44:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:44:09.940084 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb76fc8-721b-45a6-8a85-e25fbbe2db6d None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:44:09.940517 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb76fc8-721b-45a6-8a85-e25fbbe2db6d None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:44:09.940920 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb76fc8-721b-45a6-8a85-e25fbbe2db6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:44:09.954468 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e40177-2c1e-401e-a7b0-a242dd5a6560 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:44:09.954760 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e40177-2c1e-401e-a7b0-a242dd5a6560 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:44:09.955088 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e40177-2c1e-401e-a7b0-a242dd5a6560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:44:09.962351 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-cfb76fc8-721b-45a6-8a85-e25fbbe2db6d None None] MFA Rules not processed for user `b99cfb70f54c45c8870369359da20378`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:44:09.963585 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-cfb76fc8-721b-45a6-8a85-e25fbbe2db6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:44:09.974038 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1142/2269] 10.222.0.86 () {58 vars in 1018 bytes} [Tue Jun 7 14:44:09 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:44:09.985746 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-61e40177-2c1e-401e-a7b0-a242dd5a6560 None None] MFA Rules not processed for user `d7b598c6a3f642ef9edc971ad3ebbe31`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:44:09.985746 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-61e40177-2c1e-401e-a7b0-a242dd5a6560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:44:09.987074 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb76fc8-721b-45a6-8a85-e25fbbe2db6d None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:44:09.994558 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb76fc8-721b-45a6-8a85-e25fbbe2db6d None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:44:09.999438 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f8e845-9c78-47f1-a055-d3e8285480ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dda603ec5517460a83c333db2af804d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:44:10.000631 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f8e845-9c78-47f1-a055-d3e8285480ef service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:44:10.000994 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f8e845-9c78-47f1-a055-d3e8285480ef service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:44:10.001345 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f8e845-9c78-47f1-a055-d3e8285480ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:44:10.013917 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f8e845-9c78-47f1-a055-d3e8285480ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:44:10.017261 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f8e845-9c78-47f1-a055-d3e8285480ef service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:44:10.027746 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1143/2270] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:44:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:44:10.033932 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:44:10.045267 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1128/2271] 10.222.0.86 () {58 vars in 967 bytes} [Tue Jun 7 14:44:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 14:44:10.058613 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f8e845-9c78-47f1-a055-d3e8285480ef service neutron] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:44:10.060126 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-10f8e845-9c78-47f1-a055-d3e8285480ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:44:10.133138 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:44:10.138004 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f8e845-9c78-47f1-a055-d3e8285480ef service neutron] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:44:10.145018 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3b478c-64b3-4aec-8d18-870566261af3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9774349dd2b4ec092ef04c3df050a7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:44:10.145682 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3b478c-64b3-4aec-8d18-870566261af3 service swift] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:44:10.145962 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3b478c-64b3-4aec-8d18-870566261af3 service swift] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:44:10.146244 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3b478c-64b3-4aec-8d18-870566261af3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:44:10.159635 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3b478c-64b3-4aec-8d18-870566261af3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:44:10.161344 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3b478c-64b3-4aec-8d18-870566261af3 service swift] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:44:10.178445 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1144/2272] 10.222.0.86 () {60 vars in 1384 bytes} [Tue Jun 7 14:44:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 07 14:44:10.212581 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e40177-2c1e-401e-a7b0-a242dd5a6560 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:44:10.214225 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-61e40177-2c1e-401e-a7b0-a242dd5a6560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:44:10.227587 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e40177-2c1e-401e-a7b0-a242dd5a6560 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:44:10.231373 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f96f6c-9149-42f4-9e73-3303fc3e1bc0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af5a95620a4b43538abfe09eed4bf115', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:44:10.232156 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f96f6c-9149-42f4-9e73-3303fc3e1bc0 service cinder] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:44:10.232526 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f96f6c-9149-42f4-9e73-3303fc3e1bc0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:44:10.233226 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f96f6c-9149-42f4-9e73-3303fc3e1bc0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:44:10.292700 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f96f6c-9149-42f4-9e73-3303fc3e1bc0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:44:10.294149 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f96f6c-9149-42f4-9e73-3303fc3e1bc0 service cinder] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:44:10.303297 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1129/2273] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:44:10 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:44:12.177849 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3b478c-64b3-4aec-8d18-870566261af3 service swift] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:44:12.187029 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3b478c-64b3-4aec-8d18-870566261af3 service swift] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:44:12.191540 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe50b47-81e4-4820-a5e3-8cc3ce5d18c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af5a95620a4b43538abfe09eed4bf115', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:44:12.192277 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe50b47-81e4-4820-a5e3-8cc3ce5d18c0 service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:44:12.192563 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe50b47-81e4-4820-a5e3-8cc3ce5d18c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:44:12.192843 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe50b47-81e4-4820-a5e3-8cc3ce5d18c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:44:12.205638 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe50b47-81e4-4820-a5e3-8cc3ce5d18c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:44:12.205638 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe50b47-81e4-4820-a5e3-8cc3ce5d18c0 service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:44:12.214099 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1145/2274] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:44:12 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:44:13.926043 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f96f6c-9149-42f4-9e73-3303fc3e1bc0 service cinder] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:44:13.928232 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-e6f96f6c-9149-42f4-9e73-3303fc3e1bc0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:44:14.008815 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f96f6c-9149-42f4-9e73-3303fc3e1bc0 service cinder] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:44:14.020804 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958c4521-f514-4f87-8331-3ff3dd1fad03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:44:14.021875 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958c4521-f514-4f87-8331-3ff3dd1fad03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:44:14.022347 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958c4521-f514-4f87-8331-3ff3dd1fad03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:44:14.022684 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958c4521-f514-4f87-8331-3ff3dd1fad03 admin admin] PATH_INFO: `/v3/users/ace5be0026ab4c85932d358fcbcbf35e` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:44:14.023956 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958c4521-f514-4f87-8331-3ff3dd1fad03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ace5be0026ab4c85932d358fcbcbf35e)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:44:14.025860 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958c4521-f514-4f87-8331-3ff3dd1fad03 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:44:14.080123 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763455e3-fcd9-42b0-8199-2aaf65e5edd9 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:44:14.080613 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763455e3-fcd9-42b0-8199-2aaf65e5edd9 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:44:14.080707 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763455e3-fcd9-42b0-8199-2aaf65e5edd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:44:14.097881 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-763455e3-fcd9-42b0-8199-2aaf65e5edd9 None None] MFA Rules not processed for user `d7b598c6a3f642ef9edc971ad3ebbe31`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:44:14.099071 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-763455e3-fcd9-42b0-8199-2aaf65e5edd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:44:14.106189 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1146/2275] 10.222.0.86 () {58 vars in 1009 bytes} [Tue Jun 7 14:44:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 14:44:14.118584 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763455e3-fcd9-42b0-8199-2aaf65e5edd9 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:44:14.131059 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763455e3-fcd9-42b0-8199-2aaf65e5edd9 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:44:14.136337 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad33979-6d9a-4604-83ce-efb3dc107719 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9774349dd2b4ec092ef04c3df050a7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:44:14.137000 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad33979-6d9a-4604-83ce-efb3dc107719 service swift] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:44:14.137303 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad33979-6d9a-4604-83ce-efb3dc107719 service swift] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:44:14.137575 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad33979-6d9a-4604-83ce-efb3dc107719 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:44:14.146359 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad33979-6d9a-4604-83ce-efb3dc107719 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:44:14.147961 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad33979-6d9a-4604-83ce-efb3dc107719 service swift] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:44:14.157088 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1147/2276] 10.222.0.86 () {60 vars in 1384 bytes} [Tue Jun 7 14:44:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 07 14:44:14.341602 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-958c4521-f514-4f87-8331-3ff3dd1fad03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ace5be0026ab4c85932d358fcbcbf35e'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:44:14.348914 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-958c4521-f514-4f87-8331-3ff3dd1fad03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ace5be0026ab4c85932d358fcbcbf35e'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:44:14.349576 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-958c4521-f514-4f87-8331-3ff3dd1fad03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ace5be0026ab4c85932d358fcbcbf35e'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:44:14.361876 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-958c4521-f514-4f87-8331-3ff3dd1fad03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ace5be0026ab4c85932d358fcbcbf35e'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:44:14.362470 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-958c4521-f514-4f87-8331-3ff3dd1fad03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ace5be0026ab4c85932d358fcbcbf35e'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:44:14.647839 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1130/2277] 10.222.0.86 () {58 vars in 1223 bytes} [Tue Jun 7 14:44:13 2022] DELETE /identity/v3/users/ace5be0026ab4c85932d358fcbcbf35e => generated 0 bytes in 723 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:44:14.928668 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad33979-6d9a-4604-83ce-efb3dc107719 service swift] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:44:14.961942 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad33979-6d9a-4604-83ce-efb3dc107719 service swift] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:44:15.047902 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f85a65-7b0a-44f7-8d1f-6ca275661613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:44:15.055895 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f85a65-7b0a-44f7-8d1f-6ca275661613 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:44:15.056383 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f85a65-7b0a-44f7-8d1f-6ca275661613 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:44:15.057392 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f85a65-7b0a-44f7-8d1f-6ca275661613 admin admin] PATH_INFO: `/v3/projects/d17b6f38f85143ff93d2e5dc7d4fac54` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:44:15.058693 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f85a65-7b0a-44f7-8d1f-6ca275661613 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d17b6f38f85143ff93d2e5dc7d4fac54)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:44:15.060672 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f85a65-7b0a-44f7-8d1f-6ca275661613 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:44:15.234795 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-09f85a65-7b0a-44f7-8d1f-6ca275661613 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd17b6f38f85143ff93d2e5dc7d4fac54', 'request_id': 'req-09f85a65-7b0a-44f7-8d1f-6ca275661613'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:44:15.242025 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-09f85a65-7b0a-44f7-8d1f-6ca275661613 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd17b6f38f85143ff93d2e5dc7d4fac54', 'request_id': 'req-09f85a65-7b0a-44f7-8d1f-6ca275661613'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:44:15.345812 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-09f85a65-7b0a-44f7-8d1f-6ca275661613 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd17b6f38f85143ff93d2e5dc7d4fac54', 'request_id': 'req-09f85a65-7b0a-44f7-8d1f-6ca275661613'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:44:15.357766 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-09f85a65-7b0a-44f7-8d1f-6ca275661613 admin admin] The token cache is being invalidate because project d17b6f38f85143ff93d2e5dc7d4fac54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:44:15.358165 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-09f85a65-7b0a-44f7-8d1f-6ca275661613 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:44:15.358829 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-09f85a65-7b0a-44f7-8d1f-6ca275661613 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:44:15.360937 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1148/2278] 10.222.0.86 () {58 vars in 1232 bytes} [Tue Jun 7 14:44:14 2022] DELETE /identity/v3/projects/d17b6f38f85143ff93d2e5dc7d4fac54 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:44:15.367185 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5519c91-dcb4-4817-82b3-fa5553328a1d None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:44:15.367678 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5519c91-dcb4-4817-82b3-fa5553328a1d None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:44:15.367906 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5519c91-dcb4-4817-82b3-fa5553328a1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:44:15.387365 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-e5519c91-dcb4-4817-82b3-fa5553328a1d None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:44:15.388902 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-e5519c91-dcb4-4817-82b3-fa5553328a1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:44:15.399313 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:44:15.450818 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1131/2279] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:44:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:44:15.458339 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017ede0b-1b0e-4738-8da1-ca7f4e67a0f5 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:44:15.458653 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017ede0b-1b0e-4738-8da1-ca7f4e67a0f5 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:44:15.458936 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017ede0b-1b0e-4738-8da1-ca7f4e67a0f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:44:15.478490 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-017ede0b-1b0e-4738-8da1-ca7f4e67a0f5 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:44:15.479620 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-017ede0b-1b0e-4738-8da1-ca7f4e67a0f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:44:15.488253 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1149/2280] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:44:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:44:15.492337 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5519c91-dcb4-4817-82b3-fa5553328a1d None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:44:15.502966 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5519c91-dcb4-4817-82b3-fa5553328a1d None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:44:15.508167 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6c0891-bede-4914-8e47-f4c16b848f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:44:15.508905 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6c0891-bede-4914-8e47-f4c16b848f29 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:44:15.509202 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6c0891-bede-4914-8e47-f4c16b848f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:44:15.510725 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6c0891-bede-4914-8e47-f4c16b848f29 admin admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:44:15.510725 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6c0891-bede-4914-8e47-f4c16b848f29 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:44:15.510725 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6c0891-bede-4914-8e47-f4c16b848f29 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:44:15.512300 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6c0891-bede-4914-8e47-f4c16b848f29 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:44:15.525108 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1132/2281] 10.222.0.86 () {58 vars in 1152 bytes} [Tue Jun 7 14:44:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:44:15.529547 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017ede0b-1b0e-4738-8da1-ca7f4e67a0f5 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:44:15.539468 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017ede0b-1b0e-4738-8da1-ca7f4e67a0f5 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:44:15.545183 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b603e4ef-bce1-4dab-b494-666cf7771b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:44:15.546027 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b603e4ef-bce1-4dab-b494-666cf7771b8c admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:44:15.546323 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b603e4ef-bce1-4dab-b494-666cf7771b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:44:15.546604 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b603e4ef-bce1-4dab-b494-666cf7771b8c admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:44:15.547362 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b603e4ef-bce1-4dab-b494-666cf7771b8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:44:15.550057 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b603e4ef-bce1-4dab-b494-666cf7771b8c admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:44:15.645013 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1150/2282] 10.222.0.86 () {60 vars in 1152 bytes} [Tue Jun 7 14:44:15 2022] POST /identity/v3/projects => generated 383 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:44:15.649560 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6c0891-bede-4914-8e47-f4c16b848f29 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:44:15.662684 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6c0891-bede-4914-8e47-f4c16b848f29 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:44:15.720993 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0185d7-3b71-4883-bf62-6bb2ec5e2075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:44:15.721811 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0185d7-3b71-4883-bf62-6bb2ec5e2075 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:44:15.722172 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0185d7-3b71-4883-bf62-6bb2ec5e2075 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:44:15.722582 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0185d7-3b71-4883-bf62-6bb2ec5e2075 admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:44:15.723380 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0185d7-3b71-4883-bf62-6bb2ec5e2075 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:44:15.725411 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0185d7-3b71-4883-bf62-6bb2ec5e2075 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:44:15.825669 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1133/2283] 10.222.0.86 () {60 vars in 1143 bytes} [Tue Jun 7 14:44:15 2022] POST /identity/v3/users => generated 292 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:44:15.830592 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b603e4ef-bce1-4dab-b494-666cf7771b8c admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:44:15.841563 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b603e4ef-bce1-4dab-b494-666cf7771b8c admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:44:15.846210 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd63207-6e77-4597-b883-8060ff4f930a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:44:15.846992 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd63207-6e77-4597-b883-8060ff4f930a admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:44:15.847283 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd63207-6e77-4597-b883-8060ff4f930a admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:44:15.847566 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd63207-6e77-4597-b883-8060ff4f930a admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:44:15.848456 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd63207-6e77-4597-b883-8060ff4f930a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:44:15.850056 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd63207-6e77-4597-b883-8060ff4f930a admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:44:15.860963 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1151/2284] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:44:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:44:15.865492 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0185d7-3b71-4883-bf62-6bb2ec5e2075 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:44:15.875724 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0185d7-3b71-4883-bf62-6bb2ec5e2075 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:44:15.881032 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e72cad6-b23b-4982-a503-b1e0e84b6e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:44:15.881694 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e72cad6-b23b-4982-a503-b1e0e84b6e30 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:44:15.881977 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e72cad6-b23b-4982-a503-b1e0e84b6e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:44:15.882365 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e72cad6-b23b-4982-a503-b1e0e84b6e30 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:44:15.883167 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e72cad6-b23b-4982-a503-b1e0e84b6e30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:44:15.884803 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e72cad6-b23b-4982-a503-b1e0e84b6e30 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:44:15.896535 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1134/2285] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:44:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:44:15.900734 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd63207-6e77-4597-b883-8060ff4f930a admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:44:15.911327 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd63207-6e77-4597-b883-8060ff4f930a admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:44:15.915978 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3f5189-24e5-4bc2-8c85-c3287878d9ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:44:15.917058 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3f5189-24e5-4bc2-8c85-c3287878d9ba admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:44:15.917342 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3f5189-24e5-4bc2-8c85-c3287878d9ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:44:15.917620 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3f5189-24e5-4bc2-8c85-c3287878d9ba admin admin] PATH_INFO: `/v3/projects/6e03e26e1310487f8d02dca053e5138d/users/5a0ee23baf5d43538190e437545038f5/roles/c17acc2a8bb348f59ba7edd22fcf0c47` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:44:15.922149 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:44:15.934348 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3f5189-24e5-4bc2-8c85-c3287878d9ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e03e26e1310487f8d02dca053e5138d, user_id=5a0ee23baf5d43538190e437545038f5, role_id=c17acc2a8bb348f59ba7edd22fcf0c47)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:44:15.937089 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3f5189-24e5-4bc2-8c85-c3287878d9ba admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:44:16.049427 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1152/2286] 10.222.0.86 () {60 vars in 1482 bytes} [Tue Jun 7 14:44:15 2022] PUT /identity/v3/projects/6e03e26e1310487f8d02dca053e5138d/users/5a0ee23baf5d43538190e437545038f5/roles/c17acc2a8bb348f59ba7edd22fcf0c47 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:44:16.054491 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746358c7-f23c-4bbb-b6d0-339d1b7d2f53 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:44:16.054816 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746358c7-f23c-4bbb-b6d0-339d1b7d2f53 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:44:16.055094 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746358c7-f23c-4bbb-b6d0-339d1b7d2f53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:44:16.073160 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-746358c7-f23c-4bbb-b6d0-339d1b7d2f53 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:44:16.074396 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-746358c7-f23c-4bbb-b6d0-339d1b7d2f53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:44:16.134577 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1135/2287] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:44:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:44:16.145715 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3f5189-24e5-4bc2-8c85-c3287878d9ba admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:44:16.147680 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-ee3f5189-24e5-4bc2-8c85-c3287878d9ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:44:16.207282 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3f5189-24e5-4bc2-8c85-c3287878d9ba admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:44:16.211298 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325a4025-0c78-433e-a4b8-5d289431fb72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dda603ec5517460a83c333db2af804d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:44:16.212129 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325a4025-0c78-433e-a4b8-5d289431fb72 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:44:16.212415 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325a4025-0c78-433e-a4b8-5d289431fb72 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:44:16.212694 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325a4025-0c78-433e-a4b8-5d289431fb72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:44:16.223196 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325a4025-0c78-433e-a4b8-5d289431fb72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:44:16.224764 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325a4025-0c78-433e-a4b8-5d289431fb72 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:44:16.235610 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1153/2288] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:44:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:44:18.064748 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746358c7-f23c-4bbb-b6d0-339d1b7d2f53 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:44:18.069207 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-746358c7-f23c-4bbb-b6d0-339d1b7d2f53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:44:18.080508 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746358c7-f23c-4bbb-b6d0-339d1b7d2f53 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:44:18.098743 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3a3a70-3771-4587-8626-bac35af4ea26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:44:18.100010 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3a3a70-3771-4587-8626-bac35af4ea26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:44:18.100406 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3a3a70-3771-4587-8626-bac35af4ea26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:44:18.100791 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3a3a70-3771-4587-8626-bac35af4ea26 admin admin] PATH_INFO: `/v3/users/fe9a637e616b4e5b8927571b5b60ebb4` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:44:18.102201 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3a3a70-3771-4587-8626-bac35af4ea26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe9a637e616b4e5b8927571b5b60ebb4)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:44:18.104597 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3a3a70-3771-4587-8626-bac35af4ea26 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:44:18.136303 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:44:18.395485 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-4c3a3a70-3771-4587-8626-bac35af4ea26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe9a637e616b4e5b8927571b5b60ebb4'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:44:18.421060 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-4c3a3a70-3771-4587-8626-bac35af4ea26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe9a637e616b4e5b8927571b5b60ebb4'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:44:18.421818 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-4c3a3a70-3771-4587-8626-bac35af4ea26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe9a637e616b4e5b8927571b5b60ebb4'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:44:18.464831 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-4c3a3a70-3771-4587-8626-bac35af4ea26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe9a637e616b4e5b8927571b5b60ebb4'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:44:18.470298 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-4c3a3a70-3771-4587-8626-bac35af4ea26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe9a637e616b4e5b8927571b5b60ebb4'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:44:18.577578 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1136/2289] 10.222.0.86 () {58 vars in 1223 bytes} [Tue Jun 7 14:44:18 2022] DELETE /identity/v3/users/fe9a637e616b4e5b8927571b5b60ebb4 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:44:18.582256 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cd4e75-f71a-4870-899b-0d10ead412e6 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:44:18.583533 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cd4e75-f71a-4870-899b-0d10ead412e6 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:44:18.583533 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cd4e75-f71a-4870-899b-0d10ead412e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:44:18.605953 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-d9cd4e75-f71a-4870-899b-0d10ead412e6 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:44:18.607190 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-d9cd4e75-f71a-4870-899b-0d10ead412e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:44:18.686605 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1154/2290] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:44:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:44:18.705433 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3a3a70-3771-4587-8626-bac35af4ea26 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:44:18.709469 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-4c3a3a70-3771-4587-8626-bac35af4ea26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:44:18.828210 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3a3a70-3771-4587-8626-bac35af4ea26 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:44:18.839680 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb37b7a-0580-4a5b-ad80-22629cc38f66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dda603ec5517460a83c333db2af804d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:44:18.840670 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb37b7a-0580-4a5b-ad80-22629cc38f66 service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:44:18.841241 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb37b7a-0580-4a5b-ad80-22629cc38f66 service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:44:18.841665 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb37b7a-0580-4a5b-ad80-22629cc38f66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:44:18.858506 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb37b7a-0580-4a5b-ad80-22629cc38f66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:44:18.860392 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb37b7a-0580-4a5b-ad80-22629cc38f66 service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:44:18.894906 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1137/2291] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:44:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:44:19.444652 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cd4e75-f71a-4870-899b-0d10ead412e6 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:44:19.447624 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-d9cd4e75-f71a-4870-899b-0d10ead412e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:44:19.463273 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cd4e75-f71a-4870-899b-0d10ead412e6 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:44:19.491547 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e66ccdf-58ab-47ac-b944-85a9107f8b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:44:19.492999 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e66ccdf-58ab-47ac-b944-85a9107f8b40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:44:19.493294 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e66ccdf-58ab-47ac-b944-85a9107f8b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:44:19.496898 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e66ccdf-58ab-47ac-b944-85a9107f8b40 admin admin] PATH_INFO: `/v3/projects/c364a26868b04cf784e7febabbccccb7` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:44:19.498618 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e66ccdf-58ab-47ac-b944-85a9107f8b40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c364a26868b04cf784e7febabbccccb7)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:44:19.500484 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e66ccdf-58ab-47ac-b944-85a9107f8b40 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:44:20.558391 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-6e66ccdf-58ab-47ac-b944-85a9107f8b40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c364a26868b04cf784e7febabbccccb7', 'request_id': 'req-6e66ccdf-58ab-47ac-b944-85a9107f8b40'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:44:20.566805 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-6e66ccdf-58ab-47ac-b944-85a9107f8b40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c364a26868b04cf784e7febabbccccb7', 'request_id': 'req-6e66ccdf-58ab-47ac-b944-85a9107f8b40'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:44:20.659573 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-6e66ccdf-58ab-47ac-b944-85a9107f8b40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c364a26868b04cf784e7febabbccccb7', 'request_id': 'req-6e66ccdf-58ab-47ac-b944-85a9107f8b40'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:44:20.672597 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-6e66ccdf-58ab-47ac-b944-85a9107f8b40 admin admin] The token cache is being invalidate because project c364a26868b04cf784e7febabbccccb7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:44:20.675691 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-6e66ccdf-58ab-47ac-b944-85a9107f8b40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:44:20.675691 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-6e66ccdf-58ab-47ac-b944-85a9107f8b40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:44:20.676489 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1155/2292] 10.222.0.86 () {58 vars in 1232 bytes} [Tue Jun 7 14:44:19 2022] DELETE /identity/v3/projects/c364a26868b04cf784e7febabbccccb7 => generated 0 bytes in 1232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:44:20.680122 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb37b7a-0580-4a5b-ad80-22629cc38f66 service neutron] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:44:20.699493 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb37b7a-0580-4a5b-ad80-22629cc38f66 service neutron] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:44:20.775541 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f119f77-f524-4c14-bea2-a1ec9e1ccb29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:44:20.776517 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f119f77-f524-4c14-bea2-a1ec9e1ccb29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:44:20.777218 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f119f77-f524-4c14-bea2-a1ec9e1ccb29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:44:20.777218 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f119f77-f524-4c14-bea2-a1ec9e1ccb29 admin admin] PATH_INFO: `/v3/users/cd4c1562a3ed470bb80b602eae45bf1b` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:44:20.778445 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f119f77-f524-4c14-bea2-a1ec9e1ccb29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd4c1562a3ed470bb80b602eae45bf1b)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:44:20.780353 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f119f77-f524-4c14-bea2-a1ec9e1ccb29 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:44:20.985628 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:44:20.995971 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-9f119f77-f524-4c14-bea2-a1ec9e1ccb29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd4c1562a3ed470bb80b602eae45bf1b'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:44:21.004839 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-9f119f77-f524-4c14-bea2-a1ec9e1ccb29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd4c1562a3ed470bb80b602eae45bf1b'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:44:21.010424 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-9f119f77-f524-4c14-bea2-a1ec9e1ccb29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd4c1562a3ed470bb80b602eae45bf1b'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:44:21.041524 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-9f119f77-f524-4c14-bea2-a1ec9e1ccb29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd4c1562a3ed470bb80b602eae45bf1b'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:44:21.042269 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-9f119f77-f524-4c14-bea2-a1ec9e1ccb29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd4c1562a3ed470bb80b602eae45bf1b'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:44:21.122510 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1138/2293] 10.222.0.86 () {58 vars in 1223 bytes} [Tue Jun 7 14:44:20 2022] DELETE /identity/v3/users/cd4c1562a3ed470bb80b602eae45bf1b => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:44:21.782183 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e66ccdf-58ab-47ac-b944-85a9107f8b40 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:44:21.784899 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-6e66ccdf-58ab-47ac-b944-85a9107f8b40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:44:21.809582 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e66ccdf-58ab-47ac-b944-85a9107f8b40 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:44:21.838426 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:44:21.917300 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff186c5-a6f8-44be-9310-279cdb90becb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:44:21.919909 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff186c5-a6f8-44be-9310-279cdb90becb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:44:21.920397 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff186c5-a6f8-44be-9310-279cdb90becb admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:44:21.920835 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff186c5-a6f8-44be-9310-279cdb90becb admin admin] PATH_INFO: `/v3/projects/4abcf4a4bf744681aa940e30454edcf0` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:44:21.923284 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff186c5-a6f8-44be-9310-279cdb90becb admin admin] RBAC: Authorizing `identity:delete_project(project_id=4abcf4a4bf744681aa940e30454edcf0)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:44:21.926076 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff186c5-a6f8-44be-9310-279cdb90becb admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:44:22.102474 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-5ff186c5-a6f8-44be-9310-279cdb90becb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4abcf4a4bf744681aa940e30454edcf0', 'request_id': 'req-5ff186c5-a6f8-44be-9310-279cdb90becb'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:44:22.114664 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-5ff186c5-a6f8-44be-9310-279cdb90becb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4abcf4a4bf744681aa940e30454edcf0', 'request_id': 'req-5ff186c5-a6f8-44be-9310-279cdb90becb'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:44:22.208098 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-5ff186c5-a6f8-44be-9310-279cdb90becb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4abcf4a4bf744681aa940e30454edcf0', 'request_id': 'req-5ff186c5-a6f8-44be-9310-279cdb90becb'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:44:22.219946 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-5ff186c5-a6f8-44be-9310-279cdb90becb admin admin] The token cache is being invalidate because project 4abcf4a4bf744681aa940e30454edcf0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:44:22.220751 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-5ff186c5-a6f8-44be-9310-279cdb90becb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:44:22.221412 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-5ff186c5-a6f8-44be-9310-279cdb90becb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:44:22.222966 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1156/2294] 10.222.0.86 () {58 vars in 1232 bytes} [Tue Jun 7 14:44:21 2022] DELETE /identity/v3/projects/4abcf4a4bf744681aa940e30454edcf0 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:44:22.227148 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f119f77-f524-4c14-bea2-a1ec9e1ccb29 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:44:22.228895 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-9f119f77-f524-4c14-bea2-a1ec9e1ccb29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:44:22.253594 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f119f77-f524-4c14-bea2-a1ec9e1ccb29 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:44:22.349519 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f599a0-9feb-4734-9d31-f1ca848655bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:44:22.350440 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f599a0-9feb-4734-9d31-f1ca848655bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:44:22.350724 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f599a0-9feb-4734-9d31-f1ca848655bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:44:22.351000 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f599a0-9feb-4734-9d31-f1ca848655bf admin admin] PATH_INFO: `/v3/users/2f6ed7460cef42dda3b6b6bf5d37e79b` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:44:22.352250 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f599a0-9feb-4734-9d31-f1ca848655bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f6ed7460cef42dda3b6b6bf5d37e79b)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:44:22.354753 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f599a0-9feb-4734-9d31-f1ca848655bf admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:44:22.672548 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-08f599a0-9feb-4734-9d31-f1ca848655bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f6ed7460cef42dda3b6b6bf5d37e79b'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:44:22.693094 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-08f599a0-9feb-4734-9d31-f1ca848655bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f6ed7460cef42dda3b6b6bf5d37e79b'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:44:22.693876 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-08f599a0-9feb-4734-9d31-f1ca848655bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f6ed7460cef42dda3b6b6bf5d37e79b'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:44:22.720776 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-08f599a0-9feb-4734-9d31-f1ca848655bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f6ed7460cef42dda3b6b6bf5d37e79b'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:44:22.722821 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-08f599a0-9feb-4734-9d31-f1ca848655bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f6ed7460cef42dda3b6b6bf5d37e79b'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:44:22.807125 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1139/2295] 10.222.0.86 () {58 vars in 1223 bytes} [Tue Jun 7 14:44:22 2022] DELETE /identity/v3/users/2f6ed7460cef42dda3b6b6bf5d37e79b => generated 0 bytes in 580 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:44:23.479422 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff186c5-a6f8-44be-9310-279cdb90becb admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:44:23.481447 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-5ff186c5-a6f8-44be-9310-279cdb90becb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:44:23.514371 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff186c5-a6f8-44be-9310-279cdb90becb admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:44:23.657975 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0b31e7-a982-4cf1-8aed-00ef9d8493fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:44:23.659024 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0b31e7-a982-4cf1-8aed-00ef9d8493fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:44:23.659318 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0b31e7-a982-4cf1-8aed-00ef9d8493fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:44:23.659603 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0b31e7-a982-4cf1-8aed-00ef9d8493fc admin admin] PATH_INFO: `/v3/projects/54dd30d67d6b42ef9824bec4579a60b4` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:44:23.664357 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0b31e7-a982-4cf1-8aed-00ef9d8493fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=54dd30d67d6b42ef9824bec4579a60b4)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:44:23.666325 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0b31e7-a982-4cf1-8aed-00ef9d8493fc admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:44:23.770706 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ef5bc2-e222-45dd-aadb-14a7c45d5e47 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:44:23.771282 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ef5bc2-e222-45dd-aadb-14a7c45d5e47 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:44:23.771282 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ef5bc2-e222-45dd-aadb-14a7c45d5e47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:44:23.809129 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:44:23.824149 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-8c0b31e7-a982-4cf1-8aed-00ef9d8493fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54dd30d67d6b42ef9824bec4579a60b4', 'request_id': 'req-8c0b31e7-a982-4cf1-8aed-00ef9d8493fc'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:44:23.831905 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-8c0b31e7-a982-4cf1-8aed-00ef9d8493fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54dd30d67d6b42ef9824bec4579a60b4', 'request_id': 'req-8c0b31e7-a982-4cf1-8aed-00ef9d8493fc'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:44:23.842354 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-80ef5bc2-e222-45dd-aadb-14a7c45d5e47 None None] MFA Rules not processed for user `5a0ee23baf5d43538190e437545038f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:44:23.843737 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-80ef5bc2-e222-45dd-aadb-14a7c45d5e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:44:23.875873 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:44:23.922110 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-8c0b31e7-a982-4cf1-8aed-00ef9d8493fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54dd30d67d6b42ef9824bec4579a60b4', 'request_id': 'req-8c0b31e7-a982-4cf1-8aed-00ef9d8493fc'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:44:23.925399 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1140/2296] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:44:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 14:44:23.937648 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-8c0b31e7-a982-4cf1-8aed-00ef9d8493fc admin admin] The token cache is being invalidate because project 54dd30d67d6b42ef9824bec4579a60b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:44:23.937847 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ef5bc2-e222-45dd-aadb-14a7c45d5e47 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:44:23.937963 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-8c0b31e7-a982-4cf1-8aed-00ef9d8493fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:44:23.938638 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-8c0b31e7-a982-4cf1-8aed-00ef9d8493fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:44:23.940602 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1157/2297] 10.222.0.86 () {58 vars in 1232 bytes} [Tue Jun 7 14:44:23 2022] DELETE /identity/v3/projects/54dd30d67d6b42ef9824bec4579a60b4 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:44:23.949538 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-80ef5bc2-e222-45dd-aadb-14a7c45d5e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:44:24.072315 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ef5bc2-e222-45dd-aadb-14a7c45d5e47 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:44:24.081695 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4641fe-4f7e-4c46-ad2b-d764a3018a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:44:24.082946 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4641fe-4f7e-4c46-ad2b-d764a3018a97 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:44:24.083448 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4641fe-4f7e-4c46-ad2b-d764a3018a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:44:24.083977 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4641fe-4f7e-4c46-ad2b-d764a3018a97 admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:44:24.097016 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4641fe-4f7e-4c46-ad2b-d764a3018a97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:44:24.100438 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4641fe-4f7e-4c46-ad2b-d764a3018a97 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:44:24.218077 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0b31e7-a982-4cf1-8aed-00ef9d8493fc admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:44:24.219500 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-8c0b31e7-a982-4cf1-8aed-00ef9d8493fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:44:24.231698 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1141/2298] 10.222.0.86 () {60 vars in 1152 bytes} [Tue Jun 7 14:44:23 2022] POST /identity/v3/projects => generated 385 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:44:24.240246 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0b31e7-a982-4cf1-8aed-00ef9d8493fc admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:44:24.359717 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f25cbf-c804-4614-85ca-5da665811e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:44:24.360470 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f25cbf-c804-4614-85ca-5da665811e50 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:44:24.360819 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f25cbf-c804-4614-85ca-5da665811e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:44:24.361083 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f25cbf-c804-4614-85ca-5da665811e50 admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:44:24.361792 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f25cbf-c804-4614-85ca-5da665811e50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:44:24.363723 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f25cbf-c804-4614-85ca-5da665811e50 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:44:24.443213 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1158/2299] 10.222.0.86 () {60 vars in 1143 bytes} [Tue Jun 7 14:44:24 2022] POST /identity/v3/users => generated 299 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:44:24.447200 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4641fe-4f7e-4c46-ad2b-d764a3018a97 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:44:24.457277 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4641fe-4f7e-4c46-ad2b-d764a3018a97 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:44:24.461902 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab9e6b8-c41e-4bb8-9ddd-b9f0126f5839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:44:24.462614 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab9e6b8-c41e-4bb8-9ddd-b9f0126f5839 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:44:24.462898 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab9e6b8-c41e-4bb8-9ddd-b9f0126f5839 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:44:24.463170 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab9e6b8-c41e-4bb8-9ddd-b9f0126f5839 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:44:24.463990 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab9e6b8-c41e-4bb8-9ddd-b9f0126f5839 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:44:24.465575 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab9e6b8-c41e-4bb8-9ddd-b9f0126f5839 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:44:24.477406 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1142/2300] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:44:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:44:24.481448 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f25cbf-c804-4614-85ca-5da665811e50 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:44:24.492293 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f25cbf-c804-4614-85ca-5da665811e50 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:44:24.496854 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d05b676-9d90-49b7-8c1f-89865b28afdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:44:24.497755 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d05b676-9d90-49b7-8c1f-89865b28afdc admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:44:24.498038 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d05b676-9d90-49b7-8c1f-89865b28afdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:44:24.498312 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d05b676-9d90-49b7-8c1f-89865b28afdc admin admin] PATH_INFO: `/v3/projects/c23152dc12c2455e9472ac374ea5e7a6/users/4a6478443dac495a990bdac10442e457/roles/e3bf6239f5bf477b965704b086786f11` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:44:24.514182 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d05b676-9d90-49b7-8c1f-89865b28afdc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c23152dc12c2455e9472ac374ea5e7a6, user_id=4a6478443dac495a990bdac10442e457, role_id=e3bf6239f5bf477b965704b086786f11)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:44:24.517723 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d05b676-9d90-49b7-8c1f-89865b28afdc admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:44:24.591583 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1159/2301] 10.222.0.86 () {60 vars in 1482 bytes} [Tue Jun 7 14:44:24 2022] PUT /identity/v3/projects/c23152dc12c2455e9472ac374ea5e7a6/users/4a6478443dac495a990bdac10442e457/roles/e3bf6239f5bf477b965704b086786f11 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:44:24.595512 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab9e6b8-c41e-4bb8-9ddd-b9f0126f5839 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:44:24.606750 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab9e6b8-c41e-4bb8-9ddd-b9f0126f5839 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:44:24.672001 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e10d1b-20fe-460a-9c1f-565326e7066f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:44:24.672674 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e10d1b-20fe-460a-9c1f-565326e7066f admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:44:24.672960 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e10d1b-20fe-460a-9c1f-565326e7066f admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:44:24.673773 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e10d1b-20fe-460a-9c1f-565326e7066f admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:44:24.674511 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e10d1b-20fe-460a-9c1f-565326e7066f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:44:24.676156 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e10d1b-20fe-460a-9c1f-565326e7066f admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:44:24.686497 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1143/2302] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:44:24 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:44:24.691084 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d05b676-9d90-49b7-8c1f-89865b28afdc admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:44:24.706158 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d05b676-9d90-49b7-8c1f-89865b28afdc admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:44:24.711335 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03e9773-8773-49e5-9012-f81d50ba4c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:44:24.712270 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03e9773-8773-49e5-9012-f81d50ba4c61 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:44:24.712566 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03e9773-8773-49e5-9012-f81d50ba4c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:44:24.712838 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03e9773-8773-49e5-9012-f81d50ba4c61 admin admin] PATH_INFO: `/v3/projects/c23152dc12c2455e9472ac374ea5e7a6/users/4a6478443dac495a990bdac10442e457/roles/e3bf6239f5bf477b965704b086786f11` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:44:24.714953 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03e9773-8773-49e5-9012-f81d50ba4c61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c23152dc12c2455e9472ac374ea5e7a6, user_id=4a6478443dac495a990bdac10442e457, role_id=e3bf6239f5bf477b965704b086786f11)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:44:24.717614 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03e9773-8773-49e5-9012-f81d50ba4c61 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:44:24.728227 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1160/2303] 10.222.0.86 () {60 vars in 1482 bytes} [Tue Jun 7 14:44:24 2022] PUT /identity/v3/projects/c23152dc12c2455e9472ac374ea5e7a6/users/4a6478443dac495a990bdac10442e457/roles/e3bf6239f5bf477b965704b086786f11 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:44:30.933558 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e5bc97-5e44-4c8d-a245-13e1397cecdf None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:44:30.934039 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e5bc97-5e44-4c8d-a245-13e1397cecdf None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:44:30.934142 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e5bc97-5e44-4c8d-a245-13e1397cecdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:44:30.971437 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-95e5bc97-5e44-4c8d-a245-13e1397cecdf None None] MFA Rules not processed for user `4a6478443dac495a990bdac10442e457`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:44:30.972932 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-95e5bc97-5e44-4c8d-a245-13e1397cecdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:44:30.996689 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:44:31.052238 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1144/2304] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:44:30 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:44:31.062064 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03e9773-8773-49e5-9012-f81d50ba4c61 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:44:31.065291 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-a03e9773-8773-49e5-9012-f81d50ba4c61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:44:31.131599 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03e9773-8773-49e5-9012-f81d50ba4c61 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:44:31.135271 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a3be3d-e0e9-428c-90f3-dea2f07de493 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b910435e5585436996ba5b5aeb7184bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:44:31.135954 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a3be3d-e0e9-428c-90f3-dea2f07de493 service glance] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:44:31.136246 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a3be3d-e0e9-428c-90f3-dea2f07de493 service glance] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:44:31.136524 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a3be3d-e0e9-428c-90f3-dea2f07de493 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:44:31.138375 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-95a3be3d-e0e9-428c-90f3-dea2f07de493 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:44:31.180387 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=90,keystone:DELETE=4,keystone:INSERT=6 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:44:31.202288 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a3be3d-e0e9-428c-90f3-dea2f07de493 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:44:31.204592 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a3be3d-e0e9-428c-90f3-dea2f07de493 service glance] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:44:31.215950 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1161/2305] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:44:31 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 14:44:31.519427 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12880654-d96e-4a8e-aad7-a49ac2e43550 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:44:31.519727 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12880654-d96e-4a8e-aad7-a49ac2e43550 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:44:31.520057 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12880654-d96e-4a8e-aad7-a49ac2e43550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:44:31.538324 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-12880654-d96e-4a8e-aad7-a49ac2e43550 None None] MFA Rules not processed for user `d7b598c6a3f642ef9edc971ad3ebbe31`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:44:31.540399 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-12880654-d96e-4a8e-aad7-a49ac2e43550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:44:31.605421 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1145/2306] 10.222.0.86 () {58 vars in 1009 bytes} [Tue Jun 7 14:44:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:44:31.621031 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a3be3d-e0e9-428c-90f3-dea2f07de493 service glance] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:44:31.623069 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-95a3be3d-e0e9-428c-90f3-dea2f07de493 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:44:31.693337 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a3be3d-e0e9-428c-90f3-dea2f07de493 service glance] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:44:31.698395 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879c98dd-cdc6-4f80-8823-5e09f8c6931e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9774349dd2b4ec092ef04c3df050a7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:44:31.699042 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879c98dd-cdc6-4f80-8823-5e09f8c6931e service swift] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:44:31.699333 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879c98dd-cdc6-4f80-8823-5e09f8c6931e service swift] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:44:31.699612 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879c98dd-cdc6-4f80-8823-5e09f8c6931e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:44:31.707529 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879c98dd-cdc6-4f80-8823-5e09f8c6931e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:44:31.709144 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879c98dd-cdc6-4f80-8823-5e09f8c6931e service swift] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:44:31.717496 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1162/2307] 10.222.0.86 () {60 vars in 1384 bytes} [Tue Jun 7 14:44:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 07 14:44:38.698698 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee1ab5b-a597-4b1f-ba3f-d019b20b7fc7 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:44:38.698698 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee1ab5b-a597-4b1f-ba3f-d019b20b7fc7 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:44:38.698698 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee1ab5b-a597-4b1f-ba3f-d019b20b7fc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:44:38.709462 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-1ee1ab5b-a597-4b1f-ba3f-d019b20b7fc7 None None] MFA Rules not processed for user `d7b598c6a3f642ef9edc971ad3ebbe31`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:44:38.710674 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-1ee1ab5b-a597-4b1f-ba3f-d019b20b7fc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:44:38.718183 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1146/2308] 10.222.0.86 () {58 vars in 967 bytes} [Tue Jun 7 14:44:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:44:38.731469 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879c98dd-cdc6-4f80-8823-5e09f8c6931e service swift] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:44:38.746148 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879c98dd-cdc6-4f80-8823-5e09f8c6931e service swift] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:44:38.752450 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec4bce8-f1fa-44e1-8e73-2265c92589d7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9774349dd2b4ec092ef04c3df050a7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:44:38.758041 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec4bce8-f1fa-44e1-8e73-2265c92589d7 service swift] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:44:38.758041 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec4bce8-f1fa-44e1-8e73-2265c92589d7 service swift] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:44:38.758041 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec4bce8-f1fa-44e1-8e73-2265c92589d7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:44:38.770346 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec4bce8-f1fa-44e1-8e73-2265c92589d7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:44:38.772085 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec4bce8-f1fa-44e1-8e73-2265c92589d7 service swift] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:44:38.785403 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1163/2309] 10.222.0.86 () {60 vars in 1384 bytes} [Tue Jun 7 14:44:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 07 14:44:42.633735 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b1e8c6-a9ab-443d-a77f-6421d1ca26a3 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:44:42.634242 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b1e8c6-a9ab-443d-a77f-6421d1ca26a3 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:44:42.634340 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b1e8c6-a9ab-443d-a77f-6421d1ca26a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:44:42.651639 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-32b1e8c6-a9ab-443d-a77f-6421d1ca26a3 None None] MFA Rules not processed for user `5a0ee23baf5d43538190e437545038f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:44:42.652894 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-32b1e8c6-a9ab-443d-a77f-6421d1ca26a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:44:42.659582 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1147/2310] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:44:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:44:46.222708 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acb2caa-b67e-4556-a928-6e49049825df None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:44:46.223314 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acb2caa-b67e-4556-a928-6e49049825df None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:44:46.223314 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acb2caa-b67e-4556-a928-6e49049825df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:44:46.242285 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-9acb2caa-b67e-4556-a928-6e49049825df None None] MFA Rules not processed for user `d7b598c6a3f642ef9edc971ad3ebbe31`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:44:46.243497 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-9acb2caa-b67e-4556-a928-6e49049825df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:44:46.250690 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1164/2311] 10.222.0.86 () {58 vars in 1009 bytes} [Tue Jun 7 14:44:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:44:46.262539 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b1e8c6-a9ab-443d-a77f-6421d1ca26a3 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:44:46.274796 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b1e8c6-a9ab-443d-a77f-6421d1ca26a3 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:44:46.279699 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9e0757-b7d4-4cfc-a637-13ad8b6d7bfe service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9774349dd2b4ec092ef04c3df050a7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:44:46.280365 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9e0757-b7d4-4cfc-a637-13ad8b6d7bfe service swift] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:44:46.280646 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9e0757-b7d4-4cfc-a637-13ad8b6d7bfe service swift] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:44:46.280920 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9e0757-b7d4-4cfc-a637-13ad8b6d7bfe service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:44:46.289498 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9e0757-b7d4-4cfc-a637-13ad8b6d7bfe service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:44:46.291057 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9e0757-b7d4-4cfc-a637-13ad8b6d7bfe service swift] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:44:46.299262 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1148/2312] 10.222.0.86 () {60 vars in 1384 bytes} [Tue Jun 7 14:44:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 07 14:44:56.236798 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=51 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:44:56.295815 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=56 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:45:20.392699 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acb2caa-b67e-4556-a928-6e49049825df None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:45:20.394162 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-9acb2caa-b67e-4556-a928-6e49049825df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:45:20.450225 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acb2caa-b67e-4556-a928-6e49049825df None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:45:20.454548 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6fb7e3-ecb9-4cdb-bca0-97766c22bc8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dda603ec5517460a83c333db2af804d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:45:20.455211 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6fb7e3-ecb9-4cdb-bca0-97766c22bc8f service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:45:20.455480 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6fb7e3-ecb9-4cdb-bca0-97766c22bc8f service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:45:20.455786 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6fb7e3-ecb9-4cdb-bca0-97766c22bc8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:45:20.465165 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6fb7e3-ecb9-4cdb-bca0-97766c22bc8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:45:20.466581 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6fb7e3-ecb9-4cdb-bca0-97766c22bc8f service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:45:20.476173 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1165/2313] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:45:20 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:45:30.474373 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=26 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:45:30.627288 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e9e3ad-a871-4bc2-9a25-a535062e727d None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:45:30.627728 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e9e3ad-a871-4bc2-9a25-a535062e727d None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:45:30.627996 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e9e3ad-a871-4bc2-9a25-a535062e727d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:45:30.646740 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-f2e9e3ad-a871-4bc2-9a25-a535062e727d None None] MFA Rules not processed for user `68698bf3cf7a4dee9daa865e9d6454ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:45:30.647969 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-f2e9e3ad-a871-4bc2-9a25-a535062e727d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:45:30.702785 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1149/2314] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:45:30 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:45:33.464134 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6fb7e3-ecb9-4cdb-bca0-97766c22bc8f service neutron] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:45:33.473322 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6fb7e3-ecb9-4cdb-bca0-97766c22bc8f service neutron] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:45:33.476933 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95065a3a-86ee-4f3d-ba24-e610cd146356 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dda603ec5517460a83c333db2af804d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:45:33.477563 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95065a3a-86ee-4f3d-ba24-e610cd146356 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:45:33.477885 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95065a3a-86ee-4f3d-ba24-e610cd146356 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:45:33.478166 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95065a3a-86ee-4f3d-ba24-e610cd146356 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:45:33.479962 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-95065a3a-86ee-4f3d-ba24-e610cd146356 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:45:33.550614 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95065a3a-86ee-4f3d-ba24-e610cd146356 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:45:33.552063 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95065a3a-86ee-4f3d-ba24-e610cd146356 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:45:33.563034 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1166/2315] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:45:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:45:35.316635 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e9e3ad-a871-4bc2-9a25-a535062e727d None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:45:35.318066 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-f2e9e3ad-a871-4bc2-9a25-a535062e727d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:45:35.330122 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e9e3ad-a871-4bc2-9a25-a535062e727d None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:45:35.333806 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56013abd-26bd-4d2f-b7c1-77e930dfe391 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dda603ec5517460a83c333db2af804d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:45:35.334444 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56013abd-26bd-4d2f-b7c1-77e930dfe391 service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:45:35.334751 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56013abd-26bd-4d2f-b7c1-77e930dfe391 service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:45:35.335029 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56013abd-26bd-4d2f-b7c1-77e930dfe391 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:45:35.336864 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-56013abd-26bd-4d2f-b7c1-77e930dfe391 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:45:35.350351 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56013abd-26bd-4d2f-b7c1-77e930dfe391 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:45:35.351813 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56013abd-26bd-4d2f-b7c1-77e930dfe391 service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:45:35.362641 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1150/2316] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:45:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:45:43.558077 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=34 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:45:45.358306 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=31 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:45:47.897024 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95065a3a-86ee-4f3d-ba24-e610cd146356 service neutron] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:45:47.899346 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-95065a3a-86ee-4f3d-ba24-e610cd146356 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:45:47.915269 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95065a3a-86ee-4f3d-ba24-e610cd146356 service neutron] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:45:47.922291 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd97011d-1744-439e-a187-7d7d97585eb1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99cfb70f54c45c8870369359da20378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:45:47.923397 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd97011d-1744-439e-a187-7d7d97585eb1 service nova] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:45:47.924046 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd97011d-1744-439e-a187-7d7d97585eb1 service nova] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:45:47.924551 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd97011d-1744-439e-a187-7d7d97585eb1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:45:47.926903 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-fd97011d-1744-439e-a187-7d7d97585eb1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:45:47.995925 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd97011d-1744-439e-a187-7d7d97585eb1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:45:47.997448 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd97011d-1744-439e-a187-7d7d97585eb1 service nova] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:45:48.007515 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1167/2317] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:45:47 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:45:58.002720 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=28 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:45:58.384637 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56013abd-26bd-4d2f-b7c1-77e930dfe391 service neutron] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:45:58.386082 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-56013abd-26bd-4d2f-b7c1-77e930dfe391 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:45:58.400357 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56013abd-26bd-4d2f-b7c1-77e930dfe391 service neutron] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:45:58.405834 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e406b8c3-cb9c-4ddd-ad56-ad344c1a065a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99cfb70f54c45c8870369359da20378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:45:58.406486 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e406b8c3-cb9c-4ddd-ad56-ad344c1a065a service nova] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:45:58.406794 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e406b8c3-cb9c-4ddd-ad56-ad344c1a065a service nova] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:45:58.407085 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e406b8c3-cb9c-4ddd-ad56-ad344c1a065a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:45:58.408888 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-e406b8c3-cb9c-4ddd-ad56-ad344c1a065a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:45:58.466910 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e406b8c3-cb9c-4ddd-ad56-ad344c1a065a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:45:58.468567 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e406b8c3-cb9c-4ddd-ad56-ad344c1a065a service nova] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:45:58.477945 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1151/2318] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:45:58 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:46:01.384225 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aaeedf-c1a3-453c-8265-29dfd61ad75e None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:46:01.384717 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aaeedf-c1a3-453c-8265-29dfd61ad75e None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:46:01.384813 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aaeedf-c1a3-453c-8265-29dfd61ad75e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:46:01.402593 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-a3aaeedf-c1a3-453c-8265-29dfd61ad75e None None] MFA Rules not processed for user `65552520abca41ab8728a75046dc94d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:46:01.404479 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-a3aaeedf-c1a3-453c-8265-29dfd61ad75e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:46:01.411633 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1168/2319] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:46:01 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 14:46:01.848336 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e406b8c3-cb9c-4ddd-ad56-ad344c1a065a service nova] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:46:01.858092 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e406b8c3-cb9c-4ddd-ad56-ad344c1a065a service nova] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:46:01.861890 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2949a33a-0cfe-48e2-bdbe-09e50e4cca4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dda603ec5517460a83c333db2af804d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:46:01.862584 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2949a33a-0cfe-48e2-bdbe-09e50e4cca4a service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:46:01.862862 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2949a33a-0cfe-48e2-bdbe-09e50e4cca4a service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:46:01.863138 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2949a33a-0cfe-48e2-bdbe-09e50e4cca4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:46:01.864964 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-2949a33a-0cfe-48e2-bdbe-09e50e4cca4a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:46:01.874552 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2949a33a-0cfe-48e2-bdbe-09e50e4cca4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:46:01.875988 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2949a33a-0cfe-48e2-bdbe-09e50e4cca4a service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:46:01.884299 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1152/2320] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:46:01 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:46:02.153312 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d771d0-e0ee-497b-b40d-b2c74dc2886d None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:46:02.153610 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d771d0-e0ee-497b-b40d-b2c74dc2886d None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:46:02.153952 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d771d0-e0ee-497b-b40d-b2c74dc2886d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:46:02.173610 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-38d771d0-e0ee-497b-b40d-b2c74dc2886d None None] MFA Rules not processed for user `bd70563183ab43d68df41f1be27cadc3`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:46:02.174913 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-38d771d0-e0ee-497b-b40d-b2c74dc2886d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:46:02.182306 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1169/2321] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:46:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:46:02.359329 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2949a33a-0cfe-48e2-bdbe-09e50e4cca4a service neutron] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:46:02.366088 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-2949a33a-0cfe-48e2-bdbe-09e50e4cca4a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:46:02.444966 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2949a33a-0cfe-48e2-bdbe-09e50e4cca4a service neutron] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:46:02.450191 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c370a24b-5a30-4dd5-a111-23d40566833e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e042f9d4a9345bb947e6a30f64a59ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:46:02.450944 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c370a24b-5a30-4dd5-a111-23d40566833e service placement] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:46:02.451229 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c370a24b-5a30-4dd5-a111-23d40566833e service placement] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:46:02.451503 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c370a24b-5a30-4dd5-a111-23d40566833e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:46:02.453319 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-c370a24b-5a30-4dd5-a111-23d40566833e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:46:02.465324 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c370a24b-5a30-4dd5-a111-23d40566833e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:46:02.466930 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c370a24b-5a30-4dd5-a111-23d40566833e service placement] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:46:02.477266 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1153/2322] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:46:02 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:46:02.497270 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d771d0-e0ee-497b-b40d-b2c74dc2886d None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:46:02.508544 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d771d0-e0ee-497b-b40d-b2c74dc2886d None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:46:02.530380 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8b2d5f-7ce4-495f-a5cb-fa7961bd3899 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dda603ec5517460a83c333db2af804d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:46:02.530380 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8b2d5f-7ce4-495f-a5cb-fa7961bd3899 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:46:02.530380 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8b2d5f-7ce4-495f-a5cb-fa7961bd3899 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:46:02.530380 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8b2d5f-7ce4-495f-a5cb-fa7961bd3899 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:46:02.530727 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-cd8b2d5f-7ce4-495f-a5cb-fa7961bd3899 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:46:02.530727 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8b2d5f-7ce4-495f-a5cb-fa7961bd3899 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:46:02.530727 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8b2d5f-7ce4-495f-a5cb-fa7961bd3899 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:46:02.536557 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1170/2323] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:46:02 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:46:05.812562 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c370a24b-5a30-4dd5-a111-23d40566833e service placement] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:46:05.822488 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c370a24b-5a30-4dd5-a111-23d40566833e service placement] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:46:05.826279 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b80d9b8-9331-44a5-b0a6-63cddeebd784 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dda603ec5517460a83c333db2af804d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:46:05.826964 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b80d9b8-9331-44a5-b0a6-63cddeebd784 service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:46:05.827249 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b80d9b8-9331-44a5-b0a6-63cddeebd784 service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:46:05.827528 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b80d9b8-9331-44a5-b0a6-63cddeebd784 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:46:05.829348 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-2b80d9b8-9331-44a5-b0a6-63cddeebd784 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:46:05.840728 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b80d9b8-9331-44a5-b0a6-63cddeebd784 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:46:05.843228 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b80d9b8-9331-44a5-b0a6-63cddeebd784 service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:46:05.852905 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1154/2324] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:46:05 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:46:12.533496 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=12 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:46:14.802407 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8b2d5f-7ce4-495f-a5cb-fa7961bd3899 service neutron] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:46:14.815186 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8b2d5f-7ce4-495f-a5cb-fa7961bd3899 service neutron] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:46:14.820824 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5454db44-5e98-4146-98b2-226fe640fa3b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99cfb70f54c45c8870369359da20378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:46:14.821460 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5454db44-5e98-4146-98b2-226fe640fa3b service nova] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:46:14.821749 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5454db44-5e98-4146-98b2-226fe640fa3b service nova] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:46:14.822029 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5454db44-5e98-4146-98b2-226fe640fa3b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:46:14.823914 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-5454db44-5e98-4146-98b2-226fe640fa3b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:46:14.836345 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5454db44-5e98-4146-98b2-226fe640fa3b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:46:14.837938 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5454db44-5e98-4146-98b2-226fe640fa3b service nova] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:46:14.849020 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1171/2325] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:46:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:46:15.847857 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=72 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:46:20.349550 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b80d9b8-9331-44a5-b0a6-63cddeebd784 service neutron] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:46:20.364726 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b80d9b8-9331-44a5-b0a6-63cddeebd784 service neutron] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:46:20.373784 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca106f67-951f-48f7-82e4-b9dd1b39e0ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99cfb70f54c45c8870369359da20378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:46:20.375667 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca106f67-951f-48f7-82e4-b9dd1b39e0ef service nova] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:46:20.375667 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca106f67-951f-48f7-82e4-b9dd1b39e0ef service nova] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:46:20.375667 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca106f67-951f-48f7-82e4-b9dd1b39e0ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:46:20.377308 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-ca106f67-951f-48f7-82e4-b9dd1b39e0ef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:46:20.390458 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca106f67-951f-48f7-82e4-b9dd1b39e0ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:46:20.392052 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca106f67-951f-48f7-82e4-b9dd1b39e0ef service nova] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:46:20.402893 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1155/2326] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:46:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:46:23.758681 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5454db44-5e98-4146-98b2-226fe640fa3b service nova] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:46:23.770529 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5454db44-5e98-4146-98b2-226fe640fa3b service nova] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:46:23.776139 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e1156c-1f1b-4c84-8b28-72fe5ab198ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99cfb70f54c45c8870369359da20378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:46:23.776790 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e1156c-1f1b-4c84-8b28-72fe5ab198ba service nova] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:46:23.777071 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e1156c-1f1b-4c84-8b28-72fe5ab198ba service nova] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:46:23.777353 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e1156c-1f1b-4c84-8b28-72fe5ab198ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:46:23.779156 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-80e1156c-1f1b-4c84-8b28-72fe5ab198ba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:46:23.791439 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e1156c-1f1b-4c84-8b28-72fe5ab198ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:46:23.793038 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e1156c-1f1b-4c84-8b28-72fe5ab198ba service nova] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:46:23.804008 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1172/2327] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:46:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:46:30.398547 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=6 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:46:33.799578 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=12 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:46:47.678043 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca106f67-951f-48f7-82e4-b9dd1b39e0ef service nova] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:46:47.679468 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-ca106f67-951f-48f7-82e4-b9dd1b39e0ef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:46:47.735164 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca106f67-951f-48f7-82e4-b9dd1b39e0ef service nova] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:46:47.738825 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c1d9da-63c8-404d-9cde-cd51a95cdd83 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af5a95620a4b43538abfe09eed4bf115', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:46:47.739458 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c1d9da-63c8-404d-9cde-cd51a95cdd83 service cinder] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:46:47.739772 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c1d9da-63c8-404d-9cde-cd51a95cdd83 service cinder] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:46:47.740057 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c1d9da-63c8-404d-9cde-cd51a95cdd83 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:46:47.741830 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-77c1d9da-63c8-404d-9cde-cd51a95cdd83 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:46:47.799228 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c1d9da-63c8-404d-9cde-cd51a95cdd83 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:46:47.800684 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c1d9da-63c8-404d-9cde-cd51a95cdd83 service cinder] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:46:47.810104 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1156/2328] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:46:47 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:46:53.213315 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e1156c-1f1b-4c84-8b28-72fe5ab198ba service nova] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:46:53.225066 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e1156c-1f1b-4c84-8b28-72fe5ab198ba service nova] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:46:53.228923 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a807ffbe-8c5d-4243-aba6-ba7b3c2a93c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af5a95620a4b43538abfe09eed4bf115', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:46:53.229576 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a807ffbe-8c5d-4243-aba6-ba7b3c2a93c9 service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:46:53.230451 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a807ffbe-8c5d-4243-aba6-ba7b3c2a93c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:46:53.230778 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a807ffbe-8c5d-4243-aba6-ba7b3c2a93c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:46:53.232893 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-a807ffbe-8c5d-4243-aba6-ba7b3c2a93c9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:46:53.245933 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a807ffbe-8c5d-4243-aba6-ba7b3c2a93c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:46:53.247427 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a807ffbe-8c5d-4243-aba6-ba7b3c2a93c9 service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:46:53.257453 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1173/2329] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:46:53 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:46:56.497517 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4976547a-31b5-427d-be46-b4da0f6dfccd None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:46:56.506789 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4976547a-31b5-427d-be46-b4da0f6dfccd None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:46:56.506789 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4976547a-31b5-427d-be46-b4da0f6dfccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:46:56.516037 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-4976547a-31b5-427d-be46-b4da0f6dfccd None None] MFA Rules not processed for user `3d5a010550bb4bf783a3cf75153d7e9f`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:46:56.517281 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-4976547a-31b5-427d-be46-b4da0f6dfccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:46:56.524329 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1157/2330] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:46:56 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:47:03.252922 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=6 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:47:06.510912 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=51 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:47:18.375672 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a807ffbe-8c5d-4243-aba6-ba7b3c2a93c9 service cinder] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:47:18.384843 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a807ffbe-8c5d-4243-aba6-ba7b3c2a93c9 service cinder] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:47:18.388714 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6d1593-9291-4521-9897-35abb1836ce1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dda603ec5517460a83c333db2af804d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:47:18.389338 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6d1593-9291-4521-9897-35abb1836ce1 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:47:18.389620 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6d1593-9291-4521-9897-35abb1836ce1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:47:18.389893 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6d1593-9291-4521-9897-35abb1836ce1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:47:18.391625 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-da6d1593-9291-4521-9897-35abb1836ce1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:47:18.452297 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6d1593-9291-4521-9897-35abb1836ce1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:47:18.453710 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6d1593-9291-4521-9897-35abb1836ce1 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:47:18.463274 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1174/2331] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:47:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:47:22.439377 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4976547a-31b5-427d-be46-b4da0f6dfccd None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:47:22.440874 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-4976547a-31b5-427d-be46-b4da0f6dfccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:47:22.456283 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4976547a-31b5-427d-be46-b4da0f6dfccd None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:47:22.461308 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b0869d-0a94-4afc-ba15-36e9e02c689c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e042f9d4a9345bb947e6a30f64a59ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:47:22.461950 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b0869d-0a94-4afc-ba15-36e9e02c689c service placement] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:47:22.462237 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b0869d-0a94-4afc-ba15-36e9e02c689c service placement] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:47:22.462514 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b0869d-0a94-4afc-ba15-36e9e02c689c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:47:22.464315 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-c0b0869d-0a94-4afc-ba15-36e9e02c689c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:47:22.475749 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b0869d-0a94-4afc-ba15-36e9e02c689c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:47:22.477397 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b0869d-0a94-4afc-ba15-36e9e02c689c service placement] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:47:22.487676 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1158/2332] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:47:22 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:47:22.611097 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6d1593-9291-4521-9897-35abb1836ce1 service neutron] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:47:22.611669 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-da6d1593-9291-4521-9897-35abb1836ce1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:47:22.625076 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6d1593-9291-4521-9897-35abb1836ce1 service neutron] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:47:22.629748 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97a0dfd-b347-4e65-9231-392ffca5e28b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:47:22.630655 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97a0dfd-b347-4e65-9231-392ffca5e28b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:47:22.630955 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97a0dfd-b347-4e65-9231-392ffca5e28b admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:47:22.631233 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97a0dfd-b347-4e65-9231-392ffca5e28b admin admin] PATH_INFO: `/v3/users/68698bf3cf7a4dee9daa865e9d6454ee` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:47:22.632428 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97a0dfd-b347-4e65-9231-392ffca5e28b admin admin] RBAC: Authorizing `identity:delete_user(user_id=68698bf3cf7a4dee9daa865e9d6454ee)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:47:22.634361 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97a0dfd-b347-4e65-9231-392ffca5e28b admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:47:22.857644 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-a97a0dfd-b347-4e65-9231-392ffca5e28b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68698bf3cf7a4dee9daa865e9d6454ee'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:47:22.858299 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-a97a0dfd-b347-4e65-9231-392ffca5e28b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68698bf3cf7a4dee9daa865e9d6454ee'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:47:22.865375 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-a97a0dfd-b347-4e65-9231-392ffca5e28b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68698bf3cf7a4dee9daa865e9d6454ee'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:47:22.878783 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-a97a0dfd-b347-4e65-9231-392ffca5e28b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68698bf3cf7a4dee9daa865e9d6454ee'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:47:22.879380 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-a97a0dfd-b347-4e65-9231-392ffca5e28b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68698bf3cf7a4dee9daa865e9d6454ee'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:47:23.003348 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1175/2333] 10.222.0.86 () {58 vars in 1223 bytes} [Tue Jun 7 14:47:22 2022] DELETE /identity/v3/users/68698bf3cf7a4dee9daa865e9d6454ee => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:47:23.302474 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b0869d-0a94-4afc-ba15-36e9e02c689c service placement] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:47:23.315933 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b0869d-0a94-4afc-ba15-36e9e02c689c service placement] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:47:23.373745 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9343641-ef21-4dbf-92af-5397500d4f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:47:23.374611 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9343641-ef21-4dbf-92af-5397500d4f14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:47:23.374905 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9343641-ef21-4dbf-92af-5397500d4f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:47:23.375187 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9343641-ef21-4dbf-92af-5397500d4f14 admin admin] PATH_INFO: `/v3/projects/61d7568c92aa4becb13de9bdba6156e1` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:47:23.376402 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9343641-ef21-4dbf-92af-5397500d4f14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61d7568c92aa4becb13de9bdba6156e1)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:47:23.378302 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9343641-ef21-4dbf-92af-5397500d4f14 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:47:23.526021 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-f9343641-ef21-4dbf-92af-5397500d4f14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61d7568c92aa4becb13de9bdba6156e1', 'request_id': 'req-f9343641-ef21-4dbf-92af-5397500d4f14'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:47:23.532065 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-f9343641-ef21-4dbf-92af-5397500d4f14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61d7568c92aa4becb13de9bdba6156e1', 'request_id': 'req-f9343641-ef21-4dbf-92af-5397500d4f14'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:47:23.614761 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-f9343641-ef21-4dbf-92af-5397500d4f14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61d7568c92aa4becb13de9bdba6156e1', 'request_id': 'req-f9343641-ef21-4dbf-92af-5397500d4f14'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:47:23.625160 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-f9343641-ef21-4dbf-92af-5397500d4f14 admin admin] The token cache is being invalidate because project 61d7568c92aa4becb13de9bdba6156e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:47:23.629032 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-f9343641-ef21-4dbf-92af-5397500d4f14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:47:23.629032 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-f9343641-ef21-4dbf-92af-5397500d4f14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:47:23.629032 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1159/2334] 10.222.0.86 () {58 vars in 1232 bytes} [Tue Jun 7 14:47:23 2022] DELETE /identity/v3/projects/61d7568c92aa4becb13de9bdba6156e1 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 14:47:23.632548 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9037b46b-3950-42eb-b34c-de8ced868b7e None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:47:23.633034 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9037b46b-3950-42eb-b34c-de8ced868b7e None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:47:23.633143 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9037b46b-3950-42eb-b34c-de8ced868b7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:47:23.652240 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-9037b46b-3950-42eb-b34c-de8ced868b7e None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:47:23.653429 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-9037b46b-3950-42eb-b34c-de8ced868b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:47:23.712308 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1176/2335] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:47:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:47:23.720561 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfad9e3-14eb-4fd5-ab7b-4a23ff980827 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:47:23.720857 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfad9e3-14eb-4fd5-ab7b-4a23ff980827 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:47:23.721138 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfad9e3-14eb-4fd5-ab7b-4a23ff980827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:47:23.739693 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-1cfad9e3-14eb-4fd5-ab7b-4a23ff980827 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:47:23.740935 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-1cfad9e3-14eb-4fd5-ab7b-4a23ff980827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:47:23.749232 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1160/2336] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:47:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:47:23.753389 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9037b46b-3950-42eb-b34c-de8ced868b7e None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:47:23.764478 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9037b46b-3950-42eb-b34c-de8ced868b7e None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:47:23.769102 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaae410c-c89d-47e8-bba6-69804b72a574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:47:23.769782 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaae410c-c89d-47e8-bba6-69804b72a574 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:47:23.770063 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaae410c-c89d-47e8-bba6-69804b72a574 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:47:23.770338 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaae410c-c89d-47e8-bba6-69804b72a574 admin admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:47:23.771068 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaae410c-c89d-47e8-bba6-69804b72a574 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:47:23.771379 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaae410c-c89d-47e8-bba6-69804b72a574 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:47:23.773062 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaae410c-c89d-47e8-bba6-69804b72a574 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:47:23.774713 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:47:23.786084 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1177/2337] 10.222.0.86 () {58 vars in 1152 bytes} [Tue Jun 7 14:47:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:47:23.790308 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfad9e3-14eb-4fd5-ab7b-4a23ff980827 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:47:23.799467 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfad9e3-14eb-4fd5-ab7b-4a23ff980827 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:47:23.804168 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c26184-35a5-4c8f-be51-896088f5d34f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:47:23.804812 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c26184-35a5-4c8f-be51-896088f5d34f admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:47:23.805098 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c26184-35a5-4c8f-be51-896088f5d34f admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:47:23.805375 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c26184-35a5-4c8f-be51-896088f5d34f admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:47:23.806066 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c26184-35a5-4c8f-be51-896088f5d34f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:47:23.807986 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c26184-35a5-4c8f-be51-896088f5d34f admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:47:23.954285 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1161/2338] 10.222.0.86 () {60 vars in 1152 bytes} [Tue Jun 7 14:47:23 2022] POST /identity/v3/projects => generated 373 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:47:23.958370 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaae410c-c89d-47e8-bba6-69804b72a574 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:47:23.968550 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaae410c-c89d-47e8-bba6-69804b72a574 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:47:24.024795 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e61ea1-56ef-4b3a-94a4-4605fd270c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:47:24.025480 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e61ea1-56ef-4b3a-94a4-4605fd270c43 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:47:24.025822 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e61ea1-56ef-4b3a-94a4-4605fd270c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:47:24.026208 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e61ea1-56ef-4b3a-94a4-4605fd270c43 admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:47:24.026911 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e61ea1-56ef-4b3a-94a4-4605fd270c43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:47:24.028883 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e61ea1-56ef-4b3a-94a4-4605fd270c43 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:47:24.146997 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1178/2339] 10.222.0.86 () {60 vars in 1143 bytes} [Tue Jun 7 14:47:23 2022] POST /identity/v3/users => generated 287 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:47:24.150985 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c26184-35a5-4c8f-be51-896088f5d34f admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:47:24.161463 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c26184-35a5-4c8f-be51-896088f5d34f admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:47:24.166055 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65f378a-7558-4608-bc03-c80feea1a3e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:47:24.166703 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65f378a-7558-4608-bc03-c80feea1a3e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:47:24.167007 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65f378a-7558-4608-bc03-c80feea1a3e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:47:24.167263 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65f378a-7558-4608-bc03-c80feea1a3e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:47:24.168017 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65f378a-7558-4608-bc03-c80feea1a3e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:47:24.169728 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65f378a-7558-4608-bc03-c80feea1a3e9 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:47:24.179439 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1162/2340] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:47:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:47:24.183697 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e61ea1-56ef-4b3a-94a4-4605fd270c43 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:47:24.193373 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e61ea1-56ef-4b3a-94a4-4605fd270c43 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:47:24.198486 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6875e59b-5b02-4ae2-8733-efd5945de80e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:47:24.199137 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6875e59b-5b02-4ae2-8733-efd5945de80e admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:47:24.199417 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6875e59b-5b02-4ae2-8733-efd5945de80e admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:47:24.199692 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6875e59b-5b02-4ae2-8733-efd5945de80e admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:47:24.200444 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6875e59b-5b02-4ae2-8733-efd5945de80e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:47:24.202009 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6875e59b-5b02-4ae2-8733-efd5945de80e admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:47:24.211998 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1179/2341] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:47:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:47:24.216227 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65f378a-7558-4608-bc03-c80feea1a3e9 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:47:24.226583 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65f378a-7558-4608-bc03-c80feea1a3e9 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:47:24.231875 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13d61b7-9492-446c-9f33-d346ebac8855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:47:24.232753 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13d61b7-9492-446c-9f33-d346ebac8855 admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:47:24.233030 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13d61b7-9492-446c-9f33-d346ebac8855 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:47:24.233300 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13d61b7-9492-446c-9f33-d346ebac8855 admin admin] PATH_INFO: `/v3/projects/48e2ad2a9b5e44c7b5a4dc4b81e2952c/users/1dfb6ba8612c448e840f9c91e4e54521/roles/c17acc2a8bb348f59ba7edd22fcf0c47` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:47:24.248981 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13d61b7-9492-446c-9f33-d346ebac8855 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48e2ad2a9b5e44c7b5a4dc4b81e2952c, user_id=1dfb6ba8612c448e840f9c91e4e54521, role_id=c17acc2a8bb348f59ba7edd22fcf0c47)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:47:24.251903 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13d61b7-9492-446c-9f33-d346ebac8855 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:47:24.370045 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1163/2342] 10.222.0.86 () {60 vars in 1482 bytes} [Tue Jun 7 14:47:24 2022] PUT /identity/v3/projects/48e2ad2a9b5e44c7b5a4dc4b81e2952c/users/1dfb6ba8612c448e840f9c91e4e54521/roles/c17acc2a8bb348f59ba7edd22fcf0c47 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 14:47:24.381280 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7b33fc-f0f5-47ee-b2bb-87b8228973a5 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:47:24.381570 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7b33fc-f0f5-47ee-b2bb-87b8228973a5 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:47:24.381849 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7b33fc-f0f5-47ee-b2bb-87b8228973a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:47:24.407855 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-9c7b33fc-f0f5-47ee-b2bb-87b8228973a5 None None] MFA Rules not processed for user `1dfb6ba8612c448e840f9c91e4e54521`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:47:24.408911 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-9c7b33fc-f0f5-47ee-b2bb-87b8228973a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:47:24.472640 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1180/2343] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:47:24 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:47:24.484144 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13d61b7-9492-446c-9f33-d346ebac8855 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:47:24.485809 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-c13d61b7-9492-446c-9f33-d346ebac8855 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:47:24.492327 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:47:24.560865 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13d61b7-9492-446c-9f33-d346ebac8855 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:47:24.567019 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeb3d1a-9f12-4a0e-aa9b-bd7c7d9adef5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99cfb70f54c45c8870369359da20378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:47:24.567662 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeb3d1a-9f12-4a0e-aa9b-bd7c7d9adef5 service nova] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:47:24.567998 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeb3d1a-9f12-4a0e-aa9b-bd7c7d9adef5 service nova] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:47:24.571195 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeb3d1a-9f12-4a0e-aa9b-bd7c7d9adef5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:47:24.576209 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbeb3d1a-9f12-4a0e-aa9b-bd7c7d9adef5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:47:24.577881 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbeb3d1a-9f12-4a0e-aa9b-bd7c7d9adef5 service nova] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:47:24.586870 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1164/2344] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:47:24 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:47:24.795364 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7b33fc-f0f5-47ee-b2bb-87b8228973a5 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:47:24.857538 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7b33fc-f0f5-47ee-b2bb-87b8228973a5 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:47:24.861993 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a805fd8-f3d1-49ae-b765-8c4e20a5431b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:47:24.862889 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a805fd8-f3d1-49ae-b765-8c4e20a5431b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:47:24.863178 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a805fd8-f3d1-49ae-b765-8c4e20a5431b admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:47:24.863453 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a805fd8-f3d1-49ae-b765-8c4e20a5431b admin admin] PATH_INFO: `/v3/users/1dfb6ba8612c448e840f9c91e4e54521` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:47:24.864649 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a805fd8-f3d1-49ae-b765-8c4e20a5431b admin admin] RBAC: Authorizing `identity:delete_user(user_id=1dfb6ba8612c448e840f9c91e4e54521)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:47:24.866557 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a805fd8-f3d1-49ae-b765-8c4e20a5431b admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:47:24.868808 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:47:25.119810 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-5a805fd8-f3d1-49ae-b765-8c4e20a5431b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1dfb6ba8612c448e840f9c91e4e54521'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:47:25.120553 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-5a805fd8-f3d1-49ae-b765-8c4e20a5431b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1dfb6ba8612c448e840f9c91e4e54521'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:47:25.127490 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-5a805fd8-f3d1-49ae-b765-8c4e20a5431b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1dfb6ba8612c448e840f9c91e4e54521'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:47:25.139844 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-5a805fd8-f3d1-49ae-b765-8c4e20a5431b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1dfb6ba8612c448e840f9c91e4e54521'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:47:25.140496 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-5a805fd8-f3d1-49ae-b765-8c4e20a5431b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1dfb6ba8612c448e840f9c91e4e54521'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:47:25.233137 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1181/2345] 10.222.0.86 () {58 vars in 1223 bytes} [Tue Jun 7 14:47:24 2022] DELETE /identity/v3/users/1dfb6ba8612c448e840f9c91e4e54521 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:47:25.239337 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfa6260-982d-4304-b731-de27934d3efb None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:47:25.239337 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfa6260-982d-4304-b731-de27934d3efb None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:47:25.239337 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfa6260-982d-4304-b731-de27934d3efb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:47:25.255531 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-2bfa6260-982d-4304-b731-de27934d3efb None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:47:25.256810 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-2bfa6260-982d-4304-b731-de27934d3efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:47:25.319997 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1165/2346] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:47:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 14:47:25.330118 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a805fd8-f3d1-49ae-b765-8c4e20a5431b admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:47:25.331694 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-5a805fd8-f3d1-49ae-b765-8c4e20a5431b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:47:25.392949 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a805fd8-f3d1-49ae-b765-8c4e20a5431b admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:47:25.396635 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02361a4-255a-4e22-90a5-5a0a66806a59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dda603ec5517460a83c333db2af804d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:47:25.397310 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02361a4-255a-4e22-90a5-5a0a66806a59 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:47:25.397638 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02361a4-255a-4e22-90a5-5a0a66806a59 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:47:25.397921 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02361a4-255a-4e22-90a5-5a0a66806a59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:47:25.407378 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02361a4-255a-4e22-90a5-5a0a66806a59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:47:25.408850 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02361a4-255a-4e22-90a5-5a0a66806a59 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:47:25.419403 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1182/2347] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:47:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:47:26.011347 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfa6260-982d-4304-b731-de27934d3efb None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:47:26.012996 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-2bfa6260-982d-4304-b731-de27934d3efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:47:26.027620 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfa6260-982d-4304-b731-de27934d3efb None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:47:26.033843 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f36040-fdab-452a-9224-e4ee552d8537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:47:26.034724 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f36040-fdab-452a-9224-e4ee552d8537 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:47:26.035014 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f36040-fdab-452a-9224-e4ee552d8537 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:47:26.035327 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f36040-fdab-452a-9224-e4ee552d8537 admin admin] PATH_INFO: `/v3/projects/48e2ad2a9b5e44c7b5a4dc4b81e2952c` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:47:26.036662 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f36040-fdab-452a-9224-e4ee552d8537 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48e2ad2a9b5e44c7b5a4dc4b81e2952c)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:47:26.038687 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f36040-fdab-452a-9224-e4ee552d8537 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:47:26.175580 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-b3f36040-fdab-452a-9224-e4ee552d8537 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48e2ad2a9b5e44c7b5a4dc4b81e2952c', 'request_id': 'req-b3f36040-fdab-452a-9224-e4ee552d8537'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:47:26.182337 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-b3f36040-fdab-452a-9224-e4ee552d8537 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48e2ad2a9b5e44c7b5a4dc4b81e2952c', 'request_id': 'req-b3f36040-fdab-452a-9224-e4ee552d8537'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:47:26.277842 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-b3f36040-fdab-452a-9224-e4ee552d8537 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48e2ad2a9b5e44c7b5a4dc4b81e2952c', 'request_id': 'req-b3f36040-fdab-452a-9224-e4ee552d8537'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:47:26.289045 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-b3f36040-fdab-452a-9224-e4ee552d8537 admin admin] The token cache is being invalidate because project 48e2ad2a9b5e44c7b5a4dc4b81e2952c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:47:26.289359 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-b3f36040-fdab-452a-9224-e4ee552d8537 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:47:26.291855 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-b3f36040-fdab-452a-9224-e4ee552d8537 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:47:26.291855 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1166/2348] 10.222.0.86 () {58 vars in 1232 bytes} [Tue Jun 7 14:47:26 2022] DELETE /identity/v3/projects/48e2ad2a9b5e44c7b5a4dc4b81e2952c => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 14:47:26.296638 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75c79a3-f65d-492f-958b-8067dfced5c8 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:47:26.297085 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75c79a3-f65d-492f-958b-8067dfced5c8 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:47:26.297209 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75c79a3-f65d-492f-958b-8067dfced5c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:47:26.315075 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-c75c79a3-f65d-492f-958b-8067dfced5c8 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:47:26.316422 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-c75c79a3-f65d-492f-958b-8067dfced5c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:47:26.374684 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1183/2349] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:47:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:47:26.382344 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a5e98b-103b-4ee2-829d-856f55b26bfc None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:47:26.382641 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a5e98b-103b-4ee2-829d-856f55b26bfc None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:47:26.382920 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a5e98b-103b-4ee2-829d-856f55b26bfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:47:26.402081 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-a8a5e98b-103b-4ee2-829d-856f55b26bfc None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:47:26.403281 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-a8a5e98b-103b-4ee2-829d-856f55b26bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:47:26.411083 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1167/2350] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:47:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:47:26.415262 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75c79a3-f65d-492f-958b-8067dfced5c8 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:47:26.424703 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75c79a3-f65d-492f-958b-8067dfced5c8 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:47:26.429266 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d952eff-aaf7-4f93-9a73-ffd9aea572d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:47:26.429989 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d952eff-aaf7-4f93-9a73-ffd9aea572d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:47:26.430281 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d952eff-aaf7-4f93-9a73-ffd9aea572d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:47:26.430601 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d952eff-aaf7-4f93-9a73-ffd9aea572d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:47:26.431287 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d952eff-aaf7-4f93-9a73-ffd9aea572d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:47:26.432184 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d952eff-aaf7-4f93-9a73-ffd9aea572d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:47:26.433798 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d952eff-aaf7-4f93-9a73-ffd9aea572d8 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:47:26.446196 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1184/2351] 10.222.0.86 () {58 vars in 1152 bytes} [Tue Jun 7 14:47:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:47:26.451029 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a5e98b-103b-4ee2-829d-856f55b26bfc None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:47:26.460782 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a5e98b-103b-4ee2-829d-856f55b26bfc None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:47:26.475412 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef22b95c-9ffe-415e-bf06-914baca1e746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:47:26.475412 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef22b95c-9ffe-415e-bf06-914baca1e746 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:47:26.475412 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef22b95c-9ffe-415e-bf06-914baca1e746 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:47:26.475412 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef22b95c-9ffe-415e-bf06-914baca1e746 admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:47:26.475946 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef22b95c-9ffe-415e-bf06-914baca1e746 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:47:26.475946 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef22b95c-9ffe-415e-bf06-914baca1e746 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:47:26.475946 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:47:26.641106 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1168/2352] 10.222.0.86 () {60 vars in 1152 bytes} [Tue Jun 7 14:47:26 2022] POST /identity/v3/projects => generated 365 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:47:26.645219 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d952eff-aaf7-4f93-9a73-ffd9aea572d8 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:47:26.655198 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d952eff-aaf7-4f93-9a73-ffd9aea572d8 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:47:26.663151 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:47:26.711503 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b8434b-d924-4e53-a89b-0bbc4e831b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:47:26.712200 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b8434b-d924-4e53-a89b-0bbc4e831b2b admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:47:26.712490 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b8434b-d924-4e53-a89b-0bbc4e831b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:47:26.712771 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b8434b-d924-4e53-a89b-0bbc4e831b2b admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:47:26.713464 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b8434b-d924-4e53-a89b-0bbc4e831b2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:47:26.715380 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b8434b-d924-4e53-a89b-0bbc4e831b2b admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:47:26.832686 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1185/2353] 10.222.0.86 () {60 vars in 1143 bytes} [Tue Jun 7 14:47:26 2022] POST /identity/v3/users => generated 283 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:47:26.838558 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef22b95c-9ffe-415e-bf06-914baca1e746 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:47:26.848344 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef22b95c-9ffe-415e-bf06-914baca1e746 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:47:26.852900 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5686c162-8cb4-4053-b1a3-8bc886f96df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:47:26.853556 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5686c162-8cb4-4053-b1a3-8bc886f96df4 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:47:26.853844 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5686c162-8cb4-4053-b1a3-8bc886f96df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:47:26.854120 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5686c162-8cb4-4053-b1a3-8bc886f96df4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:47:26.854905 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5686c162-8cb4-4053-b1a3-8bc886f96df4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:47:26.856661 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5686c162-8cb4-4053-b1a3-8bc886f96df4 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:47:26.866638 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1169/2354] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:47:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:47:26.871184 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b8434b-d924-4e53-a89b-0bbc4e831b2b admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:47:26.880860 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b8434b-d924-4e53-a89b-0bbc4e831b2b admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:47:26.886200 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c242748d-0d72-47bc-a796-e967e8479291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:47:26.889603 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c242748d-0d72-47bc-a796-e967e8479291 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:47:26.889603 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c242748d-0d72-47bc-a796-e967e8479291 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:47:26.889603 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c242748d-0d72-47bc-a796-e967e8479291 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:47:26.889603 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c242748d-0d72-47bc-a796-e967e8479291 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:47:26.890150 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c242748d-0d72-47bc-a796-e967e8479291 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:47:26.900089 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1186/2355] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:47:26 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 07 14:47:26.904189 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5686c162-8cb4-4053-b1a3-8bc886f96df4 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:47:26.914046 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5686c162-8cb4-4053-b1a3-8bc886f96df4 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:47:26.918779 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a7d810-06fe-4c63-9755-3041ac42ee91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:47:26.924138 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a7d810-06fe-4c63-9755-3041ac42ee91 admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:47:26.924138 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a7d810-06fe-4c63-9755-3041ac42ee91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:47:26.924138 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a7d810-06fe-4c63-9755-3041ac42ee91 admin admin] PATH_INFO: `/v3/projects/775be5bac582470c8c5da2c5b05c97d5/users/6d0d59ac6701459095d70d508062c497/roles/c17acc2a8bb348f59ba7edd22fcf0c47` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:47:26.934721 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a7d810-06fe-4c63-9755-3041ac42ee91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=775be5bac582470c8c5da2c5b05c97d5, user_id=6d0d59ac6701459095d70d508062c497, role_id=c17acc2a8bb348f59ba7edd22fcf0c47)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:47:26.937380 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a7d810-06fe-4c63-9755-3041ac42ee91 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:47:27.055472 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1170/2356] 10.222.0.86 () {60 vars in 1482 bytes} [Tue Jun 7 14:47:26 2022] PUT /identity/v3/projects/775be5bac582470c8c5da2c5b05c97d5/users/6d0d59ac6701459095d70d508062c497/roles/c17acc2a8bb348f59ba7edd22fcf0c47 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:47:27.066574 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ae2e58-f9c8-4701-8992-a6b0ee61fd62 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:47:27.067151 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ae2e58-f9c8-4701-8992-a6b0ee61fd62 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:47:27.067725 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ae2e58-f9c8-4701-8992-a6b0ee61fd62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:47:27.095286 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-78ae2e58-f9c8-4701-8992-a6b0ee61fd62 None None] MFA Rules not processed for user `6d0d59ac6701459095d70d508062c497`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:47:27.096555 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-78ae2e58-f9c8-4701-8992-a6b0ee61fd62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:47:27.159842 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1187/2357] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:47:27 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:47:27.164371 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a7d810-06fe-4c63-9755-3041ac42ee91 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:47:27.225804 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a7d810-06fe-4c63-9755-3041ac42ee91 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:47:27.231079 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d83f6e-db46-401b-81df-636cfd791983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:47:27.231735 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d83f6e-db46-401b-81df-636cfd791983 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:47:27.232480 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d83f6e-db46-401b-81df-636cfd791983 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:47:27.232480 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d83f6e-db46-401b-81df-636cfd791983 admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:47:27.233034 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d83f6e-db46-401b-81df-636cfd791983 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:47:27.234916 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d83f6e-db46-401b-81df-636cfd791983 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:47:27.336027 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1171/2358] 10.222.0.86 () {60 vars in 1152 bytes} [Tue Jun 7 14:47:27 2022] POST /identity/v3/projects => generated 363 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:47:27.340226 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ae2e58-f9c8-4701-8992-a6b0ee61fd62 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:47:27.351008 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ae2e58-f9c8-4701-8992-a6b0ee61fd62 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:47:27.406993 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e6cd47-6c81-4f8e-b018-618bed03e495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:47:27.407658 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e6cd47-6c81-4f8e-b018-618bed03e495 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:47:27.408016 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e6cd47-6c81-4f8e-b018-618bed03e495 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:47:27.408280 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e6cd47-6c81-4f8e-b018-618bed03e495 admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:47:27.408968 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e6cd47-6c81-4f8e-b018-618bed03e495 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:47:27.410978 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e6cd47-6c81-4f8e-b018-618bed03e495 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:47:27.535066 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1188/2359] 10.222.0.86 () {60 vars in 1143 bytes} [Tue Jun 7 14:47:27 2022] POST /identity/v3/users => generated 288 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:47:27.539019 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d83f6e-db46-401b-81df-636cfd791983 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:47:27.549655 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d83f6e-db46-401b-81df-636cfd791983 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:47:27.554237 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659ccb16-324d-4cfb-afe3-27737f177563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:47:27.554884 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659ccb16-324d-4cfb-afe3-27737f177563 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:47:27.555170 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659ccb16-324d-4cfb-afe3-27737f177563 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:47:27.555450 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659ccb16-324d-4cfb-afe3-27737f177563 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:47:27.556220 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659ccb16-324d-4cfb-afe3-27737f177563 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:47:27.558482 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659ccb16-324d-4cfb-afe3-27737f177563 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:47:27.568757 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1172/2360] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:47:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:47:27.572796 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e6cd47-6c81-4f8e-b018-618bed03e495 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:47:27.582622 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e6cd47-6c81-4f8e-b018-618bed03e495 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:47:27.587222 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc854dc3-7da9-4d72-b448-e70c605a658d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:47:27.588665 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc854dc3-7da9-4d72-b448-e70c605a658d admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:47:27.588949 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc854dc3-7da9-4d72-b448-e70c605a658d admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:47:27.589225 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc854dc3-7da9-4d72-b448-e70c605a658d admin admin] PATH_INFO: `/v3/projects/4e09abd8f8fb4276863873fd3118c841/users/7229843714ec48d7ad02574974e6bbb1/roles/e3bf6239f5bf477b965704b086786f11` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:47:27.592269 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:47:27.604439 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc854dc3-7da9-4d72-b448-e70c605a658d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e09abd8f8fb4276863873fd3118c841, user_id=7229843714ec48d7ad02574974e6bbb1, role_id=e3bf6239f5bf477b965704b086786f11)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:47:27.607069 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc854dc3-7da9-4d72-b448-e70c605a658d admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:47:27.683427 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1189/2361] 10.222.0.86 () {60 vars in 1482 bytes} [Tue Jun 7 14:47:27 2022] PUT /identity/v3/projects/4e09abd8f8fb4276863873fd3118c841/users/7229843714ec48d7ad02574974e6bbb1/roles/e3bf6239f5bf477b965704b086786f11 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 14:47:27.687214 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659ccb16-324d-4cfb-afe3-27737f177563 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:47:27.697305 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659ccb16-324d-4cfb-afe3-27737f177563 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:47:27.753077 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277b6229-3c7e-489c-b9ed-026dc36573fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:47:27.753736 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277b6229-3c7e-489c-b9ed-026dc36573fd admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:47:27.754020 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277b6229-3c7e-489c-b9ed-026dc36573fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:47:27.754299 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277b6229-3c7e-489c-b9ed-026dc36573fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:47:27.755033 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277b6229-3c7e-489c-b9ed-026dc36573fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:47:27.756648 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277b6229-3c7e-489c-b9ed-026dc36573fd admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:47:27.766367 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1173/2362] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:47:27 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:47:27.770363 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc854dc3-7da9-4d72-b448-e70c605a658d admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:47:27.781004 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc854dc3-7da9-4d72-b448-e70c605a658d admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:47:27.785566 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d31115-e14f-4924-849b-7dfbdc3e8044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:47:27.786438 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d31115-e14f-4924-849b-7dfbdc3e8044 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:47:27.786723 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d31115-e14f-4924-849b-7dfbdc3e8044 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:47:27.787000 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d31115-e14f-4924-849b-7dfbdc3e8044 admin admin] PATH_INFO: `/v3/projects/4e09abd8f8fb4276863873fd3118c841/users/7229843714ec48d7ad02574974e6bbb1/roles/e3bf6239f5bf477b965704b086786f11` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:47:27.788953 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d31115-e14f-4924-849b-7dfbdc3e8044 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e09abd8f8fb4276863873fd3118c841, user_id=7229843714ec48d7ad02574974e6bbb1, role_id=e3bf6239f5bf477b965704b086786f11)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:47:27.792214 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d31115-e14f-4924-849b-7dfbdc3e8044 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:47:27.802160 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1190/2363] 10.222.0.86 () {60 vars in 1482 bytes} [Tue Jun 7 14:47:27 2022] PUT /identity/v3/projects/4e09abd8f8fb4276863873fd3118c841/users/7229843714ec48d7ad02574974e6bbb1/roles/e3bf6239f5bf477b965704b086786f11 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:47:27.813703 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2a576c-9f77-4286-9abb-1dd8b5fb1db1 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:47:27.814028 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2a576c-9f77-4286-9abb-1dd8b5fb1db1 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:47:27.814311 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2a576c-9f77-4286-9abb-1dd8b5fb1db1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:47:27.840266 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-4e2a576c-9f77-4286-9abb-1dd8b5fb1db1 None None] MFA Rules not processed for user `7229843714ec48d7ad02574974e6bbb1`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:47:27.841456 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-4e2a576c-9f77-4286-9abb-1dd8b5fb1db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:47:27.849466 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:47:27.908863 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1174/2364] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:47:27 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:47:27.920413 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d31115-e14f-4924-849b-7dfbdc3e8044 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:47:27.922065 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-42d31115-e14f-4924-849b-7dfbdc3e8044 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:47:27.979270 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d31115-e14f-4924-849b-7dfbdc3e8044 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:47:27.982864 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a451dc16-4313-4191-88ce-246c69097ae9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af5a95620a4b43538abfe09eed4bf115', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:47:27.983489 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a451dc16-4313-4191-88ce-246c69097ae9 service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:47:27.983784 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a451dc16-4313-4191-88ce-246c69097ae9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:47:27.984077 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a451dc16-4313-4191-88ce-246c69097ae9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:47:27.992825 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a451dc16-4313-4191-88ce-246c69097ae9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:47:27.994861 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a451dc16-4313-4191-88ce-246c69097ae9 service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:47:28.004332 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1191/2365] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:47:27 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:47:28.946232 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2a576c-9f77-4286-9abb-1dd8b5fb1db1 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:47:29.006315 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2a576c-9f77-4286-9abb-1dd8b5fb1db1 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:47:29.011717 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648317e8-cea0-4b80-9e06-6bfca727949e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:47:29.012893 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648317e8-cea0-4b80-9e06-6bfca727949e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:47:29.013173 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648317e8-cea0-4b80-9e06-6bfca727949e admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:47:29.013469 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648317e8-cea0-4b80-9e06-6bfca727949e admin admin] PATH_INFO: `/v3/users/6d0d59ac6701459095d70d508062c497` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:47:29.014618 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648317e8-cea0-4b80-9e06-6bfca727949e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d0d59ac6701459095d70d508062c497)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:47:29.016611 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648317e8-cea0-4b80-9e06-6bfca727949e admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:47:29.263130 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-648317e8-cea0-4b80-9e06-6bfca727949e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d0d59ac6701459095d70d508062c497'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:47:29.269941 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-648317e8-cea0-4b80-9e06-6bfca727949e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d0d59ac6701459095d70d508062c497'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:47:29.270608 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-648317e8-cea0-4b80-9e06-6bfca727949e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d0d59ac6701459095d70d508062c497'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:47:29.282229 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-648317e8-cea0-4b80-9e06-6bfca727949e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d0d59ac6701459095d70d508062c497'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:47:29.282839 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-648317e8-cea0-4b80-9e06-6bfca727949e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d0d59ac6701459095d70d508062c497'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:47:29.386720 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1175/2366] 10.222.0.86 () {58 vars in 1223 bytes} [Tue Jun 7 14:47:28 2022] DELETE /identity/v3/users/6d0d59ac6701459095d70d508062c497 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:47:29.391463 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d372c9b-e0d3-4f20-871f-7c483afc0c98 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:47:29.391959 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d372c9b-e0d3-4f20-871f-7c483afc0c98 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:47:29.392063 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d372c9b-e0d3-4f20-871f-7c483afc0c98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:47:29.409583 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-5d372c9b-e0d3-4f20-871f-7c483afc0c98 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:47:29.410765 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-5d372c9b-e0d3-4f20-871f-7c483afc0c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:47:29.467723 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1192/2367] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:47:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:47:29.477258 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648317e8-cea0-4b80-9e06-6bfca727949e admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:47:29.479155 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-648317e8-cea0-4b80-9e06-6bfca727949e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:47:29.507935 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:47:29.535886 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648317e8-cea0-4b80-9e06-6bfca727949e admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:47:29.539437 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df417dd6-36cf-4862-80fb-f1392adf87ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dda603ec5517460a83c333db2af804d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:47:29.540103 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df417dd6-36cf-4862-80fb-f1392adf87ca service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:47:29.540384 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df417dd6-36cf-4862-80fb-f1392adf87ca service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:47:29.541161 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df417dd6-36cf-4862-80fb-f1392adf87ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:47:29.550096 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df417dd6-36cf-4862-80fb-f1392adf87ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:47:29.551500 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df417dd6-36cf-4862-80fb-f1392adf87ca service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:47:29.561120 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1176/2368] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:47:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:47:29.999199 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d372c9b-e0d3-4f20-871f-7c483afc0c98 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:47:30.001091 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-5d372c9b-e0d3-4f20-871f-7c483afc0c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:47:30.013498 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d372c9b-e0d3-4f20-871f-7c483afc0c98 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:47:30.018048 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afc1f99-602b-4a16-a70c-6569431e9c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:47:30.018935 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afc1f99-602b-4a16-a70c-6569431e9c8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:47:30.019219 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afc1f99-602b-4a16-a70c-6569431e9c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:47:30.019491 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afc1f99-602b-4a16-a70c-6569431e9c8c admin admin] PATH_INFO: `/v3/projects/775be5bac582470c8c5da2c5b05c97d5` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:47:30.020768 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afc1f99-602b-4a16-a70c-6569431e9c8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=775be5bac582470c8c5da2c5b05c97d5)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:47:30.022669 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afc1f99-602b-4a16-a70c-6569431e9c8c admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:47:30.146226 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-8afc1f99-602b-4a16-a70c-6569431e9c8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '775be5bac582470c8c5da2c5b05c97d5', 'request_id': 'req-8afc1f99-602b-4a16-a70c-6569431e9c8c'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:47:30.152682 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-8afc1f99-602b-4a16-a70c-6569431e9c8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '775be5bac582470c8c5da2c5b05c97d5', 'request_id': 'req-8afc1f99-602b-4a16-a70c-6569431e9c8c'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:47:30.243519 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-8afc1f99-602b-4a16-a70c-6569431e9c8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '775be5bac582470c8c5da2c5b05c97d5', 'request_id': 'req-8afc1f99-602b-4a16-a70c-6569431e9c8c'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:47:30.250201 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:47:30.254731 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-8afc1f99-602b-4a16-a70c-6569431e9c8c admin admin] The token cache is being invalidate because project 775be5bac582470c8c5da2c5b05c97d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:47:30.255019 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-8afc1f99-602b-4a16-a70c-6569431e9c8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:47:30.255637 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-8afc1f99-602b-4a16-a70c-6569431e9c8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:47:30.257217 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1193/2369] 10.222.0.86 () {58 vars in 1232 bytes} [Tue Jun 7 14:47:29 2022] DELETE /identity/v3/projects/775be5bac582470c8c5da2c5b05c97d5 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:47:30.261697 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df417dd6-36cf-4862-80fb-f1392adf87ca service neutron] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:47:30.271723 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df417dd6-36cf-4862-80fb-f1392adf87ca service neutron] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:47:30.327198 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772fec8b-3281-4f4a-b1be-0142340ec687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:47:30.328122 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772fec8b-3281-4f4a-b1be-0142340ec687 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:47:30.328404 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772fec8b-3281-4f4a-b1be-0142340ec687 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:47:30.328677 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772fec8b-3281-4f4a-b1be-0142340ec687 admin admin] PATH_INFO: `/v3/users/7229843714ec48d7ad02574974e6bbb1` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:47:30.329897 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772fec8b-3281-4f4a-b1be-0142340ec687 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7229843714ec48d7ad02574974e6bbb1)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:47:30.331874 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772fec8b-3281-4f4a-b1be-0142340ec687 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:47:30.589090 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-772fec8b-3281-4f4a-b1be-0142340ec687 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7229843714ec48d7ad02574974e6bbb1'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:47:30.596031 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-772fec8b-3281-4f4a-b1be-0142340ec687 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7229843714ec48d7ad02574974e6bbb1'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:47:30.596737 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-772fec8b-3281-4f4a-b1be-0142340ec687 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7229843714ec48d7ad02574974e6bbb1'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:47:30.608469 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-772fec8b-3281-4f4a-b1be-0142340ec687 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7229843714ec48d7ad02574974e6bbb1'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:47:30.609104 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-772fec8b-3281-4f4a-b1be-0142340ec687 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7229843714ec48d7ad02574974e6bbb1'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:47:30.694663 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1177/2370] 10.222.0.86 () {58 vars in 1223 bytes} [Tue Jun 7 14:47:30 2022] DELETE /identity/v3/users/7229843714ec48d7ad02574974e6bbb1 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:47:31.107790 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afc1f99-602b-4a16-a70c-6569431e9c8c admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:47:31.109359 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-8afc1f99-602b-4a16-a70c-6569431e9c8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:47:31.122226 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afc1f99-602b-4a16-a70c-6569431e9c8c admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:47:31.178174 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2868f42-f4d1-41a6-9059-f8b16a52f445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:47:31.179026 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2868f42-f4d1-41a6-9059-f8b16a52f445 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:47:31.179302 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2868f42-f4d1-41a6-9059-f8b16a52f445 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:47:31.179604 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2868f42-f4d1-41a6-9059-f8b16a52f445 admin admin] PATH_INFO: `/v3/projects/4e09abd8f8fb4276863873fd3118c841` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:47:31.180833 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2868f42-f4d1-41a6-9059-f8b16a52f445 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e09abd8f8fb4276863873fd3118c841)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:47:31.182751 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2868f42-f4d1-41a6-9059-f8b16a52f445 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:47:31.289850 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-e2868f42-f4d1-41a6-9059-f8b16a52f445 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e09abd8f8fb4276863873fd3118c841', 'request_id': 'req-e2868f42-f4d1-41a6-9059-f8b16a52f445'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:47:31.295983 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-e2868f42-f4d1-41a6-9059-f8b16a52f445 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e09abd8f8fb4276863873fd3118c841', 'request_id': 'req-e2868f42-f4d1-41a6-9059-f8b16a52f445'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:47:31.375375 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-e2868f42-f4d1-41a6-9059-f8b16a52f445 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e09abd8f8fb4276863873fd3118c841', 'request_id': 'req-e2868f42-f4d1-41a6-9059-f8b16a52f445'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:47:31.388758 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-e2868f42-f4d1-41a6-9059-f8b16a52f445 admin admin] The token cache is being invalidate because project 4e09abd8f8fb4276863873fd3118c841 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:47:31.389051 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-e2868f42-f4d1-41a6-9059-f8b16a52f445 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:47:31.389690 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-e2868f42-f4d1-41a6-9059-f8b16a52f445 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:47:31.391577 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1194/2371] 10.222.0.86 () {58 vars in 1232 bytes} [Tue Jun 7 14:47:31 2022] DELETE /identity/v3/projects/4e09abd8f8fb4276863873fd3118c841 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:47:31.396160 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8784f5-f61e-485c-b457-9eb466f89e6d None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:47:31.396994 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8784f5-f61e-485c-b457-9eb466f89e6d None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:47:31.397286 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8784f5-f61e-485c-b457-9eb466f89e6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:47:31.415818 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-ed8784f5-f61e-485c-b457-9eb466f89e6d None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:47:31.417268 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-ed8784f5-f61e-485c-b457-9eb466f89e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:47:31.462391 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:47:31.482387 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1178/2372] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:47:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:47:31.489762 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cfebbf-f49e-4cf3-bb88-23a3e318d5eb None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:47:31.490060 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cfebbf-f49e-4cf3-bb88-23a3e318d5eb None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:47:31.490370 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cfebbf-f49e-4cf3-bb88-23a3e318d5eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:47:31.509999 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-a2cfebbf-f49e-4cf3-bb88-23a3e318d5eb None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:47:31.511227 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-a2cfebbf-f49e-4cf3-bb88-23a3e318d5eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:47:31.520002 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1195/2373] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:47:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 14:47:31.524712 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8784f5-f61e-485c-b457-9eb466f89e6d None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:47:31.534885 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8784f5-f61e-485c-b457-9eb466f89e6d None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:47:31.539502 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be8557d-6094-4efb-8b7d-7084f314ebaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:47:31.540199 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be8557d-6094-4efb-8b7d-7084f314ebaf admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:47:31.540489 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be8557d-6094-4efb-8b7d-7084f314ebaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:47:31.541328 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be8557d-6094-4efb-8b7d-7084f314ebaf admin admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:47:31.542062 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be8557d-6094-4efb-8b7d-7084f314ebaf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:47:31.542375 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be8557d-6094-4efb-8b7d-7084f314ebaf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:47:31.544089 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be8557d-6094-4efb-8b7d-7084f314ebaf admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:47:31.559233 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1179/2374] 10.222.0.86 () {58 vars in 1152 bytes} [Tue Jun 7 14:47:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:47:31.560487 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cfebbf-f49e-4cf3-bb88-23a3e318d5eb None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:47:31.571578 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cfebbf-f49e-4cf3-bb88-23a3e318d5eb None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:47:31.576311 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0773f1e1-062a-46e8-a005-64d92675db14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:47:31.576966 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0773f1e1-062a-46e8-a005-64d92675db14 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:47:31.577247 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0773f1e1-062a-46e8-a005-64d92675db14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:47:31.577520 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0773f1e1-062a-46e8-a005-64d92675db14 admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:47:31.578311 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0773f1e1-062a-46e8-a005-64d92675db14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:47:31.580663 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0773f1e1-062a-46e8-a005-64d92675db14 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:47:31.678827 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1196/2375] 10.222.0.86 () {60 vars in 1152 bytes} [Tue Jun 7 14:47:31 2022] POST /identity/v3/projects => generated 369 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:47:31.682893 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be8557d-6094-4efb-8b7d-7084f314ebaf admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:47:31.692746 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be8557d-6094-4efb-8b7d-7084f314ebaf admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:47:31.747951 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765998cb-ec0a-4718-940c-e24ad279df92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:47:31.748535 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765998cb-ec0a-4718-940c-e24ad279df92 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:47:31.748823 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765998cb-ec0a-4718-940c-e24ad279df92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:47:31.749106 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765998cb-ec0a-4718-940c-e24ad279df92 admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:47:31.749816 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765998cb-ec0a-4718-940c-e24ad279df92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:47:31.751703 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765998cb-ec0a-4718-940c-e24ad279df92 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:47:31.855610 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1180/2376] 10.222.0.86 () {60 vars in 1143 bytes} [Tue Jun 7 14:47:31 2022] POST /identity/v3/users => generated 285 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 14:47:31.859731 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0773f1e1-062a-46e8-a005-64d92675db14 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:47:31.870968 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0773f1e1-062a-46e8-a005-64d92675db14 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:47:31.875742 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dd7bc5-ee93-4ad6-ac2e-2ccdd745c79b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:47:31.876483 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dd7bc5-ee93-4ad6-ac2e-2ccdd745c79b admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:47:31.876770 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dd7bc5-ee93-4ad6-ac2e-2ccdd745c79b admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:47:31.877052 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dd7bc5-ee93-4ad6-ac2e-2ccdd745c79b admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:47:31.877785 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dd7bc5-ee93-4ad6-ac2e-2ccdd745c79b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:47:31.879380 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dd7bc5-ee93-4ad6-ac2e-2ccdd745c79b admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:47:31.890170 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1197/2377] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:47:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:47:31.893884 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765998cb-ec0a-4718-940c-e24ad279df92 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:47:31.903514 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765998cb-ec0a-4718-940c-e24ad279df92 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:47:31.908077 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7457799-8c48-4557-b587-c5112a45a235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:47:31.908721 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7457799-8c48-4557-b587-c5112a45a235 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:47:31.909002 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7457799-8c48-4557-b587-c5112a45a235 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:47:31.909279 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7457799-8c48-4557-b587-c5112a45a235 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:47:31.910000 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7457799-8c48-4557-b587-c5112a45a235 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:47:31.911557 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7457799-8c48-4557-b587-c5112a45a235 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:47:31.921684 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1181/2378] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:47:31 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:47:31.925558 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dd7bc5-ee93-4ad6-ac2e-2ccdd745c79b admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:47:31.936122 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dd7bc5-ee93-4ad6-ac2e-2ccdd745c79b admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:47:31.940765 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba72d33-9ead-4a80-9f56-0af6ba43498a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:47:31.941625 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba72d33-9ead-4a80-9f56-0af6ba43498a admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:47:31.941915 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba72d33-9ead-4a80-9f56-0af6ba43498a admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:47:31.942192 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba72d33-9ead-4a80-9f56-0af6ba43498a admin admin] PATH_INFO: `/v3/projects/fa575a16a4c54593b22e518e5499e581/users/d159a3400c904956aba284a9298930b9/roles/c17acc2a8bb348f59ba7edd22fcf0c47` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:47:31.956428 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba72d33-9ead-4a80-9f56-0af6ba43498a admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa575a16a4c54593b22e518e5499e581, user_id=d159a3400c904956aba284a9298930b9, role_id=c17acc2a8bb348f59ba7edd22fcf0c47)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:47:31.959109 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba72d33-9ead-4a80-9f56-0af6ba43498a admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:47:32.054818 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1198/2379] 10.222.0.86 () {60 vars in 1482 bytes} [Tue Jun 7 14:47:31 2022] PUT /identity/v3/projects/fa575a16a4c54593b22e518e5499e581/users/d159a3400c904956aba284a9298930b9/roles/c17acc2a8bb348f59ba7edd22fcf0c47 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:47:32.066788 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d873eb-0de2-4400-823c-24e94784e71d None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:47:32.070071 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d873eb-0de2-4400-823c-24e94784e71d None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:47:32.070071 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d873eb-0de2-4400-823c-24e94784e71d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:47:32.094120 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-72d873eb-0de2-4400-823c-24e94784e71d None None] MFA Rules not processed for user `d159a3400c904956aba284a9298930b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:47:32.095381 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-72d873eb-0de2-4400-823c-24e94784e71d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:47:32.158300 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1182/2380] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:47:32 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:47:32.162779 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba72d33-9ead-4a80-9f56-0af6ba43498a admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:47:32.189588 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:47:32.225250 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba72d33-9ead-4a80-9f56-0af6ba43498a admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:47:32.230592 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45c4e97-5af8-43fb-b67a-3c692bce7011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:47:32.231260 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45c4e97-5af8-43fb-b67a-3c692bce7011 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:47:32.231550 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45c4e97-5af8-43fb-b67a-3c692bce7011 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:47:32.231860 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45c4e97-5af8-43fb-b67a-3c692bce7011 admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:47:32.233012 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45c4e97-5af8-43fb-b67a-3c692bce7011 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:47:32.234453 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45c4e97-5af8-43fb-b67a-3c692bce7011 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:47:32.318566 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1199/2381] 10.222.0.86 () {60 vars in 1152 bytes} [Tue Jun 7 14:47:32 2022] POST /identity/v3/projects => generated 369 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:47:32.322912 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d873eb-0de2-4400-823c-24e94784e71d None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:47:32.333966 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d873eb-0de2-4400-823c-24e94784e71d None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:47:32.373702 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:47:32.389437 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697adbcf-9e46-4bb2-bd19-4232a69a876e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:47:32.390093 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697adbcf-9e46-4bb2-bd19-4232a69a876e admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:47:32.390376 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697adbcf-9e46-4bb2-bd19-4232a69a876e admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:47:32.390651 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697adbcf-9e46-4bb2-bd19-4232a69a876e admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:47:32.391521 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697adbcf-9e46-4bb2-bd19-4232a69a876e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:47:32.393449 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697adbcf-9e46-4bb2-bd19-4232a69a876e admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:47:32.471875 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1183/2382] 10.222.0.86 () {60 vars in 1143 bytes} [Tue Jun 7 14:47:32 2022] POST /identity/v3/users => generated 291 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 14:47:32.475978 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45c4e97-5af8-43fb-b67a-3c692bce7011 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:47:32.486743 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45c4e97-5af8-43fb-b67a-3c692bce7011 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:47:32.491488 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abb00ab-766d-433f-8070-ee8665096935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:47:32.492225 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abb00ab-766d-433f-8070-ee8665096935 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:47:32.492619 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abb00ab-766d-433f-8070-ee8665096935 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:47:32.492906 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abb00ab-766d-433f-8070-ee8665096935 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:47:32.493631 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abb00ab-766d-433f-8070-ee8665096935 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:47:32.495217 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abb00ab-766d-433f-8070-ee8665096935 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:47:32.505813 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1200/2383] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:47:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:47:32.510626 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697adbcf-9e46-4bb2-bd19-4232a69a876e admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:47:32.521005 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697adbcf-9e46-4bb2-bd19-4232a69a876e admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:47:32.526260 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef6ee1c-5952-4005-a5e7-02d9a776596d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:47:32.527131 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef6ee1c-5952-4005-a5e7-02d9a776596d admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:47:32.527409 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef6ee1c-5952-4005-a5e7-02d9a776596d admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:47:32.527686 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef6ee1c-5952-4005-a5e7-02d9a776596d admin admin] PATH_INFO: `/v3/projects/1b2dce25adfc43baaf030099ed3de0f0/users/17140b5ad3a44d83b6c86e0abac8c5c1/roles/e3bf6239f5bf477b965704b086786f11` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:47:32.542247 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef6ee1c-5952-4005-a5e7-02d9a776596d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b2dce25adfc43baaf030099ed3de0f0, user_id=17140b5ad3a44d83b6c86e0abac8c5c1, role_id=e3bf6239f5bf477b965704b086786f11)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:47:32.544963 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef6ee1c-5952-4005-a5e7-02d9a776596d admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:47:32.614601 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1184/2384] 10.222.0.86 () {60 vars in 1482 bytes} [Tue Jun 7 14:47:32 2022] PUT /identity/v3/projects/1b2dce25adfc43baaf030099ed3de0f0/users/17140b5ad3a44d83b6c86e0abac8c5c1/roles/e3bf6239f5bf477b965704b086786f11 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:47:32.618421 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abb00ab-766d-433f-8070-ee8665096935 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:47:32.628377 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abb00ab-766d-433f-8070-ee8665096935 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:47:32.684530 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5b477b-ec7b-4815-af6c-22b43e9c88ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:47:32.685253 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5b477b-ec7b-4815-af6c-22b43e9c88ed admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:47:32.685539 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5b477b-ec7b-4815-af6c-22b43e9c88ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:47:32.685819 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5b477b-ec7b-4815-af6c-22b43e9c88ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:47:32.686589 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5b477b-ec7b-4815-af6c-22b43e9c88ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:47:32.688281 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5b477b-ec7b-4815-af6c-22b43e9c88ed admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:47:32.698741 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1201/2385] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:47:32 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:47:32.702891 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef6ee1c-5952-4005-a5e7-02d9a776596d admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:47:32.713746 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef6ee1c-5952-4005-a5e7-02d9a776596d admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:47:32.718852 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f160d144-478a-4c25-8f92-a4c160d759c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:47:32.719829 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f160d144-478a-4c25-8f92-a4c160d759c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:47:32.720168 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f160d144-478a-4c25-8f92-a4c160d759c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:47:32.720552 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f160d144-478a-4c25-8f92-a4c160d759c6 admin admin] PATH_INFO: `/v3/projects/1b2dce25adfc43baaf030099ed3de0f0/users/17140b5ad3a44d83b6c86e0abac8c5c1/roles/e3bf6239f5bf477b965704b086786f11` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:47:32.722809 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f160d144-478a-4c25-8f92-a4c160d759c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b2dce25adfc43baaf030099ed3de0f0, user_id=17140b5ad3a44d83b6c86e0abac8c5c1, role_id=e3bf6239f5bf477b965704b086786f11)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:47:32.725861 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f160d144-478a-4c25-8f92-a4c160d759c6 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:47:32.736345 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1185/2386] 10.222.0.86 () {60 vars in 1482 bytes} [Tue Jun 7 14:47:32 2022] PUT /identity/v3/projects/1b2dce25adfc43baaf030099ed3de0f0/users/17140b5ad3a44d83b6c86e0abac8c5c1/roles/e3bf6239f5bf477b965704b086786f11 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:47:32.746495 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2697ed4-3ff7-4242-9f69-dd7176784eb6 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:47:32.746791 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2697ed4-3ff7-4242-9f69-dd7176784eb6 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:47:32.747099 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2697ed4-3ff7-4242-9f69-dd7176784eb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:47:32.775184 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-e2697ed4-3ff7-4242-9f69-dd7176784eb6 None None] MFA Rules not processed for user `17140b5ad3a44d83b6c86e0abac8c5c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:47:32.776431 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-e2697ed4-3ff7-4242-9f69-dd7176784eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:47:32.843960 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1202/2387] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:47:32 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:47:32.861110 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f160d144-478a-4c25-8f92-a4c160d759c6 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:47:32.862871 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-f160d144-478a-4c25-8f92-a4c160d759c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:47:32.919896 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f160d144-478a-4c25-8f92-a4c160d759c6 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:47:32.923421 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c919a358-9017-4092-9b3b-d9802fe9a331 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af5a95620a4b43538abfe09eed4bf115', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:47:32.924082 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c919a358-9017-4092-9b3b-d9802fe9a331 service cinder] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:47:32.924370 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c919a358-9017-4092-9b3b-d9802fe9a331 service cinder] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:47:32.924645 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c919a358-9017-4092-9b3b-d9802fe9a331 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:47:32.933435 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c919a358-9017-4092-9b3b-d9802fe9a331 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:47:32.934855 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c919a358-9017-4092-9b3b-d9802fe9a331 service cinder] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:47:32.944274 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1186/2388] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:47:32 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:47:33.067951 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2697ed4-3ff7-4242-9f69-dd7176784eb6 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:47:33.069337 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-e2697ed4-3ff7-4242-9f69-dd7176784eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:47:33.081384 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2697ed4-3ff7-4242-9f69-dd7176784eb6 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:47:33.085116 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c97478d-06e2-4602-aa11-d8a2a3196be4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af5a95620a4b43538abfe09eed4bf115', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:47:33.085800 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c97478d-06e2-4602-aa11-d8a2a3196be4 service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:47:33.086090 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c97478d-06e2-4602-aa11-d8a2a3196be4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:47:33.086378 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c97478d-06e2-4602-aa11-d8a2a3196be4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:47:33.104452 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:47:33.143334 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c97478d-06e2-4602-aa11-d8a2a3196be4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:47:33.144811 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c97478d-06e2-4602-aa11-d8a2a3196be4 service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:47:33.154648 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1203/2389] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:47:33 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:47:38.144172 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c919a358-9017-4092-9b3b-d9802fe9a331 service cinder] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:47:38.210645 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c919a358-9017-4092-9b3b-d9802fe9a331 service cinder] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:47:38.215716 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac1a57b-fbbd-43e5-ba08-b232d592b197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:47:38.216638 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac1a57b-fbbd-43e5-ba08-b232d592b197 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:47:38.217074 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac1a57b-fbbd-43e5-ba08-b232d592b197 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:47:38.217320 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac1a57b-fbbd-43e5-ba08-b232d592b197 admin admin] PATH_INFO: `/v3/users/d159a3400c904956aba284a9298930b9` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:47:38.218602 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac1a57b-fbbd-43e5-ba08-b232d592b197 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d159a3400c904956aba284a9298930b9)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:47:38.220603 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac1a57b-fbbd-43e5-ba08-b232d592b197 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:47:38.394789 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:47:38.401034 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-0ac1a57b-fbbd-43e5-ba08-b232d592b197 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd159a3400c904956aba284a9298930b9'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:47:38.408168 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-0ac1a57b-fbbd-43e5-ba08-b232d592b197 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd159a3400c904956aba284a9298930b9'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:47:38.408868 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-0ac1a57b-fbbd-43e5-ba08-b232d592b197 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd159a3400c904956aba284a9298930b9'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:47:38.420664 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-0ac1a57b-fbbd-43e5-ba08-b232d592b197 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd159a3400c904956aba284a9298930b9'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:47:38.421307 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-0ac1a57b-fbbd-43e5-ba08-b232d592b197 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd159a3400c904956aba284a9298930b9'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:47:38.501522 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1187/2390] 10.222.0.86 () {58 vars in 1223 bytes} [Tue Jun 7 14:47:38 2022] DELETE /identity/v3/users/d159a3400c904956aba284a9298930b9 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:47:38.506465 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbb8506-7d7c-4ea4-91c2-e31cd4dc9a10 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:47:38.506951 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbb8506-7d7c-4ea4-91c2-e31cd4dc9a10 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:47:38.507067 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbb8506-7d7c-4ea4-91c2-e31cd4dc9a10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:47:38.524253 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-5bbb8506-7d7c-4ea4-91c2-e31cd4dc9a10 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:47:38.525487 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-5bbb8506-7d7c-4ea4-91c2-e31cd4dc9a10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:47:38.586262 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1204/2391] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:47:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:47:38.596358 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac1a57b-fbbd-43e5-ba08-b232d592b197 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:47:38.597847 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-0ac1a57b-fbbd-43e5-ba08-b232d592b197 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:47:38.658993 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac1a57b-fbbd-43e5-ba08-b232d592b197 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:47:38.662734 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e9e04e-e9ab-4574-b787-b78911d5ed9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dda603ec5517460a83c333db2af804d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:47:38.663392 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e9e04e-e9ab-4574-b787-b78911d5ed9f service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:47:38.663666 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e9e04e-e9ab-4574-b787-b78911d5ed9f service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:47:38.663975 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e9e04e-e9ab-4574-b787-b78911d5ed9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:47:38.673735 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e9e04e-e9ab-4574-b787-b78911d5ed9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:47:38.675181 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e9e04e-e9ab-4574-b787-b78911d5ed9f service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:47:38.685558 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1188/2392] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:47:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:47:39.154030 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbb8506-7d7c-4ea4-91c2-e31cd4dc9a10 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:47:39.155474 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-5bbb8506-7d7c-4ea4-91c2-e31cd4dc9a10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:47:39.168017 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbb8506-7d7c-4ea4-91c2-e31cd4dc9a10 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:47:39.172593 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fc3b0f-1714-4c90-bc9e-ac6445994c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:47:39.173461 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fc3b0f-1714-4c90-bc9e-ac6445994c5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:47:39.173740 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fc3b0f-1714-4c90-bc9e-ac6445994c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:47:39.174014 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fc3b0f-1714-4c90-bc9e-ac6445994c5c admin admin] PATH_INFO: `/v3/projects/fa575a16a4c54593b22e518e5499e581` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:47:39.175294 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fc3b0f-1714-4c90-bc9e-ac6445994c5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa575a16a4c54593b22e518e5499e581)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:47:39.177218 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fc3b0f-1714-4c90-bc9e-ac6445994c5c admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:47:39.318800 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-50fc3b0f-1714-4c90-bc9e-ac6445994c5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa575a16a4c54593b22e518e5499e581', 'request_id': 'req-50fc3b0f-1714-4c90-bc9e-ac6445994c5c'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:47:39.325035 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-50fc3b0f-1714-4c90-bc9e-ac6445994c5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa575a16a4c54593b22e518e5499e581', 'request_id': 'req-50fc3b0f-1714-4c90-bc9e-ac6445994c5c'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:47:39.414899 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-50fc3b0f-1714-4c90-bc9e-ac6445994c5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa575a16a4c54593b22e518e5499e581', 'request_id': 'req-50fc3b0f-1714-4c90-bc9e-ac6445994c5c'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:47:39.426523 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-50fc3b0f-1714-4c90-bc9e-ac6445994c5c admin admin] The token cache is being invalidate because project fa575a16a4c54593b22e518e5499e581 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:47:39.426892 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-50fc3b0f-1714-4c90-bc9e-ac6445994c5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:47:39.427525 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-50fc3b0f-1714-4c90-bc9e-ac6445994c5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:47:39.429080 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1205/2393] 10.222.0.86 () {58 vars in 1232 bytes} [Tue Jun 7 14:47:39 2022] DELETE /identity/v3/projects/fa575a16a4c54593b22e518e5499e581 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:47:39.433591 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e9e04e-e9ab-4574-b787-b78911d5ed9f service neutron] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:47:39.443109 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e9e04e-e9ab-4574-b787-b78911d5ed9f service neutron] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:47:39.497423 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae9b13a-fcbc-4753-9298-c9d031e314a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:47:39.498281 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae9b13a-fcbc-4753-9298-c9d031e314a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:47:39.498563 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae9b13a-fcbc-4753-9298-c9d031e314a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:47:39.498853 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae9b13a-fcbc-4753-9298-c9d031e314a3 admin admin] PATH_INFO: `/v3/users/17140b5ad3a44d83b6c86e0abac8c5c1` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:47:39.500055 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae9b13a-fcbc-4753-9298-c9d031e314a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17140b5ad3a44d83b6c86e0abac8c5c1)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:47:39.501986 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae9b13a-fcbc-4753-9298-c9d031e314a3 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:47:39.662673 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-0ae9b13a-fcbc-4753-9298-c9d031e314a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17140b5ad3a44d83b6c86e0abac8c5c1'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:47:39.670173 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-0ae9b13a-fcbc-4753-9298-c9d031e314a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17140b5ad3a44d83b6c86e0abac8c5c1'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:47:39.670826 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-0ae9b13a-fcbc-4753-9298-c9d031e314a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17140b5ad3a44d83b6c86e0abac8c5c1'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:47:39.675339 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:47:39.683278 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-0ae9b13a-fcbc-4753-9298-c9d031e314a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17140b5ad3a44d83b6c86e0abac8c5c1'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:47:39.683972 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-0ae9b13a-fcbc-4753-9298-c9d031e314a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17140b5ad3a44d83b6c86e0abac8c5c1'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:47:39.734541 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1189/2394] 10.222.0.86 () {58 vars in 1223 bytes} [Tue Jun 7 14:47:39 2022] DELETE /identity/v3/users/17140b5ad3a44d83b6c86e0abac8c5c1 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:47:40.199801 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fc3b0f-1714-4c90-bc9e-ac6445994c5c admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:47:40.206606 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-50fc3b0f-1714-4c90-bc9e-ac6445994c5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:47:40.215786 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fc3b0f-1714-4c90-bc9e-ac6445994c5c admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:47:40.256869 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:47:40.273808 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c8e65b-9264-4ddf-b2c0-02fe9048e128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:47:40.274696 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c8e65b-9264-4ddf-b2c0-02fe9048e128 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:47:40.275517 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c8e65b-9264-4ddf-b2c0-02fe9048e128 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:47:40.275965 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c8e65b-9264-4ddf-b2c0-02fe9048e128 admin admin] PATH_INFO: `/v3/projects/1b2dce25adfc43baaf030099ed3de0f0` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:47:40.277158 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c8e65b-9264-4ddf-b2c0-02fe9048e128 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b2dce25adfc43baaf030099ed3de0f0)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:47:40.279092 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c8e65b-9264-4ddf-b2c0-02fe9048e128 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:47:40.409331 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-61c8e65b-9264-4ddf-b2c0-02fe9048e128 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b2dce25adfc43baaf030099ed3de0f0', 'request_id': 'req-61c8e65b-9264-4ddf-b2c0-02fe9048e128'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:47:40.415450 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-61c8e65b-9264-4ddf-b2c0-02fe9048e128 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b2dce25adfc43baaf030099ed3de0f0', 'request_id': 'req-61c8e65b-9264-4ddf-b2c0-02fe9048e128'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:47:40.500868 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-61c8e65b-9264-4ddf-b2c0-02fe9048e128 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b2dce25adfc43baaf030099ed3de0f0', 'request_id': 'req-61c8e65b-9264-4ddf-b2c0-02fe9048e128'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:47:40.513032 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-61c8e65b-9264-4ddf-b2c0-02fe9048e128 admin admin] The token cache is being invalidate because project 1b2dce25adfc43baaf030099ed3de0f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:47:40.513314 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-61c8e65b-9264-4ddf-b2c0-02fe9048e128 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:47:40.513948 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-61c8e65b-9264-4ddf-b2c0-02fe9048e128 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:47:40.515537 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1206/2395] 10.222.0.86 () {58 vars in 1232 bytes} [Tue Jun 7 14:47:40 2022] DELETE /identity/v3/projects/1b2dce25adfc43baaf030099ed3de0f0 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:47:40.521255 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f0bd2d-824f-422f-bdf5-e0a27672c706 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:47:40.521774 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f0bd2d-824f-422f-bdf5-e0a27672c706 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:47:40.521774 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f0bd2d-824f-422f-bdf5-e0a27672c706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:47:40.539534 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-c4f0bd2d-824f-422f-bdf5-e0a27672c706 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:47:40.540788 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-c4f0bd2d-824f-422f-bdf5-e0a27672c706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:47:40.599065 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1190/2396] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:47:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:47:40.606984 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c4f37d-9fe5-4f87-b185-3be2c00cdb1a None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:47:40.610335 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c4f37d-9fe5-4f87-b185-3be2c00cdb1a None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:47:40.610335 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c4f37d-9fe5-4f87-b185-3be2c00cdb1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:47:40.626199 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-f2c4f37d-9fe5-4f87-b185-3be2c00cdb1a None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:47:40.627400 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-f2c4f37d-9fe5-4f87-b185-3be2c00cdb1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:47:40.635822 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1207/2397] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:47:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:47:40.640271 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f0bd2d-824f-422f-bdf5-e0a27672c706 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:47:40.649854 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f0bd2d-824f-422f-bdf5-e0a27672c706 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:47:40.654357 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b5e2fe-0458-4462-a41c-4a61f817e700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:47:40.655006 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b5e2fe-0458-4462-a41c-4a61f817e700 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:47:40.655293 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b5e2fe-0458-4462-a41c-4a61f817e700 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:47:40.655572 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b5e2fe-0458-4462-a41c-4a61f817e700 admin admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:47:40.656341 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b5e2fe-0458-4462-a41c-4a61f817e700 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:47:40.656652 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b5e2fe-0458-4462-a41c-4a61f817e700 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:47:40.658243 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b5e2fe-0458-4462-a41c-4a61f817e700 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:47:40.669569 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1191/2398] 10.222.0.86 () {58 vars in 1152 bytes} [Tue Jun 7 14:47:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:47:40.673781 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c4f37d-9fe5-4f87-b185-3be2c00cdb1a None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:47:40.683536 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c4f37d-9fe5-4f87-b185-3be2c00cdb1a None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:47:40.688212 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062c1f82-7997-4c39-b813-92f13174df95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:47:40.688858 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062c1f82-7997-4c39-b813-92f13174df95 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:47:40.689147 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062c1f82-7997-4c39-b813-92f13174df95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:47:40.689428 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062c1f82-7997-4c39-b813-92f13174df95 admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:47:40.690122 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062c1f82-7997-4c39-b813-92f13174df95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:47:40.692052 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062c1f82-7997-4c39-b813-92f13174df95 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:47:40.770529 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1208/2399] 10.222.0.86 () {60 vars in 1152 bytes} [Tue Jun 7 14:47:40 2022] POST /identity/v3/projects => generated 405 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:47:40.774349 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b5e2fe-0458-4462-a41c-4a61f817e700 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:47:40.784410 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b5e2fe-0458-4462-a41c-4a61f817e700 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:47:40.840118 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1031f4-5fad-485b-bcf1-8f12dddd4808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:47:40.840777 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1031f4-5fad-485b-bcf1-8f12dddd4808 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:47:40.841064 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1031f4-5fad-485b-bcf1-8f12dddd4808 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:47:40.841342 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1031f4-5fad-485b-bcf1-8f12dddd4808 admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:47:40.842042 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1031f4-5fad-485b-bcf1-8f12dddd4808 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:47:40.843953 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1031f4-5fad-485b-bcf1-8f12dddd4808 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:47:40.912011 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1192/2400] 10.222.0.86 () {60 vars in 1143 bytes} [Tue Jun 7 14:47:40 2022] POST /identity/v3/users => generated 303 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:47:40.916619 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062c1f82-7997-4c39-b813-92f13174df95 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:47:40.926925 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062c1f82-7997-4c39-b813-92f13174df95 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:47:40.932337 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9d4f14-8742-4cc5-993d-5624e687a1a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:47:40.933002 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9d4f14-8742-4cc5-993d-5624e687a1a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:47:40.933286 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9d4f14-8742-4cc5-993d-5624e687a1a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:47:40.933560 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9d4f14-8742-4cc5-993d-5624e687a1a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:47:40.934282 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9d4f14-8742-4cc5-993d-5624e687a1a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:47:40.935923 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9d4f14-8742-4cc5-993d-5624e687a1a5 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:47:40.946596 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1209/2401] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:47:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:47:40.951674 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1031f4-5fad-485b-bcf1-8f12dddd4808 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:47:40.961973 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1031f4-5fad-485b-bcf1-8f12dddd4808 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:47:40.966780 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e18ff04-3792-4c18-8ab7-8795a1e4b61b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:47:40.967430 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e18ff04-3792-4c18-8ab7-8795a1e4b61b admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:47:40.967782 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e18ff04-3792-4c18-8ab7-8795a1e4b61b admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:47:40.968074 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e18ff04-3792-4c18-8ab7-8795a1e4b61b admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:47:40.968807 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e18ff04-3792-4c18-8ab7-8795a1e4b61b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:47:40.970389 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e18ff04-3792-4c18-8ab7-8795a1e4b61b admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:47:40.981243 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1193/2402] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:47:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:47:40.985041 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9d4f14-8742-4cc5-993d-5624e687a1a5 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:47:40.995730 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9d4f14-8742-4cc5-993d-5624e687a1a5 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:47:41.001909 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ab2e39-6931-4b4c-8286-85e502c731f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:47:41.002866 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ab2e39-6931-4b4c-8286-85e502c731f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:47:41.003251 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ab2e39-6931-4b4c-8286-85e502c731f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:47:41.003415 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ab2e39-6931-4b4c-8286-85e502c731f7 admin admin] PATH_INFO: `/v3/projects/420b874fefd041ec9e7b8c44bf8a3eb8/users/965f41283b754b4ca57cc11775397cbc/roles/c17acc2a8bb348f59ba7edd22fcf0c47` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:47:41.018549 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ab2e39-6931-4b4c-8286-85e502c731f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=420b874fefd041ec9e7b8c44bf8a3eb8, user_id=965f41283b754b4ca57cc11775397cbc, role_id=c17acc2a8bb348f59ba7edd22fcf0c47)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:47:41.021141 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ab2e39-6931-4b4c-8286-85e502c731f7 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:47:41.100924 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1210/2403] 10.222.0.86 () {60 vars in 1482 bytes} [Tue Jun 7 14:47:40 2022] PUT /identity/v3/projects/420b874fefd041ec9e7b8c44bf8a3eb8/users/965f41283b754b4ca57cc11775397cbc/roles/c17acc2a8bb348f59ba7edd22fcf0c47 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 14:47:41.112100 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5dd15a-c383-498f-b530-6f8a92948f68 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:47:41.112395 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5dd15a-c383-498f-b530-6f8a92948f68 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:47:41.112677 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5dd15a-c383-498f-b530-6f8a92948f68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:47:41.139771 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-ad5dd15a-c383-498f-b530-6f8a92948f68 None None] MFA Rules not processed for user `965f41283b754b4ca57cc11775397cbc`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:47:41.141035 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-ad5dd15a-c383-498f-b530-6f8a92948f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:47:41.172779 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:47:41.205257 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1194/2404] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:47:41 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:47:41.209744 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ab2e39-6931-4b4c-8286-85e502c731f7 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:47:41.271633 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ab2e39-6931-4b4c-8286-85e502c731f7 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:47:41.276272 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48686bd4-6904-4f6a-b838-57ccb4c78677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:47:41.276930 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48686bd4-6904-4f6a-b838-57ccb4c78677 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:47:41.277216 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48686bd4-6904-4f6a-b838-57ccb4c78677 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:47:41.277496 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48686bd4-6904-4f6a-b838-57ccb4c78677 admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:47:41.278198 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48686bd4-6904-4f6a-b838-57ccb4c78677 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:47:41.280130 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48686bd4-6904-4f6a-b838-57ccb4c78677 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:47:41.292787 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:47:41.376222 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1211/2405] 10.222.0.86 () {60 vars in 1152 bytes} [Tue Jun 7 14:47:41 2022] POST /identity/v3/projects => generated 409 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:47:41.380517 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5dd15a-c383-498f-b530-6f8a92948f68 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:47:41.392059 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5dd15a-c383-498f-b530-6f8a92948f68 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:47:41.448172 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5208b878-ee95-43b8-a7b6-08c899e15508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:47:41.448920 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5208b878-ee95-43b8-a7b6-08c899e15508 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:47:41.449259 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5208b878-ee95-43b8-a7b6-08c899e15508 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:47:41.449537 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5208b878-ee95-43b8-a7b6-08c899e15508 admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:47:41.450224 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5208b878-ee95-43b8-a7b6-08c899e15508 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:47:41.452145 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5208b878-ee95-43b8-a7b6-08c899e15508 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:47:41.558903 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1195/2406] 10.222.0.86 () {60 vars in 1143 bytes} [Tue Jun 7 14:47:41 2022] POST /identity/v3/users => generated 311 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 14:47:41.562938 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48686bd4-6904-4f6a-b838-57ccb4c78677 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:47:41.573220 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48686bd4-6904-4f6a-b838-57ccb4c78677 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:47:41.578031 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17bc783-ebe7-498a-9c9e-47c996d252bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:47:41.578689 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17bc783-ebe7-498a-9c9e-47c996d252bd admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:47:41.578972 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17bc783-ebe7-498a-9c9e-47c996d252bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:47:41.579249 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17bc783-ebe7-498a-9c9e-47c996d252bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:47:41.580044 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17bc783-ebe7-498a-9c9e-47c996d252bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:47:41.581641 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17bc783-ebe7-498a-9c9e-47c996d252bd admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:47:41.592324 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1212/2407] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:47:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:47:41.596479 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5208b878-ee95-43b8-a7b6-08c899e15508 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:47:41.607294 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5208b878-ee95-43b8-a7b6-08c899e15508 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:47:41.612067 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a491dcaa-f398-4ffb-b460-f934a0a3dfff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:47:41.612941 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a491dcaa-f398-4ffb-b460-f934a0a3dfff admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:47:41.613228 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a491dcaa-f398-4ffb-b460-f934a0a3dfff admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:47:41.613535 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a491dcaa-f398-4ffb-b460-f934a0a3dfff admin admin] PATH_INFO: `/v3/projects/3e19ac763ce042a7bc3691e977f18d32/users/2cf35bdba5fa44139f27ab9c78deef02/roles/e3bf6239f5bf477b965704b086786f11` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:47:41.628891 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a491dcaa-f398-4ffb-b460-f934a0a3dfff admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e19ac763ce042a7bc3691e977f18d32, user_id=2cf35bdba5fa44139f27ab9c78deef02, role_id=e3bf6239f5bf477b965704b086786f11)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:47:41.631535 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a491dcaa-f398-4ffb-b460-f934a0a3dfff admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:47:41.718122 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1196/2408] 10.222.0.86 () {60 vars in 1482 bytes} [Tue Jun 7 14:47:41 2022] PUT /identity/v3/projects/3e19ac763ce042a7bc3691e977f18d32/users/2cf35bdba5fa44139f27ab9c78deef02/roles/e3bf6239f5bf477b965704b086786f11 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:47:41.722310 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17bc783-ebe7-498a-9c9e-47c996d252bd admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:47:41.732693 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17bc783-ebe7-498a-9c9e-47c996d252bd admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:47:41.789455 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98d892e-4dbe-4c7f-a05a-74fb5b762025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:47:41.790123 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98d892e-4dbe-4c7f-a05a-74fb5b762025 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:47:41.790923 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98d892e-4dbe-4c7f-a05a-74fb5b762025 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:47:41.791204 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98d892e-4dbe-4c7f-a05a-74fb5b762025 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:47:41.791957 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98d892e-4dbe-4c7f-a05a-74fb5b762025 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:47:41.793556 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98d892e-4dbe-4c7f-a05a-74fb5b762025 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:47:41.803699 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1213/2409] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:47:41 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:47:41.812638 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a491dcaa-f398-4ffb-b460-f934a0a3dfff admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:47:41.823258 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a491dcaa-f398-4ffb-b460-f934a0a3dfff admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:47:41.827917 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abc68e1-46a9-4bbb-a114-985a170363dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:47:41.828861 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abc68e1-46a9-4bbb-a114-985a170363dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:47:41.832359 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abc68e1-46a9-4bbb-a114-985a170363dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:47:41.832359 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abc68e1-46a9-4bbb-a114-985a170363dd admin admin] PATH_INFO: `/v3/projects/3e19ac763ce042a7bc3691e977f18d32/users/2cf35bdba5fa44139f27ab9c78deef02/roles/e3bf6239f5bf477b965704b086786f11` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:47:41.832359 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abc68e1-46a9-4bbb-a114-985a170363dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e19ac763ce042a7bc3691e977f18d32, user_id=2cf35bdba5fa44139f27ab9c78deef02, role_id=e3bf6239f5bf477b965704b086786f11)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:47:41.833982 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abc68e1-46a9-4bbb-a114-985a170363dd admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:47:41.844542 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1197/2410] 10.222.0.86 () {60 vars in 1482 bytes} [Tue Jun 7 14:47:41 2022] PUT /identity/v3/projects/3e19ac763ce042a7bc3691e977f18d32/users/2cf35bdba5fa44139f27ab9c78deef02/roles/e3bf6239f5bf477b965704b086786f11 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:47:41.855230 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceb3cfa-3aae-43c7-9669-3a01b4620b9b None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:47:41.855529 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceb3cfa-3aae-43c7-9669-3a01b4620b9b None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:47:41.855849 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceb3cfa-3aae-43c7-9669-3a01b4620b9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:47:41.881466 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-dceb3cfa-3aae-43c7-9669-3a01b4620b9b None None] MFA Rules not processed for user `2cf35bdba5fa44139f27ab9c78deef02`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:47:41.882672 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-dceb3cfa-3aae-43c7-9669-3a01b4620b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:47:41.950699 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1214/2411] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:47:41 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:47:41.961877 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abc68e1-46a9-4bbb-a114-985a170363dd admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:47:41.964206 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-0abc68e1-46a9-4bbb-a114-985a170363dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:47:42.028249 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abc68e1-46a9-4bbb-a114-985a170363dd admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:47:42.032511 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba59da5-7a61-4d1e-8ced-94ae39b19379 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af5a95620a4b43538abfe09eed4bf115', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:47:42.033223 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba59da5-7a61-4d1e-8ced-94ae39b19379 service cinder] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:47:42.033514 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba59da5-7a61-4d1e-8ced-94ae39b19379 service cinder] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:47:42.033794 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba59da5-7a61-4d1e-8ced-94ae39b19379 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:47:42.044289 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba59da5-7a61-4d1e-8ced-94ae39b19379 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:47:42.045717 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba59da5-7a61-4d1e-8ced-94ae39b19379 service cinder] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:47:42.055239 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1198/2412] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:47:41 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:47:42.492924 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceb3cfa-3aae-43c7-9669-3a01b4620b9b None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:47:42.502417 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceb3cfa-3aae-43c7-9669-3a01b4620b9b None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:47:42.506295 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aae28ce-af1c-49fe-99bb-8c723f543a29 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af5a95620a4b43538abfe09eed4bf115', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:47:42.506932 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aae28ce-af1c-49fe-99bb-8c723f543a29 service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:47:42.507214 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aae28ce-af1c-49fe-99bb-8c723f543a29 service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:47:42.507488 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aae28ce-af1c-49fe-99bb-8c723f543a29 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:47:42.564110 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aae28ce-af1c-49fe-99bb-8c723f543a29 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:47:42.565520 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aae28ce-af1c-49fe-99bb-8c723f543a29 service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:47:42.574505 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1215/2413] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:47:42 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:47:50.625187 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba59da5-7a61-4d1e-8ced-94ae39b19379 service cinder] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:47:50.656208 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:47:50.686991 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba59da5-7a61-4d1e-8ced-94ae39b19379 service cinder] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:47:50.691427 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b874b4b-ddbe-4725-8ab4-102157012f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:47:50.692375 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b874b4b-ddbe-4725-8ab4-102157012f42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:47:50.692631 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b874b4b-ddbe-4725-8ab4-102157012f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:47:50.692905 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b874b4b-ddbe-4725-8ab4-102157012f42 admin admin] PATH_INFO: `/v3/users/965f41283b754b4ca57cc11775397cbc` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:47:50.694129 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b874b4b-ddbe-4725-8ab4-102157012f42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=965f41283b754b4ca57cc11775397cbc)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:47:50.696093 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b874b4b-ddbe-4725-8ab4-102157012f42 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:47:50.903823 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-3b874b4b-ddbe-4725-8ab4-102157012f42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '965f41283b754b4ca57cc11775397cbc'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:47:50.913569 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-3b874b4b-ddbe-4725-8ab4-102157012f42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '965f41283b754b4ca57cc11775397cbc'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:47:50.914392 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-3b874b4b-ddbe-4725-8ab4-102157012f42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '965f41283b754b4ca57cc11775397cbc'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:47:50.934343 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-3b874b4b-ddbe-4725-8ab4-102157012f42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '965f41283b754b4ca57cc11775397cbc'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:47:50.934343 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-3b874b4b-ddbe-4725-8ab4-102157012f42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '965f41283b754b4ca57cc11775397cbc'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:47:51.009604 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1199/2414] 10.222.0.86 () {58 vars in 1223 bytes} [Tue Jun 7 14:47:50 2022] DELETE /identity/v3/users/965f41283b754b4ca57cc11775397cbc => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:47:51.014279 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531a4745-a1ed-4437-b7a9-24e3a258c9ff None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:47:51.014804 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531a4745-a1ed-4437-b7a9-24e3a258c9ff None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:47:51.014804 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531a4745-a1ed-4437-b7a9-24e3a258c9ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:47:51.020412 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:47:51.034052 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-531a4745-a1ed-4437-b7a9-24e3a258c9ff None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:47:51.035244 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-531a4745-a1ed-4437-b7a9-24e3a258c9ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:47:51.092719 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1216/2415] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:47:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:47:51.102072 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b874b4b-ddbe-4725-8ab4-102157012f42 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:47:51.104179 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-3b874b4b-ddbe-4725-8ab4-102157012f42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:47:51.162478 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b874b4b-ddbe-4725-8ab4-102157012f42 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:47:51.166918 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d6f86f-4d3f-4b14-8c6b-f5b9d04ed57c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dda603ec5517460a83c333db2af804d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:47:51.167591 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d6f86f-4d3f-4b14-8c6b-f5b9d04ed57c service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:47:51.167923 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d6f86f-4d3f-4b14-8c6b-f5b9d04ed57c service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:47:51.168207 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d6f86f-4d3f-4b14-8c6b-f5b9d04ed57c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:47:51.177172 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d6f86f-4d3f-4b14-8c6b-f5b9d04ed57c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:47:51.178594 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d6f86f-4d3f-4b14-8c6b-f5b9d04ed57c service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:47:51.187944 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1200/2416] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:47:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:47:51.659268 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531a4745-a1ed-4437-b7a9-24e3a258c9ff None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:47:51.659268 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-531a4745-a1ed-4437-b7a9-24e3a258c9ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:47:51.670794 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531a4745-a1ed-4437-b7a9-24e3a258c9ff None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:47:51.675520 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79746ec8-46a8-4ee8-992a-fa43fe198eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:47:51.676504 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79746ec8-46a8-4ee8-992a-fa43fe198eb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:47:51.676797 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79746ec8-46a8-4ee8-992a-fa43fe198eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:47:51.677077 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79746ec8-46a8-4ee8-992a-fa43fe198eb3 admin admin] PATH_INFO: `/v3/projects/420b874fefd041ec9e7b8c44bf8a3eb8` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:47:51.678296 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79746ec8-46a8-4ee8-992a-fa43fe198eb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=420b874fefd041ec9e7b8c44bf8a3eb8)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:47:51.680231 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79746ec8-46a8-4ee8-992a-fa43fe198eb3 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:47:51.798124 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-79746ec8-46a8-4ee8-992a-fa43fe198eb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '420b874fefd041ec9e7b8c44bf8a3eb8', 'request_id': 'req-79746ec8-46a8-4ee8-992a-fa43fe198eb3'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:47:51.804215 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-79746ec8-46a8-4ee8-992a-fa43fe198eb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '420b874fefd041ec9e7b8c44bf8a3eb8', 'request_id': 'req-79746ec8-46a8-4ee8-992a-fa43fe198eb3'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:47:51.877391 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-79746ec8-46a8-4ee8-992a-fa43fe198eb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '420b874fefd041ec9e7b8c44bf8a3eb8', 'request_id': 'req-79746ec8-46a8-4ee8-992a-fa43fe198eb3'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:47:51.888693 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-79746ec8-46a8-4ee8-992a-fa43fe198eb3 admin admin] The token cache is being invalidate because project 420b874fefd041ec9e7b8c44bf8a3eb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:47:51.888977 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-79746ec8-46a8-4ee8-992a-fa43fe198eb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:47:51.889588 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-79746ec8-46a8-4ee8-992a-fa43fe198eb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:47:51.891163 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1217/2417] 10.222.0.86 () {58 vars in 1232 bytes} [Tue Jun 7 14:47:51 2022] DELETE /identity/v3/projects/420b874fefd041ec9e7b8c44bf8a3eb8 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:47:51.895093 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d6f86f-4d3f-4b14-8c6b-f5b9d04ed57c service neutron] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:47:51.904417 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d6f86f-4d3f-4b14-8c6b-f5b9d04ed57c service neutron] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:47:51.951520 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:47:51.961021 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7009fab7-c4bf-4a1a-9d1d-c87ef9c7fafd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:47:51.961953 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7009fab7-c4bf-4a1a-9d1d-c87ef9c7fafd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:47:51.967170 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7009fab7-c4bf-4a1a-9d1d-c87ef9c7fafd admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:47:51.967170 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7009fab7-c4bf-4a1a-9d1d-c87ef9c7fafd admin admin] PATH_INFO: `/v3/users/2cf35bdba5fa44139f27ab9c78deef02` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:47:51.967170 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7009fab7-c4bf-4a1a-9d1d-c87ef9c7fafd admin admin] RBAC: Authorizing `identity:delete_user(user_id=2cf35bdba5fa44139f27ab9c78deef02)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:47:51.967170 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7009fab7-c4bf-4a1a-9d1d-c87ef9c7fafd admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:47:52.156752 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-7009fab7-c4bf-4a1a-9d1d-c87ef9c7fafd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2cf35bdba5fa44139f27ab9c78deef02'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:47:52.174033 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-7009fab7-c4bf-4a1a-9d1d-c87ef9c7fafd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2cf35bdba5fa44139f27ab9c78deef02'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:47:52.174033 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-7009fab7-c4bf-4a1a-9d1d-c87ef9c7fafd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2cf35bdba5fa44139f27ab9c78deef02'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:47:52.180852 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-7009fab7-c4bf-4a1a-9d1d-c87ef9c7fafd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2cf35bdba5fa44139f27ab9c78deef02'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:47:52.181494 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-7009fab7-c4bf-4a1a-9d1d-c87ef9c7fafd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2cf35bdba5fa44139f27ab9c78deef02'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:47:52.249327 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1201/2418] 10.222.0.86 () {58 vars in 1223 bytes} [Tue Jun 7 14:47:51 2022] DELETE /identity/v3/users/2cf35bdba5fa44139f27ab9c78deef02 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:47:52.677054 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79746ec8-46a8-4ee8-992a-fa43fe198eb3 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:47:52.681291 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-79746ec8-46a8-4ee8-992a-fa43fe198eb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:47:52.697522 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79746ec8-46a8-4ee8-992a-fa43fe198eb3 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:47:52.756341 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969cbe82-329a-486c-b3dc-09bb0cf1ee76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:47:52.757224 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969cbe82-329a-486c-b3dc-09bb0cf1ee76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:47:52.757514 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969cbe82-329a-486c-b3dc-09bb0cf1ee76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:47:52.757791 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969cbe82-329a-486c-b3dc-09bb0cf1ee76 admin admin] PATH_INFO: `/v3/projects/3e19ac763ce042a7bc3691e977f18d32` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:47:52.759950 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969cbe82-329a-486c-b3dc-09bb0cf1ee76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e19ac763ce042a7bc3691e977f18d32)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:47:52.762179 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969cbe82-329a-486c-b3dc-09bb0cf1ee76 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:47:52.857174 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:47:52.872247 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-969cbe82-329a-486c-b3dc-09bb0cf1ee76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e19ac763ce042a7bc3691e977f18d32', 'request_id': 'req-969cbe82-329a-486c-b3dc-09bb0cf1ee76'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:47:52.878453 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-969cbe82-329a-486c-b3dc-09bb0cf1ee76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e19ac763ce042a7bc3691e977f18d32', 'request_id': 'req-969cbe82-329a-486c-b3dc-09bb0cf1ee76'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:47:52.940573 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-969cbe82-329a-486c-b3dc-09bb0cf1ee76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e19ac763ce042a7bc3691e977f18d32', 'request_id': 'req-969cbe82-329a-486c-b3dc-09bb0cf1ee76'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:47:52.951838 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-969cbe82-329a-486c-b3dc-09bb0cf1ee76 admin admin] The token cache is being invalidate because project 3e19ac763ce042a7bc3691e977f18d32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:47:52.952129 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-969cbe82-329a-486c-b3dc-09bb0cf1ee76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:47:52.952771 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-969cbe82-329a-486c-b3dc-09bb0cf1ee76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:47:52.954487 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1218/2419] 10.222.0.86 () {58 vars in 1232 bytes} [Tue Jun 7 14:47:52 2022] DELETE /identity/v3/projects/3e19ac763ce042a7bc3691e977f18d32 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 14:47:52.959374 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528bfc8a-31c7-488d-987a-7a8a07e9bcc4 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:47:52.959917 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528bfc8a-31c7-488d-987a-7a8a07e9bcc4 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:47:52.960024 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528bfc8a-31c7-488d-987a-7a8a07e9bcc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:47:52.977988 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-528bfc8a-31c7-488d-987a-7a8a07e9bcc4 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:47:52.979282 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-528bfc8a-31c7-488d-987a-7a8a07e9bcc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:47:53.042839 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1202/2420] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:47:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:47:53.050623 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9950751d-76fa-40c8-99e3-0c73fe2fd70d None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:47:53.051027 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9950751d-76fa-40c8-99e3-0c73fe2fd70d None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:47:53.051378 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9950751d-76fa-40c8-99e3-0c73fe2fd70d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:47:53.070738 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-9950751d-76fa-40c8-99e3-0c73fe2fd70d None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:47:53.072226 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-9950751d-76fa-40c8-99e3-0c73fe2fd70d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:47:53.081358 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1219/2421] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:47:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 14:47:53.088007 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528bfc8a-31c7-488d-987a-7a8a07e9bcc4 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:47:53.097642 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528bfc8a-31c7-488d-987a-7a8a07e9bcc4 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:47:53.102146 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e833d40-fe58-436f-b788-78eeb4234fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:47:53.103367 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e833d40-fe58-436f-b788-78eeb4234fdc admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:47:53.103635 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e833d40-fe58-436f-b788-78eeb4234fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:47:53.103938 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e833d40-fe58-436f-b788-78eeb4234fdc admin admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:47:53.104662 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e833d40-fe58-436f-b788-78eeb4234fdc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:47:53.104967 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e833d40-fe58-436f-b788-78eeb4234fdc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:47:53.106542 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e833d40-fe58-436f-b788-78eeb4234fdc admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:47:53.121610 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1203/2422] 10.222.0.86 () {58 vars in 1152 bytes} [Tue Jun 7 14:47:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:47:53.122818 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9950751d-76fa-40c8-99e3-0c73fe2fd70d None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:47:53.132109 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9950751d-76fa-40c8-99e3-0c73fe2fd70d None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:47:53.137311 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d82ad39-14b5-47c5-9810-fd1ceda7e2aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:47:53.137972 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d82ad39-14b5-47c5-9810-fd1ceda7e2aa admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:47:53.138258 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d82ad39-14b5-47c5-9810-fd1ceda7e2aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:47:53.138535 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d82ad39-14b5-47c5-9810-fd1ceda7e2aa admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:47:53.139269 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d82ad39-14b5-47c5-9810-fd1ceda7e2aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:47:53.141223 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d82ad39-14b5-47c5-9810-fd1ceda7e2aa admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:47:53.229462 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1220/2423] 10.222.0.86 () {60 vars in 1152 bytes} [Tue Jun 7 14:47:53 2022] POST /identity/v3/projects => generated 377 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:47:53.233588 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e833d40-fe58-436f-b788-78eeb4234fdc admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:47:53.244510 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e833d40-fe58-436f-b788-78eeb4234fdc admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:47:53.315173 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:47:53.322505 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96059a82-1b0a-4c6f-9348-b23356c5e97e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:47:53.323182 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96059a82-1b0a-4c6f-9348-b23356c5e97e admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:47:53.323463 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96059a82-1b0a-4c6f-9348-b23356c5e97e admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:47:53.323739 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96059a82-1b0a-4c6f-9348-b23356c5e97e admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:47:53.324526 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96059a82-1b0a-4c6f-9348-b23356c5e97e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:47:53.327639 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96059a82-1b0a-4c6f-9348-b23356c5e97e admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:47:53.416723 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1204/2424] 10.222.0.86 () {60 vars in 1143 bytes} [Tue Jun 7 14:47:53 2022] POST /identity/v3/users => generated 289 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:47:53.420671 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d82ad39-14b5-47c5-9810-fd1ceda7e2aa admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:47:53.432941 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d82ad39-14b5-47c5-9810-fd1ceda7e2aa admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:47:53.437936 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc855e6-65bf-4aac-a712-faaac6f55ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:47:53.438607 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc855e6-65bf-4aac-a712-faaac6f55ff1 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:47:53.438896 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc855e6-65bf-4aac-a712-faaac6f55ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:47:53.439193 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc855e6-65bf-4aac-a712-faaac6f55ff1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:47:53.439947 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc855e6-65bf-4aac-a712-faaac6f55ff1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:47:53.441638 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc855e6-65bf-4aac-a712-faaac6f55ff1 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:47:53.453494 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1221/2425] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:47:53 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:47:53.457454 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96059a82-1b0a-4c6f-9348-b23356c5e97e admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:47:53.467538 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96059a82-1b0a-4c6f-9348-b23356c5e97e admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:47:53.472545 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef42a4f-6015-45ce-b3b7-19fad1276e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:47:53.473273 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef42a4f-6015-45ce-b3b7-19fad1276e9d admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:47:53.473627 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef42a4f-6015-45ce-b3b7-19fad1276e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:47:53.473910 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef42a4f-6015-45ce-b3b7-19fad1276e9d admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:47:53.474648 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef42a4f-6015-45ce-b3b7-19fad1276e9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:47:53.476610 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef42a4f-6015-45ce-b3b7-19fad1276e9d admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:47:53.488422 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1205/2426] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:47:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:47:53.492742 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc855e6-65bf-4aac-a712-faaac6f55ff1 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:47:53.503615 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc855e6-65bf-4aac-a712-faaac6f55ff1 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:47:53.508894 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a997768-c902-478c-9cb4-3d76ba278c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:47:53.509775 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a997768-c902-478c-9cb4-3d76ba278c1d admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:47:53.510066 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a997768-c902-478c-9cb4-3d76ba278c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:47:53.510381 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a997768-c902-478c-9cb4-3d76ba278c1d admin admin] PATH_INFO: `/v3/projects/59be6acbac5847098a4d2faaaf915e21/users/ef667a5e3a8c494585cca7f04b712f24/roles/c17acc2a8bb348f59ba7edd22fcf0c47` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:47:53.525650 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a997768-c902-478c-9cb4-3d76ba278c1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=59be6acbac5847098a4d2faaaf915e21, user_id=ef667a5e3a8c494585cca7f04b712f24, role_id=c17acc2a8bb348f59ba7edd22fcf0c47)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:47:53.528487 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a997768-c902-478c-9cb4-3d76ba278c1d admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:47:53.638571 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1222/2427] 10.222.0.86 () {60 vars in 1482 bytes} [Tue Jun 7 14:47:53 2022] PUT /identity/v3/projects/59be6acbac5847098a4d2faaaf915e21/users/ef667a5e3a8c494585cca7f04b712f24/roles/c17acc2a8bb348f59ba7edd22fcf0c47 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 14:47:53.648622 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb89f634-c64a-4d5a-927a-d7a6bb992a29 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:47:53.648922 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb89f634-c64a-4d5a-927a-d7a6bb992a29 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:47:53.649223 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb89f634-c64a-4d5a-927a-d7a6bb992a29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:47:53.683593 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-cb89f634-c64a-4d5a-927a-d7a6bb992a29 None None] MFA Rules not processed for user `ef667a5e3a8c494585cca7f04b712f24`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:47:53.685651 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-cb89f634-c64a-4d5a-927a-d7a6bb992a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:47:53.771045 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1206/2428] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:47:53 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:47:53.776202 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a997768-c902-478c-9cb4-3d76ba278c1d admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:47:53.851054 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a997768-c902-478c-9cb4-3d76ba278c1d admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:47:53.856081 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1cec2a-20ef-4aa4-9b37-781b75c71cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:47:53.856761 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1cec2a-20ef-4aa4-9b37-781b75c71cee admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:47:53.857048 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1cec2a-20ef-4aa4-9b37-781b75c71cee admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:47:53.857328 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1cec2a-20ef-4aa4-9b37-781b75c71cee admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:47:53.858033 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1cec2a-20ef-4aa4-9b37-781b75c71cee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:47:53.860075 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1cec2a-20ef-4aa4-9b37-781b75c71cee admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:47:53.963456 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1223/2429] 10.222.0.86 () {60 vars in 1152 bytes} [Tue Jun 7 14:47:53 2022] POST /identity/v3/projects => generated 377 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:47:53.964611 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb89f634-c64a-4d5a-927a-d7a6bb992a29 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:47:53.975485 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb89f634-c64a-4d5a-927a-d7a6bb992a29 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:47:54.032842 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de13b19d-6c84-42ad-aa25-637a31b85b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:47:54.033525 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de13b19d-6c84-42ad-aa25-637a31b85b27 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:47:54.033832 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de13b19d-6c84-42ad-aa25-637a31b85b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:47:54.034113 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de13b19d-6c84-42ad-aa25-637a31b85b27 admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:47:54.034832 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de13b19d-6c84-42ad-aa25-637a31b85b27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:47:54.036909 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de13b19d-6c84-42ad-aa25-637a31b85b27 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:47:54.124256 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1207/2430] 10.222.0.86 () {60 vars in 1143 bytes} [Tue Jun 7 14:47:53 2022] POST /identity/v3/users => generated 289 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 14:47:54.128341 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1cec2a-20ef-4aa4-9b37-781b75c71cee admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:47:54.139199 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1cec2a-20ef-4aa4-9b37-781b75c71cee admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:47:54.143961 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b39027-dd90-41ee-a3eb-c6aff9d7aa30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:47:54.144625 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b39027-dd90-41ee-a3eb-c6aff9d7aa30 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:47:54.144911 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b39027-dd90-41ee-a3eb-c6aff9d7aa30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:47:54.145188 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b39027-dd90-41ee-a3eb-c6aff9d7aa30 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:47:54.145919 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b39027-dd90-41ee-a3eb-c6aff9d7aa30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:47:54.147500 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b39027-dd90-41ee-a3eb-c6aff9d7aa30 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:47:54.159027 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1224/2431] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:47:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:47:54.163133 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de13b19d-6c84-42ad-aa25-637a31b85b27 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:47:54.173789 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de13b19d-6c84-42ad-aa25-637a31b85b27 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:47:54.178430 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f58ce3-002c-4790-bcd1-1eba5f44b23f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:47:54.179165 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f58ce3-002c-4790-bcd1-1eba5f44b23f admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:47:54.179450 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f58ce3-002c-4790-bcd1-1eba5f44b23f admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:47:54.179748 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f58ce3-002c-4790-bcd1-1eba5f44b23f admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:47:54.180530 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f58ce3-002c-4790-bcd1-1eba5f44b23f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:47:54.182704 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f58ce3-002c-4790-bcd1-1eba5f44b23f admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:47:54.193196 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1208/2432] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:47:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:47:54.197575 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b39027-dd90-41ee-a3eb-c6aff9d7aa30 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:47:54.207959 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b39027-dd90-41ee-a3eb-c6aff9d7aa30 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:47:54.213493 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d47e1ae-912c-440a-bfbc-f55f0d49d797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:47:54.214378 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d47e1ae-912c-440a-bfbc-f55f0d49d797 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:47:54.214658 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d47e1ae-912c-440a-bfbc-f55f0d49d797 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:47:54.214932 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d47e1ae-912c-440a-bfbc-f55f0d49d797 admin admin] PATH_INFO: `/v3/projects/e2298ea12d70451b86fb94d2cd20978a/users/e28d1a80f3494189abb5782a662a6bff/roles/c17acc2a8bb348f59ba7edd22fcf0c47` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:47:54.230570 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d47e1ae-912c-440a-bfbc-f55f0d49d797 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2298ea12d70451b86fb94d2cd20978a, user_id=e28d1a80f3494189abb5782a662a6bff, role_id=c17acc2a8bb348f59ba7edd22fcf0c47)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:47:54.233532 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d47e1ae-912c-440a-bfbc-f55f0d49d797 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:47:54.312468 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1225/2433] 10.222.0.86 () {60 vars in 1482 bytes} [Tue Jun 7 14:47:54 2022] PUT /identity/v3/projects/e2298ea12d70451b86fb94d2cd20978a/users/e28d1a80f3494189abb5782a662a6bff/roles/c17acc2a8bb348f59ba7edd22fcf0c47 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:47:54.323227 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0748f7b7-ed53-44d6-9f65-d58a9777dc41 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:47:54.323515 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0748f7b7-ed53-44d6-9f65-d58a9777dc41 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:47:54.323882 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0748f7b7-ed53-44d6-9f65-d58a9777dc41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:47:54.351144 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-0748f7b7-ed53-44d6-9f65-d58a9777dc41 None None] MFA Rules not processed for user `e28d1a80f3494189abb5782a662a6bff`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:47:54.352400 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-0748f7b7-ed53-44d6-9f65-d58a9777dc41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:47:54.392487 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:47:54.429712 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1209/2434] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:47:54 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:47:54.433824 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d47e1ae-912c-440a-bfbc-f55f0d49d797 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:47:54.439035 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:47:54.514487 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d47e1ae-912c-440a-bfbc-f55f0d49d797 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:47:54.521817 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9a6791-27fb-4f3f-8c3e-1fa010c30751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:47:54.522706 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9a6791-27fb-4f3f-8c3e-1fa010c30751 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:47:54.523056 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9a6791-27fb-4f3f-8c3e-1fa010c30751 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:47:54.523427 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9a6791-27fb-4f3f-8c3e-1fa010c30751 admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:47:54.524835 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9a6791-27fb-4f3f-8c3e-1fa010c30751 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:47:54.526901 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9a6791-27fb-4f3f-8c3e-1fa010c30751 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:47:54.652431 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1226/2435] 10.222.0.86 () {60 vars in 1152 bytes} [Tue Jun 7 14:47:54 2022] POST /identity/v3/projects => generated 377 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:47:54.656230 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0748f7b7-ed53-44d6-9f65-d58a9777dc41 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:47:54.667142 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0748f7b7-ed53-44d6-9f65-d58a9777dc41 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:47:54.727066 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b8d04c-5dbb-448d-9149-4f8249e2d3d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:47:54.728389 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b8d04c-5dbb-448d-9149-4f8249e2d3d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:47:54.728684 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b8d04c-5dbb-448d-9149-4f8249e2d3d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:47:54.728966 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b8d04c-5dbb-448d-9149-4f8249e2d3d0 admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:47:54.729701 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b8d04c-5dbb-448d-9149-4f8249e2d3d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:47:54.731630 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b8d04c-5dbb-448d-9149-4f8249e2d3d0 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:47:54.832775 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1210/2436] 10.222.0.86 () {60 vars in 1143 bytes} [Tue Jun 7 14:47:54 2022] POST /identity/v3/users => generated 295 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 14:47:54.834177 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9a6791-27fb-4f3f-8c3e-1fa010c30751 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:47:54.849659 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9a6791-27fb-4f3f-8c3e-1fa010c30751 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:47:54.851312 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51ddd60-adee-4f7b-a8a9-26e9c4d84978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:47:54.852169 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51ddd60-adee-4f7b-a8a9-26e9c4d84978 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:47:54.852527 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51ddd60-adee-4f7b-a8a9-26e9c4d84978 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:47:54.852873 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51ddd60-adee-4f7b-a8a9-26e9c4d84978 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:47:54.853724 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51ddd60-adee-4f7b-a8a9-26e9c4d84978 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:47:54.855447 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51ddd60-adee-4f7b-a8a9-26e9c4d84978 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:47:54.867636 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1227/2437] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:47:54 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:47:54.873335 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b8d04c-5dbb-448d-9149-4f8249e2d3d0 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:47:54.884370 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b8d04c-5dbb-448d-9149-4f8249e2d3d0 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:47:54.889248 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5232587a-663b-4669-96da-09620a0931ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:47:54.890129 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5232587a-663b-4669-96da-09620a0931ef admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:47:54.890439 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5232587a-663b-4669-96da-09620a0931ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:47:54.890719 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5232587a-663b-4669-96da-09620a0931ef admin admin] PATH_INFO: `/v3/projects/f3c4e1d5f3084cf29ef78a111e55a4cf/users/13fd3b7c0547453ebf85ffd9427b3886/roles/e3bf6239f5bf477b965704b086786f11` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:47:54.906827 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5232587a-663b-4669-96da-09620a0931ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3c4e1d5f3084cf29ef78a111e55a4cf, user_id=13fd3b7c0547453ebf85ffd9427b3886, role_id=e3bf6239f5bf477b965704b086786f11)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:47:54.909484 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5232587a-663b-4669-96da-09620a0931ef admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:47:55.032324 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1211/2438] 10.222.0.86 () {60 vars in 1482 bytes} [Tue Jun 7 14:47:54 2022] PUT /identity/v3/projects/f3c4e1d5f3084cf29ef78a111e55a4cf/users/13fd3b7c0547453ebf85ffd9427b3886/roles/e3bf6239f5bf477b965704b086786f11 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:47:55.036417 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51ddd60-adee-4f7b-a8a9-26e9c4d84978 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:47:55.046995 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51ddd60-adee-4f7b-a8a9-26e9c4d84978 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:47:55.104050 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506d042b-e259-47db-945f-1304ca057fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:47:55.104719 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506d042b-e259-47db-945f-1304ca057fd9 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:47:55.105008 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506d042b-e259-47db-945f-1304ca057fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:47:55.106294 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506d042b-e259-47db-945f-1304ca057fd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:47:55.106294 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506d042b-e259-47db-945f-1304ca057fd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:47:55.107621 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506d042b-e259-47db-945f-1304ca057fd9 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:47:55.117826 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1228/2439] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:47:55 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:47:55.122819 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5232587a-663b-4669-96da-09620a0931ef admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:47:55.133205 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5232587a-663b-4669-96da-09620a0931ef admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:47:55.138461 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca1d433-0279-46e8-bcaf-af507eb52b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:47:55.140255 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca1d433-0279-46e8-bcaf-af507eb52b34 admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:47:55.140255 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca1d433-0279-46e8-bcaf-af507eb52b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:47:55.140255 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca1d433-0279-46e8-bcaf-af507eb52b34 admin admin] PATH_INFO: `/v3/projects/f3c4e1d5f3084cf29ef78a111e55a4cf/users/13fd3b7c0547453ebf85ffd9427b3886/roles/e3bf6239f5bf477b965704b086786f11` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:47:55.141879 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca1d433-0279-46e8-bcaf-af507eb52b34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3c4e1d5f3084cf29ef78a111e55a4cf, user_id=13fd3b7c0547453ebf85ffd9427b3886, role_id=e3bf6239f5bf477b965704b086786f11)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:47:55.144582 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca1d433-0279-46e8-bcaf-af507eb52b34 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:47:55.154849 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1212/2440] 10.222.0.86 () {60 vars in 1482 bytes} [Tue Jun 7 14:47:55 2022] PUT /identity/v3/projects/f3c4e1d5f3084cf29ef78a111e55a4cf/users/13fd3b7c0547453ebf85ffd9427b3886/roles/e3bf6239f5bf477b965704b086786f11 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:47:55.219145 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa55bf2-3612-4009-94e0-ea1d4fac0815 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:47:55.219440 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa55bf2-3612-4009-94e0-ea1d4fac0815 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:47:55.219726 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa55bf2-3612-4009-94e0-ea1d4fac0815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:47:55.246964 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-5fa55bf2-3612-4009-94e0-ea1d4fac0815 None None] MFA Rules not processed for user `13fd3b7c0547453ebf85ffd9427b3886`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:47:55.248209 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-5fa55bf2-3612-4009-94e0-ea1d4fac0815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:47:55.309648 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:47:55.314665 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1229/2441] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:47:55 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:47:55.325800 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca1d433-0279-46e8-bcaf-af507eb52b34 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:47:55.327507 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-aca1d433-0279-46e8-bcaf-af507eb52b34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:47:55.383880 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca1d433-0279-46e8-bcaf-af507eb52b34 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:47:55.387829 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b29f36e-7b08-423e-9c92-57e1ce69694c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af5a95620a4b43538abfe09eed4bf115', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:47:55.388466 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b29f36e-7b08-423e-9c92-57e1ce69694c service cinder] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:47:55.388752 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b29f36e-7b08-423e-9c92-57e1ce69694c service cinder] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:47:55.389030 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b29f36e-7b08-423e-9c92-57e1ce69694c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:47:55.397958 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b29f36e-7b08-423e-9c92-57e1ce69694c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:47:55.399947 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b29f36e-7b08-423e-9c92-57e1ce69694c service cinder] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:47:55.409115 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1213/2442] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:47:55 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:47:55.549485 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa55bf2-3612-4009-94e0-ea1d4fac0815 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:47:55.551072 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-5fa55bf2-3612-4009-94e0-ea1d4fac0815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:47:55.567549 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa55bf2-3612-4009-94e0-ea1d4fac0815 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:47:55.571431 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa125c92-5523-4fab-987c-f5a343cfc73c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af5a95620a4b43538abfe09eed4bf115', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:47:55.572211 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa125c92-5523-4fab-987c-f5a343cfc73c service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:47:55.572540 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa125c92-5523-4fab-987c-f5a343cfc73c service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:47:55.572819 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa125c92-5523-4fab-987c-f5a343cfc73c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:47:55.631952 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa125c92-5523-4fab-987c-f5a343cfc73c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:47:55.633405 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa125c92-5523-4fab-987c-f5a343cfc73c service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:47:55.643059 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1230/2443] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:47:55 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:47:58.799258 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f40954-3253-4b9b-a957-4de8526e1b44 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:47:58.799770 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f40954-3253-4b9b-a957-4de8526e1b44 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:47:58.799868 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f40954-3253-4b9b-a957-4de8526e1b44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:47:58.817332 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-61f40954-3253-4b9b-a957-4de8526e1b44 None None] MFA Rules not processed for user `bd70563183ab43d68df41f1be27cadc3`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:47:58.818532 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-61f40954-3253-4b9b-a957-4de8526e1b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:47:58.842923 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:47:58.873586 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1214/2444] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:47:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:47:59.920989 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa125c92-5523-4fab-987c-f5a343cfc73c service cinder] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:47:59.983119 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa125c92-5523-4fab-987c-f5a343cfc73c service cinder] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:47:59.988208 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad75cbb2-2756-418a-9884-3ec3511b9cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:47:59.989081 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad75cbb2-2756-418a-9884-3ec3511b9cec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:47:59.991304 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad75cbb2-2756-418a-9884-3ec3511b9cec admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:47:59.991304 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad75cbb2-2756-418a-9884-3ec3511b9cec admin admin] PATH_INFO: `/v3/users/ef667a5e3a8c494585cca7f04b712f24` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:47:59.991304 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad75cbb2-2756-418a-9884-3ec3511b9cec admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef667a5e3a8c494585cca7f04b712f24)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:47:59.992822 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad75cbb2-2756-418a-9884-3ec3511b9cec admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:48:00.159116 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-ad75cbb2-2756-418a-9884-3ec3511b9cec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef667a5e3a8c494585cca7f04b712f24'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:48:00.159789 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-ad75cbb2-2756-418a-9884-3ec3511b9cec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef667a5e3a8c494585cca7f04b712f24'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:48:00.167291 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-ad75cbb2-2756-418a-9884-3ec3511b9cec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef667a5e3a8c494585cca7f04b712f24'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:48:00.179307 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-ad75cbb2-2756-418a-9884-3ec3511b9cec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef667a5e3a8c494585cca7f04b712f24'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:48:00.179998 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-ad75cbb2-2756-418a-9884-3ec3511b9cec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef667a5e3a8c494585cca7f04b712f24'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:48:00.277695 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1231/2445] 10.222.0.86 () {58 vars in 1223 bytes} [Tue Jun 7 14:47:59 2022] DELETE /identity/v3/users/ef667a5e3a8c494585cca7f04b712f24 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:48:00.282185 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42054745-ef87-4e89-b01a-5adc1ab5deb7 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:48:00.282699 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42054745-ef87-4e89-b01a-5adc1ab5deb7 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:48:00.282797 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42054745-ef87-4e89-b01a-5adc1ab5deb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:48:00.300614 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-42054745-ef87-4e89-b01a-5adc1ab5deb7 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:48:00.301802 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-42054745-ef87-4e89-b01a-5adc1ab5deb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:48:00.360071 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1215/2446] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:48:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:48:00.370208 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad75cbb2-2756-418a-9884-3ec3511b9cec admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:48:00.371613 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-ad75cbb2-2756-418a-9884-3ec3511b9cec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:48:00.391373 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:48:00.431196 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad75cbb2-2756-418a-9884-3ec3511b9cec admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:48:00.435039 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b286fe33-5599-4b12-8fef-fd41514ce0f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dda603ec5517460a83c333db2af804d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:48:00.435847 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b286fe33-5599-4b12-8fef-fd41514ce0f8 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:48:00.436212 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b286fe33-5599-4b12-8fef-fd41514ce0f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:48:00.436658 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b286fe33-5599-4b12-8fef-fd41514ce0f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:48:00.448234 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b286fe33-5599-4b12-8fef-fd41514ce0f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:48:00.449793 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b286fe33-5599-4b12-8fef-fd41514ce0f8 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:48:00.462194 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1232/2447] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:48:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:48:00.981892 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42054745-ef87-4e89-b01a-5adc1ab5deb7 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:48:00.983449 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-42054745-ef87-4e89-b01a-5adc1ab5deb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:48:00.997150 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42054745-ef87-4e89-b01a-5adc1ab5deb7 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:48:01.002568 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f56be53-2c10-4a8d-89b6-9d4488ebb423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:48:01.003828 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f56be53-2c10-4a8d-89b6-9d4488ebb423 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:48:01.004025 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f56be53-2c10-4a8d-89b6-9d4488ebb423 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:48:01.004336 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f56be53-2c10-4a8d-89b6-9d4488ebb423 admin admin] PATH_INFO: `/v3/projects/59be6acbac5847098a4d2faaaf915e21` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:48:01.005520 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f56be53-2c10-4a8d-89b6-9d4488ebb423 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59be6acbac5847098a4d2faaaf915e21)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:48:01.007426 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f56be53-2c10-4a8d-89b6-9d4488ebb423 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:48:01.153128 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-0f56be53-2c10-4a8d-89b6-9d4488ebb423 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59be6acbac5847098a4d2faaaf915e21', 'request_id': 'req-0f56be53-2c10-4a8d-89b6-9d4488ebb423'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:48:01.159445 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-0f56be53-2c10-4a8d-89b6-9d4488ebb423 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59be6acbac5847098a4d2faaaf915e21', 'request_id': 'req-0f56be53-2c10-4a8d-89b6-9d4488ebb423'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:48:01.231714 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-0f56be53-2c10-4a8d-89b6-9d4488ebb423 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59be6acbac5847098a4d2faaaf915e21', 'request_id': 'req-0f56be53-2c10-4a8d-89b6-9d4488ebb423'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:48:01.242877 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-0f56be53-2c10-4a8d-89b6-9d4488ebb423 admin admin] The token cache is being invalidate because project 59be6acbac5847098a4d2faaaf915e21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:48:01.243168 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-0f56be53-2c10-4a8d-89b6-9d4488ebb423 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:48:01.243900 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-0f56be53-2c10-4a8d-89b6-9d4488ebb423 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:48:01.245500 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1216/2448] 10.222.0.86 () {58 vars in 1232 bytes} [Tue Jun 7 14:48:00 2022] DELETE /identity/v3/projects/59be6acbac5847098a4d2faaaf915e21 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:48:01.249481 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b286fe33-5599-4b12-8fef-fd41514ce0f8 service neutron] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:48:01.259671 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b286fe33-5599-4b12-8fef-fd41514ce0f8 service neutron] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:48:01.315542 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f87cedb-f201-4603-abf7-6b818b0f54b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:48:01.317160 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f87cedb-f201-4603-abf7-6b818b0f54b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:48:01.317546 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f87cedb-f201-4603-abf7-6b818b0f54b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:48:01.317830 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f87cedb-f201-4603-abf7-6b818b0f54b7 admin admin] PATH_INFO: `/v3/users/e28d1a80f3494189abb5782a662a6bff` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:48:01.319011 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f87cedb-f201-4603-abf7-6b818b0f54b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e28d1a80f3494189abb5782a662a6bff)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:48:01.321451 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f87cedb-f201-4603-abf7-6b818b0f54b7 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:48:01.502823 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-1f87cedb-f201-4603-abf7-6b818b0f54b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e28d1a80f3494189abb5782a662a6bff'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:48:01.503397 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-1f87cedb-f201-4603-abf7-6b818b0f54b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e28d1a80f3494189abb5782a662a6bff'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:48:01.511270 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-1f87cedb-f201-4603-abf7-6b818b0f54b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e28d1a80f3494189abb5782a662a6bff'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:48:01.523472 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-1f87cedb-f201-4603-abf7-6b818b0f54b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e28d1a80f3494189abb5782a662a6bff'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:48:01.524140 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-1f87cedb-f201-4603-abf7-6b818b0f54b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e28d1a80f3494189abb5782a662a6bff'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:48:01.616957 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1233/2449] 10.222.0.86 () {58 vars in 1223 bytes} [Tue Jun 7 14:48:01 2022] DELETE /identity/v3/users/e28d1a80f3494189abb5782a662a6bff => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:48:02.126008 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f56be53-2c10-4a8d-89b6-9d4488ebb423 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:48:02.127582 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-0f56be53-2c10-4a8d-89b6-9d4488ebb423 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:48:02.156660 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f56be53-2c10-4a8d-89b6-9d4488ebb423 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:48:02.181192 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7c0ae2-aca2-4d2b-a8ea-a7b34cb4dcda None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:48:02.184212 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7c0ae2-aca2-4d2b-a8ea-a7b34cb4dcda None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:48:02.184212 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7c0ae2-aca2-4d2b-a8ea-a7b34cb4dcda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:48:02.207035 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-9a7c0ae2-aca2-4d2b-a8ea-a7b34cb4dcda None None] MFA Rules not processed for user `d7b598c6a3f642ef9edc971ad3ebbe31`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:48:02.208380 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-9a7c0ae2-aca2-4d2b-a8ea-a7b34cb4dcda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:48:02.240974 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:48:02.247792 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153654b5-c7b1-42dc-b021-43ed8ded1dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:48:02.248816 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153654b5-c7b1-42dc-b021-43ed8ded1dc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:48:02.249154 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153654b5-c7b1-42dc-b021-43ed8ded1dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:48:02.249495 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153654b5-c7b1-42dc-b021-43ed8ded1dc1 admin admin] PATH_INFO: `/v3/projects/e2298ea12d70451b86fb94d2cd20978a` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:48:02.250794 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153654b5-c7b1-42dc-b021-43ed8ded1dc1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2298ea12d70451b86fb94d2cd20978a)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:48:02.252269 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:48:02.252992 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153654b5-c7b1-42dc-b021-43ed8ded1dc1 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:48:02.278920 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1234/2450] 10.222.0.86 () {58 vars in 1009 bytes} [Tue Jun 7 14:48:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 14:48:02.325564 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7c0ae2-aca2-4d2b-a8ea-a7b34cb4dcda None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:48:02.327210 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-9a7c0ae2-aca2-4d2b-a8ea-a7b34cb4dcda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:48:02.381240 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-153654b5-c7b1-42dc-b021-43ed8ded1dc1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2298ea12d70451b86fb94d2cd20978a', 'request_id': 'req-153654b5-c7b1-42dc-b021-43ed8ded1dc1'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:48:02.389868 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-153654b5-c7b1-42dc-b021-43ed8ded1dc1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2298ea12d70451b86fb94d2cd20978a', 'request_id': 'req-153654b5-c7b1-42dc-b021-43ed8ded1dc1'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:48:02.408195 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7c0ae2-aca2-4d2b-a8ea-a7b34cb4dcda None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:48:02.470040 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba9bf1a-5f9c-4dc7-89b8-73c715733f0f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9774349dd2b4ec092ef04c3df050a7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:48:02.470801 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba9bf1a-5f9c-4dc7-89b8-73c715733f0f service swift] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:48:02.471090 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba9bf1a-5f9c-4dc7-89b8-73c715733f0f service swift] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:48:02.471370 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba9bf1a-5f9c-4dc7-89b8-73c715733f0f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:48:02.478474 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-153654b5-c7b1-42dc-b021-43ed8ded1dc1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2298ea12d70451b86fb94d2cd20978a', 'request_id': 'req-153654b5-c7b1-42dc-b021-43ed8ded1dc1'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:48:02.491856 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-153654b5-c7b1-42dc-b021-43ed8ded1dc1 admin admin] The token cache is being invalidate because project e2298ea12d70451b86fb94d2cd20978a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:48:02.492497 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-153654b5-c7b1-42dc-b021-43ed8ded1dc1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:48:02.493432 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-153654b5-c7b1-42dc-b021-43ed8ded1dc1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:48:02.495186 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1217/2451] 10.222.0.86 () {58 vars in 1232 bytes} [Tue Jun 7 14:48:02 2022] DELETE /identity/v3/projects/e2298ea12d70451b86fb94d2cd20978a => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:48:02.499383 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153654b5-c7b1-42dc-b021-43ed8ded1dc1 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:48:02.500772 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-153654b5-c7b1-42dc-b021-43ed8ded1dc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:48:02.535629 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba9bf1a-5f9c-4dc7-89b8-73c715733f0f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:48:02.537961 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba9bf1a-5f9c-4dc7-89b8-73c715733f0f service swift] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:48:02.546322 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1235/2452] 10.222.0.86 () {60 vars in 1384 bytes} [Tue Jun 7 14:48:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 07 14:48:02.572778 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153654b5-c7b1-42dc-b021-43ed8ded1dc1 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:48:02.578568 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2994702c-4fe9-4cce-baae-66ce48b1ad7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:48:02.579466 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2994702c-4fe9-4cce-baae-66ce48b1ad7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:48:02.579864 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2994702c-4fe9-4cce-baae-66ce48b1ad7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:48:02.580220 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2994702c-4fe9-4cce-baae-66ce48b1ad7e admin admin] PATH_INFO: `/v3/users/13fd3b7c0547453ebf85ffd9427b3886` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:48:02.586097 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2994702c-4fe9-4cce-baae-66ce48b1ad7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=13fd3b7c0547453ebf85ffd9427b3886)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:48:02.586097 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2994702c-4fe9-4cce-baae-66ce48b1ad7e admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:48:02.857685 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-2994702c-4fe9-4cce-baae-66ce48b1ad7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13fd3b7c0547453ebf85ffd9427b3886'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:48:02.873321 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-2994702c-4fe9-4cce-baae-66ce48b1ad7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13fd3b7c0547453ebf85ffd9427b3886'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:48:02.875606 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-2994702c-4fe9-4cce-baae-66ce48b1ad7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13fd3b7c0547453ebf85ffd9427b3886'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:48:02.891011 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-2994702c-4fe9-4cce-baae-66ce48b1ad7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13fd3b7c0547453ebf85ffd9427b3886'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:48:02.891781 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-2994702c-4fe9-4cce-baae-66ce48b1ad7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13fd3b7c0547453ebf85ffd9427b3886'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:48:02.975195 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1218/2453] 10.222.0.86 () {58 vars in 1223 bytes} [Tue Jun 7 14:48:02 2022] DELETE /identity/v3/users/13fd3b7c0547453ebf85ffd9427b3886 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 14:48:03.722506 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba9bf1a-5f9c-4dc7-89b8-73c715733f0f service swift] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:48:03.724137 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-7ba9bf1a-5f9c-4dc7-89b8-73c715733f0f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:48:03.753783 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba9bf1a-5f9c-4dc7-89b8-73c715733f0f service swift] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:48:03.805671 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:48:03.864015 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1546e41f-353f-47b0-b663-8083337b8c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:48:03.865161 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1546e41f-353f-47b0-b663-8083337b8c33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:48:03.865658 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1546e41f-353f-47b0-b663-8083337b8c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:48:03.866125 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1546e41f-353f-47b0-b663-8083337b8c33 admin admin] PATH_INFO: `/v3/projects/f3c4e1d5f3084cf29ef78a111e55a4cf` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:48:03.868262 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1546e41f-353f-47b0-b663-8083337b8c33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3c4e1d5f3084cf29ef78a111e55a4cf)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:48:03.870499 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1546e41f-353f-47b0-b663-8083337b8c33 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:48:04.073449 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-1546e41f-353f-47b0-b663-8083337b8c33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3c4e1d5f3084cf29ef78a111e55a4cf', 'request_id': 'req-1546e41f-353f-47b0-b663-8083337b8c33'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:48:04.099269 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-1546e41f-353f-47b0-b663-8083337b8c33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3c4e1d5f3084cf29ef78a111e55a4cf', 'request_id': 'req-1546e41f-353f-47b0-b663-8083337b8c33'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:48:04.163792 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-1546e41f-353f-47b0-b663-8083337b8c33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3c4e1d5f3084cf29ef78a111e55a4cf', 'request_id': 'req-1546e41f-353f-47b0-b663-8083337b8c33'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:48:04.182863 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-1546e41f-353f-47b0-b663-8083337b8c33 admin admin] The token cache is being invalidate because project f3c4e1d5f3084cf29ef78a111e55a4cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:48:04.183455 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-1546e41f-353f-47b0-b663-8083337b8c33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:48:04.184438 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-1546e41f-353f-47b0-b663-8083337b8c33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:48:04.186533 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1236/2454] 10.222.0.86 () {58 vars in 1232 bytes} [Tue Jun 7 14:48:03 2022] DELETE /identity/v3/projects/f3c4e1d5f3084cf29ef78a111e55a4cf => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:48:04.200070 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5fbcb3-028b-4909-be40-d13b9711209d None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:48:04.200624 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5fbcb3-028b-4909-be40-d13b9711209d None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:48:04.200711 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5fbcb3-028b-4909-be40-d13b9711209d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:48:04.256809 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:48:04.268655 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-5a5fbcb3-028b-4909-be40-d13b9711209d None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:48:04.270360 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-5a5fbcb3-028b-4909-be40-d13b9711209d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:48:04.409208 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1219/2455] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:48:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:48:04.423339 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338ecf6c-0f50-4de4-8962-d30fa099eb65 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:48:04.423631 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338ecf6c-0f50-4de4-8962-d30fa099eb65 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:48:04.423976 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338ecf6c-0f50-4de4-8962-d30fa099eb65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:48:04.455871 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-338ecf6c-0f50-4de4-8962-d30fa099eb65 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:48:04.458662 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-338ecf6c-0f50-4de4-8962-d30fa099eb65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:48:04.473495 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1237/2456] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:48:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:48:04.479245 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5fbcb3-028b-4909-be40-d13b9711209d None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:48:04.510390 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5fbcb3-028b-4909-be40-d13b9711209d None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:48:04.532496 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53060ba-7a4f-4252-9f79-4f604ecdc00f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:48:04.533446 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53060ba-7a4f-4252-9f79-4f604ecdc00f admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:48:04.533642 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53060ba-7a4f-4252-9f79-4f604ecdc00f admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:48:04.533927 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53060ba-7a4f-4252-9f79-4f604ecdc00f admin admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:48:04.534808 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53060ba-7a4f-4252-9f79-4f604ecdc00f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:48:04.535124 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53060ba-7a4f-4252-9f79-4f604ecdc00f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:48:04.536765 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53060ba-7a4f-4252-9f79-4f604ecdc00f admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:48:04.573532 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1220/2457] 10.222.0.86 () {58 vars in 1152 bytes} [Tue Jun 7 14:48:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:48:04.575245 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338ecf6c-0f50-4de4-8962-d30fa099eb65 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:48:04.586977 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338ecf6c-0f50-4de4-8962-d30fa099eb65 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:48:04.592272 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e250bdd-78fa-49d4-a7af-9fc1913b5bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:48:04.593134 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e250bdd-78fa-49d4-a7af-9fc1913b5bc9 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:48:04.593580 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e250bdd-78fa-49d4-a7af-9fc1913b5bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:48:04.594015 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e250bdd-78fa-49d4-a7af-9fc1913b5bc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:48:04.595134 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e250bdd-78fa-49d4-a7af-9fc1913b5bc9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:48:04.597837 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e250bdd-78fa-49d4-a7af-9fc1913b5bc9 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:48:04.753871 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53060ba-7a4f-4252-9f79-4f604ecdc00f admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:48:04.755567 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1238/2458] 10.222.0.86 () {60 vars in 1152 bytes} [Tue Jun 7 14:48:04 2022] POST /identity/v3/projects => generated 371 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:48:04.773296 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53060ba-7a4f-4252-9f79-4f604ecdc00f admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:48:04.895165 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b5e02a-a4a2-4874-8c0e-8802ce229553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:48:04.896761 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b5e02a-a4a2-4874-8c0e-8802ce229553 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:48:04.896761 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b5e02a-a4a2-4874-8c0e-8802ce229553 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:48:04.896761 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b5e02a-a4a2-4874-8c0e-8802ce229553 admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:48:04.897176 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b5e02a-a4a2-4874-8c0e-8802ce229553 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:48:04.899782 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b5e02a-a4a2-4874-8c0e-8802ce229553 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:48:05.155846 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1221/2459] 10.222.0.86 () {60 vars in 1143 bytes} [Tue Jun 7 14:48:04 2022] POST /identity/v3/users => generated 286 bytes in 401 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:48:05.160084 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e250bdd-78fa-49d4-a7af-9fc1913b5bc9 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:48:05.176587 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e250bdd-78fa-49d4-a7af-9fc1913b5bc9 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:48:05.181618 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b02511c-9fca-4ccb-9d66-3dd876c722e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:48:05.182303 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b02511c-9fca-4ccb-9d66-3dd876c722e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:48:05.182693 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b02511c-9fca-4ccb-9d66-3dd876c722e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:48:05.182979 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b02511c-9fca-4ccb-9d66-3dd876c722e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:48:05.183773 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b02511c-9fca-4ccb-9d66-3dd876c722e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:48:05.185502 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b02511c-9fca-4ccb-9d66-3dd876c722e9 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:48:05.200443 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1239/2460] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:48:05 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:48:05.205786 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b5e02a-a4a2-4874-8c0e-8802ce229553 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:48:05.218639 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b5e02a-a4a2-4874-8c0e-8802ce229553 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:48:05.224881 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd40dda-0c17-4769-89ed-2cadc5186b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:48:05.226172 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd40dda-0c17-4769-89ed-2cadc5186b29 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:48:05.226469 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd40dda-0c17-4769-89ed-2cadc5186b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:48:05.227463 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd40dda-0c17-4769-89ed-2cadc5186b29 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:48:05.228411 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd40dda-0c17-4769-89ed-2cadc5186b29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:48:05.229949 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd40dda-0c17-4769-89ed-2cadc5186b29 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:48:05.247909 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1222/2461] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:48:05 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:48:05.249117 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b02511c-9fca-4ccb-9d66-3dd876c722e9 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:48:05.265049 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b02511c-9fca-4ccb-9d66-3dd876c722e9 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:48:05.270801 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7b6804-f1fb-4bf3-9818-5b0a656605b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:48:05.271726 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7b6804-f1fb-4bf3-9818-5b0a656605b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:48:05.272039 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7b6804-f1fb-4bf3-9818-5b0a656605b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:48:05.272365 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7b6804-f1fb-4bf3-9818-5b0a656605b9 admin admin] PATH_INFO: `/v3/projects/5952306ba80f4a49bec5de370fbb86c8/users/0884ce7637be466ea5c334d1cf432285/roles/c17acc2a8bb348f59ba7edd22fcf0c47` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:48:05.289591 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7b6804-f1fb-4bf3-9818-5b0a656605b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5952306ba80f4a49bec5de370fbb86c8, user_id=0884ce7637be466ea5c334d1cf432285, role_id=c17acc2a8bb348f59ba7edd22fcf0c47)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:48:05.292356 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7b6804-f1fb-4bf3-9818-5b0a656605b9 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:48:05.382438 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1240/2462] 10.222.0.86 () {60 vars in 1482 bytes} [Tue Jun 7 14:48:05 2022] PUT /identity/v3/projects/5952306ba80f4a49bec5de370fbb86c8/users/0884ce7637be466ea5c334d1cf432285/roles/c17acc2a8bb348f59ba7edd22fcf0c47 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:48:05.396134 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1ebb7a-d474-460b-9df6-8f02ef028b37 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:48:05.396437 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1ebb7a-d474-460b-9df6-8f02ef028b37 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:48:05.396721 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1ebb7a-d474-460b-9df6-8f02ef028b37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:48:05.432795 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-6e1ebb7a-d474-460b-9df6-8f02ef028b37 None None] MFA Rules not processed for user `0884ce7637be466ea5c334d1cf432285`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:48:05.435872 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-6e1ebb7a-d474-460b-9df6-8f02ef028b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:48:05.560001 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1223/2463] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:48:05 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:48:05.569385 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7b6804-f1fb-4bf3-9818-5b0a656605b9 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:48:05.578146 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-6b7b6804-f1fb-4bf3-9818-5b0a656605b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:48:05.711488 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7b6804-f1fb-4bf3-9818-5b0a656605b9 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:48:05.717792 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dba1e3-9a77-445c-aea3-416f59ce57d2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b910435e5585436996ba5b5aeb7184bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:48:05.718725 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dba1e3-9a77-445c-aea3-416f59ce57d2 service glance] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:48:05.719240 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dba1e3-9a77-445c-aea3-416f59ce57d2 service glance] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:48:05.719867 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dba1e3-9a77-445c-aea3-416f59ce57d2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:48:05.730587 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:48:05.733660 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dba1e3-9a77-445c-aea3-416f59ce57d2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:48:05.736623 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dba1e3-9a77-445c-aea3-416f59ce57d2 service glance] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:48:05.763004 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1241/2464] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:48:05 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:48:15.550613 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=96,keystone:INSERT=3 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:48:16.580397 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=2 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:48:24.970378 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8401df6-b082-4083-9b8a-dd5de0d71ca9 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:48:24.970850 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8401df6-b082-4083-9b8a-dd5de0d71ca9 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:48:24.970947 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8401df6-b082-4083-9b8a-dd5de0d71ca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:48:24.988713 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-d8401df6-b082-4083-9b8a-dd5de0d71ca9 None None] MFA Rules not processed for user `d7b598c6a3f642ef9edc971ad3ebbe31`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:48:24.989911 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-d8401df6-b082-4083-9b8a-dd5de0d71ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:48:25.043698 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1224/2465] 10.222.0.86 () {58 vars in 1009 bytes} [Tue Jun 7 14:48:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:48:25.055570 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dba1e3-9a77-445c-aea3-416f59ce57d2 service glance] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:48:25.057022 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-81dba1e3-9a77-445c-aea3-416f59ce57d2 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:48:25.127170 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dba1e3-9a77-445c-aea3-416f59ce57d2 service glance] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:48:25.132695 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6549288d-291a-4969-9114-78b5007aa4f8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9774349dd2b4ec092ef04c3df050a7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:48:25.133342 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6549288d-291a-4969-9114-78b5007aa4f8 service swift] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:48:25.133630 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6549288d-291a-4969-9114-78b5007aa4f8 service swift] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:48:25.133910 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6549288d-291a-4969-9114-78b5007aa4f8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:48:25.142445 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6549288d-291a-4969-9114-78b5007aa4f8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:48:25.144106 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6549288d-291a-4969-9114-78b5007aa4f8 service swift] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:48:25.152945 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1242/2466] 10.222.0.86 () {60 vars in 1384 bytes} [Tue Jun 7 14:48:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 07 14:48:35.037088 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=25 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:48:35.149575 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=32 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:48:38.017710 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8401df6-b082-4083-9b8a-dd5de0d71ca9 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:48:38.080234 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8401df6-b082-4083-9b8a-dd5de0d71ca9 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:48:38.084642 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8babf583-7e23-41f1-bc96-7929804e1461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:48:38.086082 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8babf583-7e23-41f1-bc96-7929804e1461 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:48:38.086401 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8babf583-7e23-41f1-bc96-7929804e1461 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:48:38.086682 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8babf583-7e23-41f1-bc96-7929804e1461 admin admin] PATH_INFO: `/v3/users/0884ce7637be466ea5c334d1cf432285` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:48:38.087902 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8babf583-7e23-41f1-bc96-7929804e1461 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0884ce7637be466ea5c334d1cf432285)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:48:38.089813 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8babf583-7e23-41f1-bc96-7929804e1461 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:48:38.256197 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-8babf583-7e23-41f1-bc96-7929804e1461 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0884ce7637be466ea5c334d1cf432285'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:48:38.263971 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-8babf583-7e23-41f1-bc96-7929804e1461 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0884ce7637be466ea5c334d1cf432285'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:48:38.264653 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-8babf583-7e23-41f1-bc96-7929804e1461 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0884ce7637be466ea5c334d1cf432285'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:48:38.276560 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-8babf583-7e23-41f1-bc96-7929804e1461 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0884ce7637be466ea5c334d1cf432285'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:48:38.277287 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-8babf583-7e23-41f1-bc96-7929804e1461 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0884ce7637be466ea5c334d1cf432285'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:48:38.368897 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1225/2467] 10.222.0.86 () {58 vars in 1223 bytes} [Tue Jun 7 14:48:38 2022] DELETE /identity/v3/users/0884ce7637be466ea5c334d1cf432285 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:48:38.373498 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3ad22e-2e5b-4ccd-bf08-de8e0bf8b4c9 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:48:38.373984 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3ad22e-2e5b-4ccd-bf08-de8e0bf8b4c9 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:48:38.374171 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3ad22e-2e5b-4ccd-bf08-de8e0bf8b4c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:48:38.392857 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-9e3ad22e-2e5b-4ccd-bf08-de8e0bf8b4c9 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:48:38.394079 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-9e3ad22e-2e5b-4ccd-bf08-de8e0bf8b4c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:48:38.455901 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1243/2468] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:48:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:48:38.471920 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8babf583-7e23-41f1-bc96-7929804e1461 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:48:38.473347 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-8babf583-7e23-41f1-bc96-7929804e1461 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:48:38.531938 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8babf583-7e23-41f1-bc96-7929804e1461 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:48:38.535568 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d987b9a-8bb9-46ac-8759-0fe9d28c45b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dda603ec5517460a83c333db2af804d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:48:38.536238 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d987b9a-8bb9-46ac-8759-0fe9d28c45b2 service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:48:38.536521 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d987b9a-8bb9-46ac-8759-0fe9d28c45b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:48:38.536795 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d987b9a-8bb9-46ac-8759-0fe9d28c45b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:48:38.546016 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d987b9a-8bb9-46ac-8759-0fe9d28c45b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:48:38.547424 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d987b9a-8bb9-46ac-8759-0fe9d28c45b2 service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:48:38.557288 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1226/2469] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:48:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:48:38.997738 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3ad22e-2e5b-4ccd-bf08-de8e0bf8b4c9 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:48:38.999281 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-9e3ad22e-2e5b-4ccd-bf08-de8e0bf8b4c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:48:39.015871 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3ad22e-2e5b-4ccd-bf08-de8e0bf8b4c9 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:48:39.025896 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3364afca-b905-4caf-87ec-8751d539cacd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:48:39.026776 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3364afca-b905-4caf-87ec-8751d539cacd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:48:39.027066 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3364afca-b905-4caf-87ec-8751d539cacd admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:48:39.027348 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3364afca-b905-4caf-87ec-8751d539cacd admin admin] PATH_INFO: `/v3/projects/5952306ba80f4a49bec5de370fbb86c8` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:48:39.028575 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3364afca-b905-4caf-87ec-8751d539cacd admin admin] RBAC: Authorizing `identity:delete_project(project_id=5952306ba80f4a49bec5de370fbb86c8)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:48:39.030525 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3364afca-b905-4caf-87ec-8751d539cacd admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:48:39.119610 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-3364afca-b905-4caf-87ec-8751d539cacd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5952306ba80f4a49bec5de370fbb86c8', 'request_id': 'req-3364afca-b905-4caf-87ec-8751d539cacd'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:48:39.125828 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-3364afca-b905-4caf-87ec-8751d539cacd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5952306ba80f4a49bec5de370fbb86c8', 'request_id': 'req-3364afca-b905-4caf-87ec-8751d539cacd'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:48:39.219681 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-3364afca-b905-4caf-87ec-8751d539cacd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5952306ba80f4a49bec5de370fbb86c8', 'request_id': 'req-3364afca-b905-4caf-87ec-8751d539cacd'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:48:39.230937 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-3364afca-b905-4caf-87ec-8751d539cacd admin admin] The token cache is being invalidate because project 5952306ba80f4a49bec5de370fbb86c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:48:39.231250 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-3364afca-b905-4caf-87ec-8751d539cacd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:48:39.231915 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-3364afca-b905-4caf-87ec-8751d539cacd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:48:39.233460 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1244/2470] 10.222.0.86 () {58 vars in 1232 bytes} [Tue Jun 7 14:48:38 2022] DELETE /identity/v3/projects/5952306ba80f4a49bec5de370fbb86c8 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:48:44.397025 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d987b9a-8bb9-46ac-8759-0fe9d28c45b2 service neutron] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:48:44.398690 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-1d987b9a-8bb9-46ac-8759-0fe9d28c45b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:48:44.425842 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:48:44.470553 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d987b9a-8bb9-46ac-8759-0fe9d28c45b2 service neutron] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:48:44.530501 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36280319-6ea8-47a6-80f7-a4a1f27df3f8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e042f9d4a9345bb947e6a30f64a59ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:48:44.531162 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36280319-6ea8-47a6-80f7-a4a1f27df3f8 service placement] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:48:44.531450 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36280319-6ea8-47a6-80f7-a4a1f27df3f8 service placement] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:48:44.531732 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36280319-6ea8-47a6-80f7-a4a1f27df3f8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:48:44.533680 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-36280319-6ea8-47a6-80f7-a4a1f27df3f8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:48:44.546241 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36280319-6ea8-47a6-80f7-a4a1f27df3f8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:48:44.547910 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36280319-6ea8-47a6-80f7-a4a1f27df3f8 service placement] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:48:44.559516 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1227/2471] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:48:44 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:48:46.566815 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008c69c4-411a-4995-87bb-a8374f4fa8c4 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:48:46.567263 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008c69c4-411a-4995-87bb-a8374f4fa8c4 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:48:46.567379 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008c69c4-411a-4995-87bb-a8374f4fa8c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:48:46.585636 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-008c69c4-411a-4995-87bb-a8374f4fa8c4 None None] MFA Rules not processed for user `d7b598c6a3f642ef9edc971ad3ebbe31`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:48:46.586826 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-008c69c4-411a-4995-87bb-a8374f4fa8c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:48:46.640838 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1245/2472] 10.222.0.86 () {58 vars in 967 bytes} [Tue Jun 7 14:48:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:48:46.652986 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36280319-6ea8-47a6-80f7-a4a1f27df3f8 service placement] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:48:46.654386 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-36280319-6ea8-47a6-80f7-a4a1f27df3f8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:48:46.720977 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36280319-6ea8-47a6-80f7-a4a1f27df3f8 service placement] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:48:46.726367 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8c2e5e-6221-4928-8ea0-a437e6511f5b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9774349dd2b4ec092ef04c3df050a7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:48:46.726999 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8c2e5e-6221-4928-8ea0-a437e6511f5b service swift] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:48:46.727307 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8c2e5e-6221-4928-8ea0-a437e6511f5b service swift] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:48:46.727583 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8c2e5e-6221-4928-8ea0-a437e6511f5b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:48:46.736207 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8c2e5e-6221-4928-8ea0-a437e6511f5b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:48:46.737892 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8c2e5e-6221-4928-8ea0-a437e6511f5b service swift] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:48:46.746518 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1228/2473] 10.222.0.86 () {60 vars in 1384 bytes} [Tue Jun 7 14:48:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 07 14:48:49.967664 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554356cd-ef81-4f27-89c5-16236ca6b5bd None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:48:49.968178 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554356cd-ef81-4f27-89c5-16236ca6b5bd None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:48:49.968275 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554356cd-ef81-4f27-89c5-16236ca6b5bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:48:49.991990 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-554356cd-ef81-4f27-89c5-16236ca6b5bd None None] MFA Rules not processed for user `d7b598c6a3f642ef9edc971ad3ebbe31`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:48:49.993785 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-554356cd-ef81-4f27-89c5-16236ca6b5bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:48:50.004622 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1246/2474] 10.222.0.86 () {58 vars in 967 bytes} [Tue Jun 7 14:48:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:48:50.018848 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8c2e5e-6221-4928-8ea0-a437e6511f5b service swift] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:48:50.030064 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8c2e5e-6221-4928-8ea0-a437e6511f5b service swift] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:48:50.035414 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c21c0b3-81fb-4d8d-ae66-b327d6adf084 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9774349dd2b4ec092ef04c3df050a7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:48:50.036182 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c21c0b3-81fb-4d8d-ae66-b327d6adf084 service swift] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:48:50.036544 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c21c0b3-81fb-4d8d-ae66-b327d6adf084 service swift] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:48:50.036893 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c21c0b3-81fb-4d8d-ae66-b327d6adf084 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:48:50.046199 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c21c0b3-81fb-4d8d-ae66-b327d6adf084 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:48:50.047892 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c21c0b3-81fb-4d8d-ae66-b327d6adf084 service swift] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:48:50.057582 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1229/2475] 10.222.0.86 () {60 vars in 1384 bytes} [Tue Jun 7 14:48:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 07 14:48:51.564291 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554356cd-ef81-4f27-89c5-16236ca6b5bd None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:48:51.565721 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-554356cd-ef81-4f27-89c5-16236ca6b5bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:48:51.581651 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554356cd-ef81-4f27-89c5-16236ca6b5bd None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:48:51.588570 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91c93fc-c2e9-46b4-b503-e78aff1ead7d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e042f9d4a9345bb947e6a30f64a59ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:48:51.589454 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91c93fc-c2e9-46b4-b503-e78aff1ead7d service placement] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:48:51.589736 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91c93fc-c2e9-46b4-b503-e78aff1ead7d service placement] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:48:51.590007 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91c93fc-c2e9-46b4-b503-e78aff1ead7d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:48:51.591844 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-d91c93fc-c2e9-46b4-b503-e78aff1ead7d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:48:51.604317 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91c93fc-c2e9-46b4-b503-e78aff1ead7d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:48:51.606135 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91c93fc-c2e9-46b4-b503-e78aff1ead7d service placement] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:48:51.617124 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1247/2476] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:48:51 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:48:55.712240 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c21c0b3-81fb-4d8d-ae66-b327d6adf084 service swift] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:48:55.713692 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-2c21c0b3-81fb-4d8d-ae66-b327d6adf084 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:48:55.749747 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:48:55.781009 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c21c0b3-81fb-4d8d-ae66-b327d6adf084 service swift] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:48:55.785850 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4da22b8-ffe2-4e54-85e1-e290c52979b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:48:55.786755 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4da22b8-ffe2-4e54-85e1-e290c52979b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:48:55.787042 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4da22b8-ffe2-4e54-85e1-e290c52979b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:48:55.787320 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4da22b8-ffe2-4e54-85e1-e290c52979b2 admin admin] PATH_INFO: `/v3/users/5a0ee23baf5d43538190e437545038f5` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:48:55.788563 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4da22b8-ffe2-4e54-85e1-e290c52979b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a0ee23baf5d43538190e437545038f5)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:48:55.790528 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4da22b8-ffe2-4e54-85e1-e290c52979b2 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:48:55.980864 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-b4da22b8-ffe2-4e54-85e1-e290c52979b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a0ee23baf5d43538190e437545038f5'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:48:55.988023 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-b4da22b8-ffe2-4e54-85e1-e290c52979b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a0ee23baf5d43538190e437545038f5'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:48:55.988736 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-b4da22b8-ffe2-4e54-85e1-e290c52979b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a0ee23baf5d43538190e437545038f5'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:48:56.000786 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-b4da22b8-ffe2-4e54-85e1-e290c52979b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a0ee23baf5d43538190e437545038f5'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:48:56.005800 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-b4da22b8-ffe2-4e54-85e1-e290c52979b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a0ee23baf5d43538190e437545038f5'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:48:56.117687 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1230/2477] 10.222.0.86 () {58 vars in 1223 bytes} [Tue Jun 7 14:48:55 2022] DELETE /identity/v3/users/5a0ee23baf5d43538190e437545038f5 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:48:56.384798 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91c93fc-c2e9-46b4-b503-e78aff1ead7d service placement] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:48:56.397825 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91c93fc-c2e9-46b4-b503-e78aff1ead7d service placement] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:48:56.403124 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:48:56.461937 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e706a2-7a6a-417c-a5bb-b1109096a316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:48:56.463249 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e706a2-7a6a-417c-a5bb-b1109096a316 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:48:56.467562 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e706a2-7a6a-417c-a5bb-b1109096a316 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:48:56.467562 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e706a2-7a6a-417c-a5bb-b1109096a316 admin admin] PATH_INFO: `/v3/projects/6e03e26e1310487f8d02dca053e5138d` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:48:56.467562 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e706a2-7a6a-417c-a5bb-b1109096a316 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e03e26e1310487f8d02dca053e5138d)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:48:56.469171 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e706a2-7a6a-417c-a5bb-b1109096a316 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:48:56.624949 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-21e706a2-7a6a-417c-a5bb-b1109096a316 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e03e26e1310487f8d02dca053e5138d', 'request_id': 'req-21e706a2-7a6a-417c-a5bb-b1109096a316'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:48:56.631185 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-21e706a2-7a6a-417c-a5bb-b1109096a316 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e03e26e1310487f8d02dca053e5138d', 'request_id': 'req-21e706a2-7a6a-417c-a5bb-b1109096a316'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:48:56.778967 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-21e706a2-7a6a-417c-a5bb-b1109096a316 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e03e26e1310487f8d02dca053e5138d', 'request_id': 'req-21e706a2-7a6a-417c-a5bb-b1109096a316'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:48:56.790618 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-21e706a2-7a6a-417c-a5bb-b1109096a316 admin admin] The token cache is being invalidate because project 6e03e26e1310487f8d02dca053e5138d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:48:56.790985 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-21e706a2-7a6a-417c-a5bb-b1109096a316 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:48:56.791744 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-21e706a2-7a6a-417c-a5bb-b1109096a316 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:48:56.793577 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1248/2478] 10.222.0.86 () {58 vars in 1232 bytes} [Tue Jun 7 14:48:56 2022] DELETE /identity/v3/projects/6e03e26e1310487f8d02dca053e5138d => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:48:56.797577 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4da22b8-ffe2-4e54-85e1-e290c52979b2 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:48:56.799050 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-b4da22b8-ffe2-4e54-85e1-e290c52979b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:48:56.813242 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4da22b8-ffe2-4e54-85e1-e290c52979b2 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:48:56.870282 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ca54f8-5298-426a-963b-0b9914a9d538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:48:56.871084 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ca54f8-5298-426a-963b-0b9914a9d538 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:48:56.871417 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ca54f8-5298-426a-963b-0b9914a9d538 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:48:56.871703 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ca54f8-5298-426a-963b-0b9914a9d538 admin admin] PATH_INFO: `/v3/users/4a6478443dac495a990bdac10442e457` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:48:56.872977 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ca54f8-5298-426a-963b-0b9914a9d538 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a6478443dac495a990bdac10442e457)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:48:56.874980 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ca54f8-5298-426a-963b-0b9914a9d538 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:48:57.102081 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-a8ca54f8-5298-426a-963b-0b9914a9d538 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a6478443dac495a990bdac10442e457'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:48:57.106494 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:48:57.109369 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-a8ca54f8-5298-426a-963b-0b9914a9d538 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a6478443dac495a990bdac10442e457'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:48:57.110033 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-a8ca54f8-5298-426a-963b-0b9914a9d538 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a6478443dac495a990bdac10442e457'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:48:57.121752 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-a8ca54f8-5298-426a-963b-0b9914a9d538 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a6478443dac495a990bdac10442e457'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:48:57.122339 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-a8ca54f8-5298-426a-963b-0b9914a9d538 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a6478443dac495a990bdac10442e457'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:48:57.214035 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1231/2479] 10.222.0.86 () {58 vars in 1223 bytes} [Tue Jun 7 14:48:56 2022] DELETE /identity/v3/users/4a6478443dac495a990bdac10442e457 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:48:57.483605 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e706a2-7a6a-417c-a5bb-b1109096a316 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:48:57.485080 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-21e706a2-7a6a-417c-a5bb-b1109096a316 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:48:57.497861 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e706a2-7a6a-417c-a5bb-b1109096a316 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:48:57.556342 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9828a294-7297-48bc-8089-298c62b4577e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:48:57.558123 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9828a294-7297-48bc-8089-298c62b4577e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:48:57.558410 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9828a294-7297-48bc-8089-298c62b4577e admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:48:57.558689 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9828a294-7297-48bc-8089-298c62b4577e admin admin] PATH_INFO: `/v3/projects/c23152dc12c2455e9472ac374ea5e7a6` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:48:57.559949 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9828a294-7297-48bc-8089-298c62b4577e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c23152dc12c2455e9472ac374ea5e7a6)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:48:57.561902 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9828a294-7297-48bc-8089-298c62b4577e admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:48:57.693579 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:48:57.699989 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-9828a294-7297-48bc-8089-298c62b4577e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c23152dc12c2455e9472ac374ea5e7a6', 'request_id': 'req-9828a294-7297-48bc-8089-298c62b4577e'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:48:57.706111 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-9828a294-7297-48bc-8089-298c62b4577e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c23152dc12c2455e9472ac374ea5e7a6', 'request_id': 'req-9828a294-7297-48bc-8089-298c62b4577e'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:48:57.790261 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-9828a294-7297-48bc-8089-298c62b4577e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c23152dc12c2455e9472ac374ea5e7a6', 'request_id': 'req-9828a294-7297-48bc-8089-298c62b4577e'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:48:57.801034 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-9828a294-7297-48bc-8089-298c62b4577e admin admin] The token cache is being invalidate because project c23152dc12c2455e9472ac374ea5e7a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:48:57.801329 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-9828a294-7297-48bc-8089-298c62b4577e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:48:57.805667 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-9828a294-7297-48bc-8089-298c62b4577e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:48:57.805667 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1249/2480] 10.222.0.86 () {58 vars in 1232 bytes} [Tue Jun 7 14:48:57 2022] DELETE /identity/v3/projects/c23152dc12c2455e9472ac374ea5e7a6 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:49:07.281955 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=10,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:49:07.893670 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=9,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:49:21.502025 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ca54f8-5298-426a-963b-0b9914a9d538 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:49:21.503595 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-a8ca54f8-5298-426a-963b-0b9914a9d538 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:49:21.560861 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ca54f8-5298-426a-963b-0b9914a9d538 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:49:21.609278 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8197086-3ea1-4cdd-84a8-a807c072adb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dda603ec5517460a83c333db2af804d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:49:21.609926 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8197086-3ea1-4cdd-84a8-a807c072adb4 service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:49:21.610212 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8197086-3ea1-4cdd-84a8-a807c072adb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:49:21.610492 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8197086-3ea1-4cdd-84a8-a807c072adb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:49:21.612420 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-c8197086-3ea1-4cdd-84a8-a807c072adb4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:49:21.674661 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8197086-3ea1-4cdd-84a8-a807c072adb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:49:21.676049 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8197086-3ea1-4cdd-84a8-a807c072adb4 service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:49:21.686317 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1232/2481] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:49:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 14:49:25.019856 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9828a294-7297-48bc-8089-298c62b4577e admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:49:25.021449 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-9828a294-7297-48bc-8089-298c62b4577e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:49:25.035304 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9828a294-7297-48bc-8089-298c62b4577e admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:49:25.040644 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f4adfc-f756-47b1-9980-0c0b0e911f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:49:25.041518 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f4adfc-f756-47b1-9980-0c0b0e911f4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:49:25.041804 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f4adfc-f756-47b1-9980-0c0b0e911f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:49:25.042082 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f4adfc-f756-47b1-9980-0c0b0e911f4c admin admin] PATH_INFO: `/v3/users/3d5a010550bb4bf783a3cf75153d7e9f` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:49:25.043273 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f4adfc-f756-47b1-9980-0c0b0e911f4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d5a010550bb4bf783a3cf75153d7e9f)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:49:25.045230 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f4adfc-f756-47b1-9980-0c0b0e911f4c admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:49:25.272016 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-f9f4adfc-f756-47b1-9980-0c0b0e911f4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d5a010550bb4bf783a3cf75153d7e9f'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:49:25.272662 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-f9f4adfc-f756-47b1-9980-0c0b0e911f4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d5a010550bb4bf783a3cf75153d7e9f'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:49:25.279529 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-f9f4adfc-f756-47b1-9980-0c0b0e911f4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d5a010550bb4bf783a3cf75153d7e9f'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:49:25.291437 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-f9f4adfc-f756-47b1-9980-0c0b0e911f4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d5a010550bb4bf783a3cf75153d7e9f'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:49:25.292142 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-f9f4adfc-f756-47b1-9980-0c0b0e911f4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d5a010550bb4bf783a3cf75153d7e9f'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:49:25.388770 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1250/2482] 10.222.0.86 () {58 vars in 1223 bytes} [Tue Jun 7 14:49:25 2022] DELETE /identity/v3/users/3d5a010550bb4bf783a3cf75153d7e9f => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:49:25.745915 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8197086-3ea1-4cdd-84a8-a807c072adb4 service neutron] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:49:25.757820 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8197086-3ea1-4cdd-84a8-a807c072adb4 service neutron] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:49:25.818329 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1273bde5-f567-450f-ae1a-193d86e99410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:49:25.819189 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1273bde5-f567-450f-ae1a-193d86e99410 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:49:25.822208 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1273bde5-f567-450f-ae1a-193d86e99410 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:49:25.822208 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1273bde5-f567-450f-ae1a-193d86e99410 admin admin] PATH_INFO: `/v3/projects/0fc4ea7acf86499a8abd7b5f2cdfd6f1` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:49:25.822208 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1273bde5-f567-450f-ae1a-193d86e99410 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fc4ea7acf86499a8abd7b5f2cdfd6f1)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:49:25.822971 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1273bde5-f567-450f-ae1a-193d86e99410 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:49:25.830821 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:49:25.939469 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-1273bde5-f567-450f-ae1a-193d86e99410 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fc4ea7acf86499a8abd7b5f2cdfd6f1', 'request_id': 'req-1273bde5-f567-450f-ae1a-193d86e99410'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:49:25.945913 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-1273bde5-f567-450f-ae1a-193d86e99410 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fc4ea7acf86499a8abd7b5f2cdfd6f1', 'request_id': 'req-1273bde5-f567-450f-ae1a-193d86e99410'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:49:26.046667 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-1273bde5-f567-450f-ae1a-193d86e99410 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fc4ea7acf86499a8abd7b5f2cdfd6f1', 'request_id': 'req-1273bde5-f567-450f-ae1a-193d86e99410'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:49:26.058176 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-1273bde5-f567-450f-ae1a-193d86e99410 admin admin] The token cache is being invalidate because project 0fc4ea7acf86499a8abd7b5f2cdfd6f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:49:26.058581 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-1273bde5-f567-450f-ae1a-193d86e99410 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:49:26.059208 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-1273bde5-f567-450f-ae1a-193d86e99410 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:49:26.060904 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1233/2483] 10.222.0.86 () {58 vars in 1232 bytes} [Tue Jun 7 14:49:25 2022] DELETE /identity/v3/projects/0fc4ea7acf86499a8abd7b5f2cdfd6f1 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:49:26.068650 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4146fa-cc06-4aef-845d-476f70168df4 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:49:26.068650 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4146fa-cc06-4aef-845d-476f70168df4 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:49:26.068650 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4146fa-cc06-4aef-845d-476f70168df4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:49:26.086068 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-db4146fa-cc06-4aef-845d-476f70168df4 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:49:26.087255 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-db4146fa-cc06-4aef-845d-476f70168df4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:49:26.143670 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1251/2484] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:49:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:49:26.152884 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd864e99-f6d3-4f37-a2e5-c4c138ce90e3 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:49:26.153181 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd864e99-f6d3-4f37-a2e5-c4c138ce90e3 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:49:26.153466 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd864e99-f6d3-4f37-a2e5-c4c138ce90e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:49:26.172485 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-cd864e99-f6d3-4f37-a2e5-c4c138ce90e3 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:49:26.173714 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-cd864e99-f6d3-4f37-a2e5-c4c138ce90e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:49:26.182186 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1234/2485] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:49:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:49:26.186288 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4146fa-cc06-4aef-845d-476f70168df4 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:49:26.196302 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4146fa-cc06-4aef-845d-476f70168df4 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:49:26.200899 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ab2cbc-e062-4086-b857-b548dd74c2f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:49:26.201553 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ab2cbc-e062-4086-b857-b548dd74c2f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:49:26.201849 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ab2cbc-e062-4086-b857-b548dd74c2f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:49:26.202101 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ab2cbc-e062-4086-b857-b548dd74c2f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:49:26.202823 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ab2cbc-e062-4086-b857-b548dd74c2f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:49:26.203125 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ab2cbc-e062-4086-b857-b548dd74c2f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:49:26.204732 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ab2cbc-e062-4086-b857-b548dd74c2f7 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:49:26.216497 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1252/2486] 10.222.0.86 () {58 vars in 1152 bytes} [Tue Jun 7 14:49:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:49:26.220810 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd864e99-f6d3-4f37-a2e5-c4c138ce90e3 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:49:26.230453 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd864e99-f6d3-4f37-a2e5-c4c138ce90e3 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:49:26.235056 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55223335-93dd-4c8e-9230-947a86b8fb2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:49:26.235704 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55223335-93dd-4c8e-9230-947a86b8fb2d admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:49:26.236020 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55223335-93dd-4c8e-9230-947a86b8fb2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:49:26.236296 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55223335-93dd-4c8e-9230-947a86b8fb2d admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:49:26.237029 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55223335-93dd-4c8e-9230-947a86b8fb2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:49:26.239462 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55223335-93dd-4c8e-9230-947a86b8fb2d admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:49:26.338762 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1235/2487] 10.222.0.86 () {60 vars in 1152 bytes} [Tue Jun 7 14:49:26 2022] POST /identity/v3/projects => generated 371 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 14:49:26.342756 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ab2cbc-e062-4086-b857-b548dd74c2f7 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:49:26.352567 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ab2cbc-e062-4086-b857-b548dd74c2f7 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:49:26.408404 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12c9ba7-e568-4204-8517-366e1fca4c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:49:26.409104 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12c9ba7-e568-4204-8517-366e1fca4c88 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:49:26.409389 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12c9ba7-e568-4204-8517-366e1fca4c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:49:26.409674 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12c9ba7-e568-4204-8517-366e1fca4c88 admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:49:26.410370 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12c9ba7-e568-4204-8517-366e1fca4c88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:49:26.412374 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12c9ba7-e568-4204-8517-366e1fca4c88 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:49:26.418998 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:49:26.544472 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1253/2488] 10.222.0.86 () {60 vars in 1143 bytes} [Tue Jun 7 14:49:26 2022] POST /identity/v3/users => generated 286 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 14:49:26.548705 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55223335-93dd-4c8e-9230-947a86b8fb2d admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:49:26.559893 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55223335-93dd-4c8e-9230-947a86b8fb2d admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:49:26.564532 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169ec8c8-4b31-4db8-80c8-5db29f4ff366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:49:26.565185 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169ec8c8-4b31-4db8-80c8-5db29f4ff366 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:49:26.565474 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169ec8c8-4b31-4db8-80c8-5db29f4ff366 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:49:26.565756 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169ec8c8-4b31-4db8-80c8-5db29f4ff366 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:49:26.566488 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169ec8c8-4b31-4db8-80c8-5db29f4ff366 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:49:26.568518 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169ec8c8-4b31-4db8-80c8-5db29f4ff366 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:49:26.579425 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1236/2489] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:49:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:49:26.589955 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12c9ba7-e568-4204-8517-366e1fca4c88 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:49:26.600156 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12c9ba7-e568-4204-8517-366e1fca4c88 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:49:26.604731 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5aff98-a523-4bde-a161-38e6addbfc58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:49:26.605382 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5aff98-a523-4bde-a161-38e6addbfc58 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:49:26.605697 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5aff98-a523-4bde-a161-38e6addbfc58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:49:26.606164 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5aff98-a523-4bde-a161-38e6addbfc58 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:49:26.607067 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5aff98-a523-4bde-a161-38e6addbfc58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:49:26.608953 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5aff98-a523-4bde-a161-38e6addbfc58 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:49:26.619347 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1254/2490] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:49:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:49:26.623348 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169ec8c8-4b31-4db8-80c8-5db29f4ff366 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:49:26.633212 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169ec8c8-4b31-4db8-80c8-5db29f4ff366 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:49:26.637984 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fab4a1-b222-4616-ac02-8085b56eb795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:49:26.638848 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fab4a1-b222-4616-ac02-8085b56eb795 admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:49:26.639139 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fab4a1-b222-4616-ac02-8085b56eb795 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:49:26.639430 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fab4a1-b222-4616-ac02-8085b56eb795 admin admin] PATH_INFO: `/v3/projects/d48a41a196644e5e97146b009d0fd9b1/users/c6922f068b174279869e92eb4919627f/roles/c17acc2a8bb348f59ba7edd22fcf0c47` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:49:26.654111 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fab4a1-b222-4616-ac02-8085b56eb795 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d48a41a196644e5e97146b009d0fd9b1, user_id=c6922f068b174279869e92eb4919627f, role_id=c17acc2a8bb348f59ba7edd22fcf0c47)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:49:26.656878 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fab4a1-b222-4616-ac02-8085b56eb795 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:49:26.727525 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1237/2491] 10.222.0.86 () {60 vars in 1482 bytes} [Tue Jun 7 14:49:26 2022] PUT /identity/v3/projects/d48a41a196644e5e97146b009d0fd9b1/users/c6922f068b174279869e92eb4919627f/roles/c17acc2a8bb348f59ba7edd22fcf0c47 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:49:26.737737 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee8a2ba-e8e5-4fb3-82b9-746cd4b91530 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:49:26.738033 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee8a2ba-e8e5-4fb3-82b9-746cd4b91530 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:49:26.738310 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee8a2ba-e8e5-4fb3-82b9-746cd4b91530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:49:26.764386 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-cee8a2ba-e8e5-4fb3-82b9-746cd4b91530 None None] MFA Rules not processed for user `c6922f068b174279869e92eb4919627f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:49:26.765576 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-cee8a2ba-e8e5-4fb3-82b9-746cd4b91530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:49:26.828083 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1255/2492] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:49:26 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:49:26.832538 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fab4a1-b222-4616-ac02-8085b56eb795 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:49:26.895002 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fab4a1-b222-4616-ac02-8085b56eb795 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:49:26.900208 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa885261-18e5-47a5-a584-c4f7f85e05dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:49:26.900858 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa885261-18e5-47a5-a584-c4f7f85e05dd admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:49:26.901145 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa885261-18e5-47a5-a584-c4f7f85e05dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:49:26.901424 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa885261-18e5-47a5-a584-c4f7f85e05dd admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:49:26.902172 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa885261-18e5-47a5-a584-c4f7f85e05dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:49:26.904192 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa885261-18e5-47a5-a584-c4f7f85e05dd admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:49:27.014086 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1238/2493] 10.222.0.86 () {60 vars in 1152 bytes} [Tue Jun 7 14:49:26 2022] POST /identity/v3/projects => generated 373 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:49:27.018232 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee8a2ba-e8e5-4fb3-82b9-746cd4b91530 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:49:27.029249 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee8a2ba-e8e5-4fb3-82b9-746cd4b91530 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:49:27.084338 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca780211-ab6f-4d3b-a1fd-f9c3cd237900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:49:27.085003 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca780211-ab6f-4d3b-a1fd-f9c3cd237900 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:49:27.085284 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca780211-ab6f-4d3b-a1fd-f9c3cd237900 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:49:27.085557 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca780211-ab6f-4d3b-a1fd-f9c3cd237900 admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:49:27.086247 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca780211-ab6f-4d3b-a1fd-f9c3cd237900 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:49:27.088187 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca780211-ab6f-4d3b-a1fd-f9c3cd237900 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:49:27.168267 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1256/2494] 10.222.0.86 () {60 vars in 1143 bytes} [Tue Jun 7 14:49:27 2022] POST /identity/v3/users => generated 293 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:49:27.172195 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa885261-18e5-47a5-a584-c4f7f85e05dd admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:49:27.182600 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa885261-18e5-47a5-a584-c4f7f85e05dd admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:49:27.187168 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27185280-4e3b-40f0-a4e9-e43580d0605d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:49:27.187857 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27185280-4e3b-40f0-a4e9-e43580d0605d admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:49:27.188141 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27185280-4e3b-40f0-a4e9-e43580d0605d admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:49:27.188414 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27185280-4e3b-40f0-a4e9-e43580d0605d admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:49:27.189137 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27185280-4e3b-40f0-a4e9-e43580d0605d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:49:27.190740 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27185280-4e3b-40f0-a4e9-e43580d0605d admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:49:27.201548 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1239/2495] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:49:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:49:27.205705 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca780211-ab6f-4d3b-a1fd-f9c3cd237900 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:49:27.216596 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca780211-ab6f-4d3b-a1fd-f9c3cd237900 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:49:27.221376 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9061ca4a-6b4e-4fa8-bbb3-93c704066fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:49:27.222257 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9061ca4a-6b4e-4fa8-bbb3-93c704066fd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:49:27.222542 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9061ca4a-6b4e-4fa8-bbb3-93c704066fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:49:27.222852 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9061ca4a-6b4e-4fa8-bbb3-93c704066fd1 admin admin] PATH_INFO: `/v3/projects/7ce99f61a7b54092957325ff9b637558/users/d5ff5d56311e42f587cae53cfbc69b6d/roles/e3bf6239f5bf477b965704b086786f11` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:49:27.238520 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9061ca4a-6b4e-4fa8-bbb3-93c704066fd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ce99f61a7b54092957325ff9b637558, user_id=d5ff5d56311e42f587cae53cfbc69b6d, role_id=e3bf6239f5bf477b965704b086786f11)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:49:27.241171 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9061ca4a-6b4e-4fa8-bbb3-93c704066fd1 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:49:27.350309 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1257/2496] 10.222.0.86 () {60 vars in 1482 bytes} [Tue Jun 7 14:49:27 2022] PUT /identity/v3/projects/7ce99f61a7b54092957325ff9b637558/users/d5ff5d56311e42f587cae53cfbc69b6d/roles/e3bf6239f5bf477b965704b086786f11 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 14:49:27.354384 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27185280-4e3b-40f0-a4e9-e43580d0605d admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:49:27.364249 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27185280-4e3b-40f0-a4e9-e43580d0605d admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:49:27.367887 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:49:27.421078 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a509c003-cfc6-4d85-970e-16d2f8df7c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:49:27.421671 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a509c003-cfc6-4d85-970e-16d2f8df7c2c admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:49:27.421955 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a509c003-cfc6-4d85-970e-16d2f8df7c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:49:27.422231 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a509c003-cfc6-4d85-970e-16d2f8df7c2c admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:49:27.423019 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a509c003-cfc6-4d85-970e-16d2f8df7c2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:49:27.425207 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a509c003-cfc6-4d85-970e-16d2f8df7c2c admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:49:27.435725 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1240/2497] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:49:27 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:49:27.439996 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9061ca4a-6b4e-4fa8-bbb3-93c704066fd1 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:49:27.450995 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9061ca4a-6b4e-4fa8-bbb3-93c704066fd1 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:49:27.455643 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c2191f-a7a8-431f-a005-957df2485a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:49:27.456581 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c2191f-a7a8-431f-a005-957df2485a89 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:49:27.457615 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c2191f-a7a8-431f-a005-957df2485a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:49:27.458439 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c2191f-a7a8-431f-a005-957df2485a89 admin admin] PATH_INFO: `/v3/projects/7ce99f61a7b54092957325ff9b637558/users/d5ff5d56311e42f587cae53cfbc69b6d/roles/e3bf6239f5bf477b965704b086786f11` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:49:27.460476 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c2191f-a7a8-431f-a005-957df2485a89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ce99f61a7b54092957325ff9b637558, user_id=d5ff5d56311e42f587cae53cfbc69b6d, role_id=e3bf6239f5bf477b965704b086786f11)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:49:27.463100 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c2191f-a7a8-431f-a005-957df2485a89 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:49:27.475577 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1258/2498] 10.222.0.86 () {60 vars in 1482 bytes} [Tue Jun 7 14:49:27 2022] PUT /identity/v3/projects/7ce99f61a7b54092957325ff9b637558/users/d5ff5d56311e42f587cae53cfbc69b6d/roles/e3bf6239f5bf477b965704b086786f11 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:49:27.485662 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba97756-5ca2-4f5c-be55-ad3cbdb403f1 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:49:27.485861 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba97756-5ca2-4f5c-be55-ad3cbdb403f1 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:49:27.486129 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba97756-5ca2-4f5c-be55-ad3cbdb403f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:49:27.514435 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-6ba97756-5ca2-4f5c-be55-ad3cbdb403f1 None None] MFA Rules not processed for user `d5ff5d56311e42f587cae53cfbc69b6d`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:49:27.515640 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-6ba97756-5ca2-4f5c-be55-ad3cbdb403f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:49:27.584364 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1241/2499] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:49:27 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:49:27.596075 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c2191f-a7a8-431f-a005-957df2485a89 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:49:27.598328 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-c4c2191f-a7a8-431f-a005-957df2485a89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:49:27.621770 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:49:27.656491 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c2191f-a7a8-431f-a005-957df2485a89 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:49:27.660110 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9181c1cb-2ad9-473d-9146-cb15b404cc61 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af5a95620a4b43538abfe09eed4bf115', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:49:27.660774 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9181c1cb-2ad9-473d-9146-cb15b404cc61 service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:49:27.661052 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9181c1cb-2ad9-473d-9146-cb15b404cc61 service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:49:27.661323 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9181c1cb-2ad9-473d-9146-cb15b404cc61 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:49:27.670225 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9181c1cb-2ad9-473d-9146-cb15b404cc61 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:49:27.671696 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9181c1cb-2ad9-473d-9146-cb15b404cc61 service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:49:27.681323 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1259/2500] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:49:27 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:49:28.595190 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba97756-5ca2-4f5c-be55-ad3cbdb403f1 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:49:28.656994 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba97756-5ca2-4f5c-be55-ad3cbdb403f1 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:49:28.662338 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480417a4-6674-49e6-bcd6-32bc15085ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:49:28.663207 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480417a4-6674-49e6-bcd6-32bc15085ddb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:49:28.663496 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480417a4-6674-49e6-bcd6-32bc15085ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:49:28.666066 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480417a4-6674-49e6-bcd6-32bc15085ddb admin admin] PATH_INFO: `/v3/users/c6922f068b174279869e92eb4919627f` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:49:28.666066 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480417a4-6674-49e6-bcd6-32bc15085ddb admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6922f068b174279869e92eb4919627f)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:49:28.666944 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480417a4-6674-49e6-bcd6-32bc15085ddb admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:49:28.842010 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:49:28.855101 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-480417a4-6674-49e6-bcd6-32bc15085ddb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6922f068b174279869e92eb4919627f'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:49:28.861961 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-480417a4-6674-49e6-bcd6-32bc15085ddb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6922f068b174279869e92eb4919627f'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:49:28.862645 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-480417a4-6674-49e6-bcd6-32bc15085ddb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6922f068b174279869e92eb4919627f'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:49:28.874256 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-480417a4-6674-49e6-bcd6-32bc15085ddb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6922f068b174279869e92eb4919627f'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:49:28.874895 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-480417a4-6674-49e6-bcd6-32bc15085ddb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6922f068b174279869e92eb4919627f'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:49:28.972270 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1242/2501] 10.222.0.86 () {58 vars in 1223 bytes} [Tue Jun 7 14:49:28 2022] DELETE /identity/v3/users/c6922f068b174279869e92eb4919627f => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:49:28.976923 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0164b647-93e5-4d93-b89e-4913bc10bc79 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:49:28.977400 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0164b647-93e5-4d93-b89e-4913bc10bc79 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:49:28.981437 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0164b647-93e5-4d93-b89e-4913bc10bc79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:49:28.994444 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-0164b647-93e5-4d93-b89e-4913bc10bc79 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:49:28.995646 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-0164b647-93e5-4d93-b89e-4913bc10bc79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:49:29.053949 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1260/2502] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:49:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:49:29.063395 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480417a4-6674-49e6-bcd6-32bc15085ddb admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:49:29.064819 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-480417a4-6674-49e6-bcd6-32bc15085ddb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:49:29.120591 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480417a4-6674-49e6-bcd6-32bc15085ddb admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:49:29.124152 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d97061e-44e3-404f-a419-e5b8767b46b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dda603ec5517460a83c333db2af804d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:49:29.124792 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d97061e-44e3-404f-a419-e5b8767b46b1 service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:49:29.125077 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d97061e-44e3-404f-a419-e5b8767b46b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:49:29.125352 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d97061e-44e3-404f-a419-e5b8767b46b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:49:29.135044 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d97061e-44e3-404f-a419-e5b8767b46b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:49:29.136483 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d97061e-44e3-404f-a419-e5b8767b46b1 service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:49:29.145799 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1243/2503] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:49:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 14:49:29.557358 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0164b647-93e5-4d93-b89e-4913bc10bc79 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:49:29.558865 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-0164b647-93e5-4d93-b89e-4913bc10bc79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:49:29.570610 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0164b647-93e5-4d93-b89e-4913bc10bc79 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:49:29.576333 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83761546-a821-4588-8819-0546662f9a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:49:29.577448 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83761546-a821-4588-8819-0546662f9a32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:49:29.577736 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83761546-a821-4588-8819-0546662f9a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:49:29.578012 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83761546-a821-4588-8819-0546662f9a32 admin admin] PATH_INFO: `/v3/projects/d48a41a196644e5e97146b009d0fd9b1` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:49:29.579371 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83761546-a821-4588-8819-0546662f9a32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d48a41a196644e5e97146b009d0fd9b1)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:49:29.581917 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83761546-a821-4588-8819-0546662f9a32 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:49:29.681289 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-83761546-a821-4588-8819-0546662f9a32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd48a41a196644e5e97146b009d0fd9b1', 'request_id': 'req-83761546-a821-4588-8819-0546662f9a32'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:49:29.687214 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-83761546-a821-4588-8819-0546662f9a32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd48a41a196644e5e97146b009d0fd9b1', 'request_id': 'req-83761546-a821-4588-8819-0546662f9a32'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:49:29.783871 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-83761546-a821-4588-8819-0546662f9a32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd48a41a196644e5e97146b009d0fd9b1', 'request_id': 'req-83761546-a821-4588-8819-0546662f9a32'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:49:29.794748 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-83761546-a821-4588-8819-0546662f9a32 admin admin] The token cache is being invalidate because project d48a41a196644e5e97146b009d0fd9b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:49:29.795038 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-83761546-a821-4588-8819-0546662f9a32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:49:29.795646 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-83761546-a821-4588-8819-0546662f9a32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:49:29.797265 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1261/2504] 10.222.0.86 () {58 vars in 1232 bytes} [Tue Jun 7 14:49:29 2022] DELETE /identity/v3/projects/d48a41a196644e5e97146b009d0fd9b1 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:49:29.801885 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d97061e-44e3-404f-a419-e5b8767b46b1 service neutron] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:49:29.811659 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d97061e-44e3-404f-a419-e5b8767b46b1 service neutron] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:49:29.869286 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc256857-f50c-4902-a24f-2f95e180cb7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:49:29.870148 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc256857-f50c-4902-a24f-2f95e180cb7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:49:29.870427 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc256857-f50c-4902-a24f-2f95e180cb7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:49:29.870699 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc256857-f50c-4902-a24f-2f95e180cb7b admin admin] PATH_INFO: `/v3/users/d5ff5d56311e42f587cae53cfbc69b6d` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:49:29.871896 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc256857-f50c-4902-a24f-2f95e180cb7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5ff5d56311e42f587cae53cfbc69b6d)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:49:29.873792 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc256857-f50c-4902-a24f-2f95e180cb7b admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:49:30.094539 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-dc256857-f50c-4902-a24f-2f95e180cb7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5ff5d56311e42f587cae53cfbc69b6d'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:49:30.099680 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:49:30.102463 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-dc256857-f50c-4902-a24f-2f95e180cb7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5ff5d56311e42f587cae53cfbc69b6d'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:49:30.103162 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-dc256857-f50c-4902-a24f-2f95e180cb7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5ff5d56311e42f587cae53cfbc69b6d'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:49:30.114948 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-dc256857-f50c-4902-a24f-2f95e180cb7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5ff5d56311e42f587cae53cfbc69b6d'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:49:30.115649 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-dc256857-f50c-4902-a24f-2f95e180cb7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5ff5d56311e42f587cae53cfbc69b6d'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:49:30.224107 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1244/2505] 10.222.0.86 () {58 vars in 1223 bytes} [Tue Jun 7 14:49:29 2022] DELETE /identity/v3/users/d5ff5d56311e42f587cae53cfbc69b6d => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:49:30.632275 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83761546-a821-4588-8819-0546662f9a32 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:49:30.633910 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-83761546-a821-4588-8819-0546662f9a32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:49:30.648646 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83761546-a821-4588-8819-0546662f9a32 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:49:30.696382 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:49:30.709101 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9288a0aa-87d7-4df1-b1a9-13431b820e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:49:30.709964 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9288a0aa-87d7-4df1-b1a9-13431b820e68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:49:30.710249 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9288a0aa-87d7-4df1-b1a9-13431b820e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:49:30.710517 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9288a0aa-87d7-4df1-b1a9-13431b820e68 admin admin] PATH_INFO: `/v3/projects/7ce99f61a7b54092957325ff9b637558` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:49:30.711681 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9288a0aa-87d7-4df1-b1a9-13431b820e68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ce99f61a7b54092957325ff9b637558)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:49:30.713603 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9288a0aa-87d7-4df1-b1a9-13431b820e68 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:49:30.819122 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-9288a0aa-87d7-4df1-b1a9-13431b820e68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ce99f61a7b54092957325ff9b637558', 'request_id': 'req-9288a0aa-87d7-4df1-b1a9-13431b820e68'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:49:30.825362 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-9288a0aa-87d7-4df1-b1a9-13431b820e68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ce99f61a7b54092957325ff9b637558', 'request_id': 'req-9288a0aa-87d7-4df1-b1a9-13431b820e68'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:49:30.921522 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-9288a0aa-87d7-4df1-b1a9-13431b820e68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ce99f61a7b54092957325ff9b637558', 'request_id': 'req-9288a0aa-87d7-4df1-b1a9-13431b820e68'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:49:30.933072 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-9288a0aa-87d7-4df1-b1a9-13431b820e68 admin admin] The token cache is being invalidate because project 7ce99f61a7b54092957325ff9b637558 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:49:30.933365 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-9288a0aa-87d7-4df1-b1a9-13431b820e68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:49:30.934071 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-9288a0aa-87d7-4df1-b1a9-13431b820e68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:49:30.935710 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1262/2506] 10.222.0.86 () {58 vars in 1232 bytes} [Tue Jun 7 14:49:30 2022] DELETE /identity/v3/projects/7ce99f61a7b54092957325ff9b637558 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:49:30.941619 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3588449-7695-4a83-936c-b2ba2de701ba None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:49:30.942797 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3588449-7695-4a83-936c-b2ba2de701ba None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:49:30.942883 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3588449-7695-4a83-936c-b2ba2de701ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:49:30.960900 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-b3588449-7695-4a83-936c-b2ba2de701ba None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:49:30.962358 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-b3588449-7695-4a83-936c-b2ba2de701ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:49:31.021167 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1245/2507] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:49:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:49:31.030322 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23ab55d-db1b-45a8-83b1-63d6ea23c233 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:49:31.030601 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23ab55d-db1b-45a8-83b1-63d6ea23c233 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:49:31.030883 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23ab55d-db1b-45a8-83b1-63d6ea23c233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:49:31.049617 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-b23ab55d-db1b-45a8-83b1-63d6ea23c233 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:49:31.050858 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-b23ab55d-db1b-45a8-83b1-63d6ea23c233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:49:31.059424 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1263/2508] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:49:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:49:31.063646 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3588449-7695-4a83-936c-b2ba2de701ba None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:49:31.073138 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3588449-7695-4a83-936c-b2ba2de701ba None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:49:31.077752 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94361268-0e5f-4194-8bdf-ff2043a77225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:49:31.078403 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94361268-0e5f-4194-8bdf-ff2043a77225 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:49:31.078690 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94361268-0e5f-4194-8bdf-ff2043a77225 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:49:31.078965 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94361268-0e5f-4194-8bdf-ff2043a77225 admin admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:49:31.079692 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94361268-0e5f-4194-8bdf-ff2043a77225 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:49:31.080034 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94361268-0e5f-4194-8bdf-ff2043a77225 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:49:31.081624 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94361268-0e5f-4194-8bdf-ff2043a77225 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:49:31.093042 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1246/2509] 10.222.0.86 () {58 vars in 1152 bytes} [Tue Jun 7 14:49:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:49:31.097414 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23ab55d-db1b-45a8-83b1-63d6ea23c233 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:49:31.107135 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23ab55d-db1b-45a8-83b1-63d6ea23c233 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:49:31.111857 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb83ddd-d926-4676-a9d5-f6dc1a4a0ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:49:31.112502 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb83ddd-d926-4676-a9d5-f6dc1a4a0ca2 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:49:31.112788 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb83ddd-d926-4676-a9d5-f6dc1a4a0ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:49:31.113069 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb83ddd-d926-4676-a9d5-f6dc1a4a0ca2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:49:31.114467 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb83ddd-d926-4676-a9d5-f6dc1a4a0ca2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:49:31.116375 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb83ddd-d926-4676-a9d5-f6dc1a4a0ca2 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:49:31.219677 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1264/2510] 10.222.0.86 () {60 vars in 1152 bytes} [Tue Jun 7 14:49:31 2022] POST /identity/v3/projects => generated 375 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 14:49:31.228555 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94361268-0e5f-4194-8bdf-ff2043a77225 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:49:31.239447 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94361268-0e5f-4194-8bdf-ff2043a77225 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:49:31.296990 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8664b077-abd5-4e30-a1c2-be24d45f7b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:49:31.297651 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8664b077-abd5-4e30-a1c2-be24d45f7b61 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:49:31.297940 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8664b077-abd5-4e30-a1c2-be24d45f7b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:49:31.298217 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8664b077-abd5-4e30-a1c2-be24d45f7b61 admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:49:31.298934 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8664b077-abd5-4e30-a1c2-be24d45f7b61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:49:31.300917 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8664b077-abd5-4e30-a1c2-be24d45f7b61 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:49:31.390162 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1247/2511] 10.222.0.86 () {60 vars in 1143 bytes} [Tue Jun 7 14:49:31 2022] POST /identity/v3/users => generated 288 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:49:31.394480 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb83ddd-d926-4676-a9d5-f6dc1a4a0ca2 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:49:31.405313 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb83ddd-d926-4676-a9d5-f6dc1a4a0ca2 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:49:31.409818 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ad14ca-7603-485d-aadb-07db9b0daab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:49:31.410467 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ad14ca-7603-485d-aadb-07db9b0daab1 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:49:31.411365 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ad14ca-7603-485d-aadb-07db9b0daab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:49:31.411636 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ad14ca-7603-485d-aadb-07db9b0daab1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:49:31.412386 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ad14ca-7603-485d-aadb-07db9b0daab1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:49:31.413959 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ad14ca-7603-485d-aadb-07db9b0daab1 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:49:31.424543 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1265/2512] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:49:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:49:31.428523 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8664b077-abd5-4e30-a1c2-be24d45f7b61 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:49:31.438430 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8664b077-abd5-4e30-a1c2-be24d45f7b61 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:49:31.443034 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaa5f2b-5127-449f-adaa-c862681c5645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:49:31.443719 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaa5f2b-5127-449f-adaa-c862681c5645 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:49:31.444037 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaa5f2b-5127-449f-adaa-c862681c5645 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:49:31.444348 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaa5f2b-5127-449f-adaa-c862681c5645 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:49:31.445077 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaa5f2b-5127-449f-adaa-c862681c5645 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:49:31.446652 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaa5f2b-5127-449f-adaa-c862681c5645 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:49:31.456475 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1248/2513] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:49:31 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:49:31.460956 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ad14ca-7603-485d-aadb-07db9b0daab1 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:49:31.473862 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ad14ca-7603-485d-aadb-07db9b0daab1 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:49:31.476783 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31e3b1b-bd13-4727-96ff-f702b1a0fa69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:49:31.477649 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31e3b1b-bd13-4727-96ff-f702b1a0fa69 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:49:31.477929 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31e3b1b-bd13-4727-96ff-f702b1a0fa69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:49:31.478237 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31e3b1b-bd13-4727-96ff-f702b1a0fa69 admin admin] PATH_INFO: `/v3/projects/c059648143a94b4e9b1f8aa45faecd91/users/f739824a4f4447f6bc33cab1d9dca3d2/roles/c17acc2a8bb348f59ba7edd22fcf0c47` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:49:31.493159 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31e3b1b-bd13-4727-96ff-f702b1a0fa69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c059648143a94b4e9b1f8aa45faecd91, user_id=f739824a4f4447f6bc33cab1d9dca3d2, role_id=c17acc2a8bb348f59ba7edd22fcf0c47)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:49:31.495786 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31e3b1b-bd13-4727-96ff-f702b1a0fa69 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:49:31.590189 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1266/2514] 10.222.0.86 () {60 vars in 1482 bytes} [Tue Jun 7 14:49:31 2022] PUT /identity/v3/projects/c059648143a94b4e9b1f8aa45faecd91/users/f739824a4f4447f6bc33cab1d9dca3d2/roles/c17acc2a8bb348f59ba7edd22fcf0c47 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 14:49:31.601234 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dfd1ac-2fc9-4598-97e5-baeadd7d0882 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:49:31.601528 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dfd1ac-2fc9-4598-97e5-baeadd7d0882 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:49:31.601809 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dfd1ac-2fc9-4598-97e5-baeadd7d0882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:49:31.628135 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-c1dfd1ac-2fc9-4598-97e5-baeadd7d0882 None None] MFA Rules not processed for user `f739824a4f4447f6bc33cab1d9dca3d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:49:31.629342 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-c1dfd1ac-2fc9-4598-97e5-baeadd7d0882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:49:31.653855 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:49:31.694625 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1249/2515] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:49:31 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:49:31.699131 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31e3b1b-bd13-4727-96ff-f702b1a0fa69 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:49:31.760308 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31e3b1b-bd13-4727-96ff-f702b1a0fa69 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:49:31.764907 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1e54c9-158e-47cf-b8df-6e975aabe693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:49:31.765558 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1e54c9-158e-47cf-b8df-6e975aabe693 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:49:31.766160 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1e54c9-158e-47cf-b8df-6e975aabe693 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:49:31.766160 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1e54c9-158e-47cf-b8df-6e975aabe693 admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:49:31.766823 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1e54c9-158e-47cf-b8df-6e975aabe693 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:49:31.768748 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1e54c9-158e-47cf-b8df-6e975aabe693 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:49:31.835928 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:49:31.843233 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1267/2516] 10.222.0.86 () {60 vars in 1152 bytes} [Tue Jun 7 14:49:31 2022] POST /identity/v3/projects => generated 375 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:49:31.847272 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dfd1ac-2fc9-4598-97e5-baeadd7d0882 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:49:31.858670 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dfd1ac-2fc9-4598-97e5-baeadd7d0882 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:49:31.916184 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9e734b-48fe-4d32-89e7-f6447b3328ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:49:31.917229 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9e734b-48fe-4d32-89e7-f6447b3328ac admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:49:31.917517 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9e734b-48fe-4d32-89e7-f6447b3328ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:49:31.917935 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9e734b-48fe-4d32-89e7-f6447b3328ac admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:49:31.918614 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9e734b-48fe-4d32-89e7-f6447b3328ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:49:31.920679 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9e734b-48fe-4d32-89e7-f6447b3328ac admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:49:32.111002 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1250/2517] 10.222.0.86 () {60 vars in 1143 bytes} [Tue Jun 7 14:49:31 2022] POST /identity/v3/users => generated 294 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:49:32.114421 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1e54c9-158e-47cf-b8df-6e975aabe693 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:49:32.126025 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1e54c9-158e-47cf-b8df-6e975aabe693 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:49:32.131704 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86aea0e-15e4-428d-a5fd-23eefa818990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:49:32.132411 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86aea0e-15e4-428d-a5fd-23eefa818990 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:49:32.132695 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86aea0e-15e4-428d-a5fd-23eefa818990 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:49:32.132972 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86aea0e-15e4-428d-a5fd-23eefa818990 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:49:32.133710 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86aea0e-15e4-428d-a5fd-23eefa818990 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:49:32.135649 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86aea0e-15e4-428d-a5fd-23eefa818990 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:49:32.147396 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1268/2518] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:49:32 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:49:32.151720 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9e734b-48fe-4d32-89e7-f6447b3328ac admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:49:32.162781 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9e734b-48fe-4d32-89e7-f6447b3328ac admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:49:32.167612 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748b345d-06d7-41d3-954c-32a460e11eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:49:32.168532 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748b345d-06d7-41d3-954c-32a460e11eff admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:49:32.168814 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748b345d-06d7-41d3-954c-32a460e11eff admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:49:32.169089 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748b345d-06d7-41d3-954c-32a460e11eff admin admin] PATH_INFO: `/v3/projects/1d687a2989204626bce24e76490a4df6/users/69d9d87b64fa43daa8052385aafa3a20/roles/e3bf6239f5bf477b965704b086786f11` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:49:32.185710 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748b345d-06d7-41d3-954c-32a460e11eff admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d687a2989204626bce24e76490a4df6, user_id=69d9d87b64fa43daa8052385aafa3a20, role_id=e3bf6239f5bf477b965704b086786f11)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:49:32.188820 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748b345d-06d7-41d3-954c-32a460e11eff admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:49:32.259084 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1251/2519] 10.222.0.86 () {60 vars in 1482 bytes} [Tue Jun 7 14:49:32 2022] PUT /identity/v3/projects/1d687a2989204626bce24e76490a4df6/users/69d9d87b64fa43daa8052385aafa3a20/roles/e3bf6239f5bf477b965704b086786f11 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:49:32.263536 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86aea0e-15e4-428d-a5fd-23eefa818990 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:49:32.273081 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86aea0e-15e4-428d-a5fd-23eefa818990 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:49:32.328817 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c9d0e4-48be-4e66-a086-5e737913db18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:49:32.329485 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c9d0e4-48be-4e66-a086-5e737913db18 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:49:32.329770 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c9d0e4-48be-4e66-a086-5e737913db18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:49:32.330046 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c9d0e4-48be-4e66-a086-5e737913db18 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:49:32.330770 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c9d0e4-48be-4e66-a086-5e737913db18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:49:32.332400 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c9d0e4-48be-4e66-a086-5e737913db18 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:49:32.341977 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1269/2520] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:49:32 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:49:32.346217 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748b345d-06d7-41d3-954c-32a460e11eff admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:49:32.356320 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748b345d-06d7-41d3-954c-32a460e11eff admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:49:32.361566 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30f5063-a465-4635-b71c-997c1f0fa029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:49:32.362425 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30f5063-a465-4635-b71c-997c1f0fa029 admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:49:32.362705 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30f5063-a465-4635-b71c-997c1f0fa029 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:49:32.363106 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30f5063-a465-4635-b71c-997c1f0fa029 admin admin] PATH_INFO: `/v3/projects/1d687a2989204626bce24e76490a4df6/users/69d9d87b64fa43daa8052385aafa3a20/roles/e3bf6239f5bf477b965704b086786f11` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:49:32.365969 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30f5063-a465-4635-b71c-997c1f0fa029 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d687a2989204626bce24e76490a4df6, user_id=69d9d87b64fa43daa8052385aafa3a20, role_id=e3bf6239f5bf477b965704b086786f11)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:49:32.368778 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30f5063-a465-4635-b71c-997c1f0fa029 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:49:32.378791 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1252/2521] 10.222.0.86 () {60 vars in 1482 bytes} [Tue Jun 7 14:49:32 2022] PUT /identity/v3/projects/1d687a2989204626bce24e76490a4df6/users/69d9d87b64fa43daa8052385aafa3a20/roles/e3bf6239f5bf477b965704b086786f11 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:49:32.390709 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e55c37-2782-470c-8d63-c4b84c5ac2cd None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:49:32.390997 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e55c37-2782-470c-8d63-c4b84c5ac2cd None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:49:32.391274 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e55c37-2782-470c-8d63-c4b84c5ac2cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:49:32.416595 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-a3e55c37-2782-470c-8d63-c4b84c5ac2cd None None] MFA Rules not processed for user `69d9d87b64fa43daa8052385aafa3a20`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:49:32.417777 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-a3e55c37-2782-470c-8d63-c4b84c5ac2cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:49:32.484675 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1270/2522] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:49:32 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:49:32.496200 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30f5063-a465-4635-b71c-997c1f0fa029 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:49:32.498155 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-d30f5063-a465-4635-b71c-997c1f0fa029 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:49:32.556070 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30f5063-a465-4635-b71c-997c1f0fa029 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:49:32.559696 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d5eb86-f57d-49b0-bdc8-8e5bdb64e676 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af5a95620a4b43538abfe09eed4bf115', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:49:32.560362 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d5eb86-f57d-49b0-bdc8-8e5bdb64e676 service cinder] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:49:32.560646 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d5eb86-f57d-49b0-bdc8-8e5bdb64e676 service cinder] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:49:32.560924 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d5eb86-f57d-49b0-bdc8-8e5bdb64e676 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:49:32.589397 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:49:32.615119 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d5eb86-f57d-49b0-bdc8-8e5bdb64e676 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:49:32.616515 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d5eb86-f57d-49b0-bdc8-8e5bdb64e676 service cinder] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:49:32.625352 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1253/2523] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:49:32 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:49:37.013124 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e55c37-2782-470c-8d63-c4b84c5ac2cd None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:49:37.023595 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e55c37-2782-470c-8d63-c4b84c5ac2cd None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:49:37.027118 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fedcf6-aae0-41b4-8b8b-55690b134668 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af5a95620a4b43538abfe09eed4bf115', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:49:37.027771 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fedcf6-aae0-41b4-8b8b-55690b134668 service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:49:37.028106 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fedcf6-aae0-41b4-8b8b-55690b134668 service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:49:37.028427 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fedcf6-aae0-41b4-8b8b-55690b134668 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:49:37.037393 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fedcf6-aae0-41b4-8b8b-55690b134668 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:49:37.038808 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fedcf6-aae0-41b4-8b8b-55690b134668 service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:49:37.048384 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1271/2524] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:49:37 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:49:42.668159 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=13 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:49:47.044115 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=75 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:49:51.557244 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d5eb86-f57d-49b0-bdc8-8e5bdb64e676 service cinder] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:49:51.558687 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-b3d5eb86-f57d-49b0-bdc8-8e5bdb64e676 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:49:51.614828 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d5eb86-f57d-49b0-bdc8-8e5bdb64e676 service cinder] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:49:51.618439 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf95f8b-bf3a-4239-b718-2b2b144e3b6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dda603ec5517460a83c333db2af804d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:49:51.619079 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf95f8b-bf3a-4239-b718-2b2b144e3b6b service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:49:51.619366 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf95f8b-bf3a-4239-b718-2b2b144e3b6b service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:49:51.619644 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf95f8b-bf3a-4239-b718-2b2b144e3b6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:49:51.621482 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-daf95f8b-bf3a-4239-b718-2b2b144e3b6b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:49:51.683349 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf95f8b-bf3a-4239-b718-2b2b144e3b6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:49:51.684821 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf95f8b-bf3a-4239-b718-2b2b144e3b6b service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:49:51.694447 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1254/2525] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:49:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:49:51.765582 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fedcf6-aae0-41b4-8b8b-55690b134668 service cinder] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:49:51.776272 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fedcf6-aae0-41b4-8b8b-55690b134668 service cinder] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:49:51.780856 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5ddb45-cbf5-462c-9c6d-a127c826ac9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:49:51.781720 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5ddb45-cbf5-462c-9c6d-a127c826ac9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:49:51.782006 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5ddb45-cbf5-462c-9c6d-a127c826ac9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:49:51.782283 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5ddb45-cbf5-462c-9c6d-a127c826ac9d admin admin] PATH_INFO: `/v3/users/f739824a4f4447f6bc33cab1d9dca3d2` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:49:51.783474 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5ddb45-cbf5-462c-9c6d-a127c826ac9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f739824a4f4447f6bc33cab1d9dca3d2)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:49:51.785420 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5ddb45-cbf5-462c-9c6d-a127c826ac9d admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:49:51.946316 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-5e5ddb45-cbf5-462c-9c6d-a127c826ac9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f739824a4f4447f6bc33cab1d9dca3d2'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:49:51.946879 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-5e5ddb45-cbf5-462c-9c6d-a127c826ac9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f739824a4f4447f6bc33cab1d9dca3d2'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:49:51.953610 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-5e5ddb45-cbf5-462c-9c6d-a127c826ac9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f739824a4f4447f6bc33cab1d9dca3d2'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:49:51.966049 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-5e5ddb45-cbf5-462c-9c6d-a127c826ac9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f739824a4f4447f6bc33cab1d9dca3d2'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:49:51.966712 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-5e5ddb45-cbf5-462c-9c6d-a127c826ac9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f739824a4f4447f6bc33cab1d9dca3d2'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:49:52.029684 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1272/2526] 10.222.0.86 () {58 vars in 1223 bytes} [Tue Jun 7 14:49:51 2022] DELETE /identity/v3/users/f739824a4f4447f6bc33cab1d9dca3d2 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:49:52.034452 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79599a15-141b-4e5c-8cce-f032ed57a1b5 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:49:52.034808 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79599a15-141b-4e5c-8cce-f032ed57a1b5 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:49:52.035095 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79599a15-141b-4e5c-8cce-f032ed57a1b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:49:52.052384 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-79599a15-141b-4e5c-8cce-f032ed57a1b5 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:49:52.053629 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-79599a15-141b-4e5c-8cce-f032ed57a1b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:49:52.115263 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1255/2527] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:49:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:49:52.124919 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5ddb45-cbf5-462c-9c6d-a127c826ac9d admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:49:52.126327 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-5e5ddb45-cbf5-462c-9c6d-a127c826ac9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:49:52.184397 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5ddb45-cbf5-462c-9c6d-a127c826ac9d admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:49:52.188040 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71ace18-1fa6-4f85-a33e-25cb6967ebb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dda603ec5517460a83c333db2af804d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:49:52.188687 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71ace18-1fa6-4f85-a33e-25cb6967ebb7 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:49:52.188971 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71ace18-1fa6-4f85-a33e-25cb6967ebb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:49:52.189247 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71ace18-1fa6-4f85-a33e-25cb6967ebb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:49:52.198912 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71ace18-1fa6-4f85-a33e-25cb6967ebb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:49:52.200323 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71ace18-1fa6-4f85-a33e-25cb6967ebb7 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:49:52.210954 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1273/2528] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:49:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:49:52.665861 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79599a15-141b-4e5c-8cce-f032ed57a1b5 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:49:52.668217 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-79599a15-141b-4e5c-8cce-f032ed57a1b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:49:52.684394 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79599a15-141b-4e5c-8cce-f032ed57a1b5 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:49:52.689978 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcf8ee6-85c9-418b-8b1d-0d88adeb302e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:49:52.691192 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcf8ee6-85c9-418b-8b1d-0d88adeb302e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:49:52.691485 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcf8ee6-85c9-418b-8b1d-0d88adeb302e admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:49:52.691928 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcf8ee6-85c9-418b-8b1d-0d88adeb302e admin admin] PATH_INFO: `/v3/projects/c059648143a94b4e9b1f8aa45faecd91` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:49:52.693460 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcf8ee6-85c9-418b-8b1d-0d88adeb302e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c059648143a94b4e9b1f8aa45faecd91)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:49:52.695630 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcf8ee6-85c9-418b-8b1d-0d88adeb302e admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:49:52.807082 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:49:52.809864 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-8fcf8ee6-85c9-418b-8b1d-0d88adeb302e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c059648143a94b4e9b1f8aa45faecd91', 'request_id': 'req-8fcf8ee6-85c9-418b-8b1d-0d88adeb302e'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:49:52.816310 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-8fcf8ee6-85c9-418b-8b1d-0d88adeb302e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c059648143a94b4e9b1f8aa45faecd91', 'request_id': 'req-8fcf8ee6-85c9-418b-8b1d-0d88adeb302e'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:49:52.898274 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-8fcf8ee6-85c9-418b-8b1d-0d88adeb302e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c059648143a94b4e9b1f8aa45faecd91', 'request_id': 'req-8fcf8ee6-85c9-418b-8b1d-0d88adeb302e'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:49:52.909495 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-8fcf8ee6-85c9-418b-8b1d-0d88adeb302e admin admin] The token cache is being invalidate because project c059648143a94b4e9b1f8aa45faecd91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:49:52.910480 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-8fcf8ee6-85c9-418b-8b1d-0d88adeb302e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:49:52.911218 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-8fcf8ee6-85c9-418b-8b1d-0d88adeb302e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:49:52.913464 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1256/2529] 10.222.0.86 () {58 vars in 1232 bytes} [Tue Jun 7 14:49:52 2022] DELETE /identity/v3/projects/c059648143a94b4e9b1f8aa45faecd91 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:49:52.917492 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71ace18-1fa6-4f85-a33e-25cb6967ebb7 service neutron] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:49:52.927273 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71ace18-1fa6-4f85-a33e-25cb6967ebb7 service neutron] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:49:52.988199 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b284afd-de93-4e1a-890e-b6a889586588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:49:52.989111 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b284afd-de93-4e1a-890e-b6a889586588 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:49:52.989395 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b284afd-de93-4e1a-890e-b6a889586588 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:49:52.989676 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b284afd-de93-4e1a-890e-b6a889586588 admin admin] PATH_INFO: `/v3/users/69d9d87b64fa43daa8052385aafa3a20` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:49:52.991567 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b284afd-de93-4e1a-890e-b6a889586588 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69d9d87b64fa43daa8052385aafa3a20)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:49:52.993508 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b284afd-de93-4e1a-890e-b6a889586588 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:49:53.011458 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:49:53.187375 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-9b284afd-de93-4e1a-890e-b6a889586588 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69d9d87b64fa43daa8052385aafa3a20'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:49:53.188415 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-9b284afd-de93-4e1a-890e-b6a889586588 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69d9d87b64fa43daa8052385aafa3a20'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:49:53.202007 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-9b284afd-de93-4e1a-890e-b6a889586588 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69d9d87b64fa43daa8052385aafa3a20'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:49:53.217975 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-9b284afd-de93-4e1a-890e-b6a889586588 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69d9d87b64fa43daa8052385aafa3a20'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:49:53.218957 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-9b284afd-de93-4e1a-890e-b6a889586588 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69d9d87b64fa43daa8052385aafa3a20'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:49:53.309247 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1274/2530] 10.222.0.86 () {58 vars in 1223 bytes} [Tue Jun 7 14:49:52 2022] DELETE /identity/v3/users/69d9d87b64fa43daa8052385aafa3a20 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:49:53.763164 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcf8ee6-85c9-418b-8b1d-0d88adeb302e admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:49:53.765374 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-8fcf8ee6-85c9-418b-8b1d-0d88adeb302e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:49:53.789214 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcf8ee6-85c9-418b-8b1d-0d88adeb302e admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:49:53.851434 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a5b771-575d-4e18-b746-4e2cb2e9dc7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:49:53.852358 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a5b771-575d-4e18-b746-4e2cb2e9dc7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:49:53.852696 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a5b771-575d-4e18-b746-4e2cb2e9dc7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:49:53.853023 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a5b771-575d-4e18-b746-4e2cb2e9dc7e admin admin] PATH_INFO: `/v3/projects/1d687a2989204626bce24e76490a4df6` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:49:53.854221 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a5b771-575d-4e18-b746-4e2cb2e9dc7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d687a2989204626bce24e76490a4df6)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:49:53.856211 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a5b771-575d-4e18-b746-4e2cb2e9dc7e admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:49:53.970997 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-b6a5b771-575d-4e18-b746-4e2cb2e9dc7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d687a2989204626bce24e76490a4df6', 'request_id': 'req-b6a5b771-575d-4e18-b746-4e2cb2e9dc7e'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:49:53.978162 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-b6a5b771-575d-4e18-b746-4e2cb2e9dc7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d687a2989204626bce24e76490a4df6', 'request_id': 'req-b6a5b771-575d-4e18-b746-4e2cb2e9dc7e'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:49:54.075545 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-b6a5b771-575d-4e18-b746-4e2cb2e9dc7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d687a2989204626bce24e76490a4df6', 'request_id': 'req-b6a5b771-575d-4e18-b746-4e2cb2e9dc7e'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:49:54.089347 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-b6a5b771-575d-4e18-b746-4e2cb2e9dc7e admin admin] The token cache is being invalidate because project 1d687a2989204626bce24e76490a4df6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:49:54.089678 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-b6a5b771-575d-4e18-b746-4e2cb2e9dc7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:49:54.090327 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-b6a5b771-575d-4e18-b746-4e2cb2e9dc7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:49:54.091927 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1257/2531] 10.222.0.86 () {58 vars in 1232 bytes} [Tue Jun 7 14:49:53 2022] DELETE /identity/v3/projects/1d687a2989204626bce24e76490a4df6 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:49:54.096910 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2351c8c2-d961-48c6-90ab-303598b39934 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:49:54.097409 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2351c8c2-d961-48c6-90ab-303598b39934 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:49:54.097520 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2351c8c2-d961-48c6-90ab-303598b39934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:49:54.116132 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-2351c8c2-d961-48c6-90ab-303598b39934 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:49:54.117376 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-2351c8c2-d961-48c6-90ab-303598b39934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:49:54.181029 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1275/2532] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:49:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:49:54.188526 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71a9bdd-d178-414d-a210-c5171dfe1498 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:49:54.188824 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71a9bdd-d178-414d-a210-c5171dfe1498 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:49:54.189724 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71a9bdd-d178-414d-a210-c5171dfe1498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:49:54.214145 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-c71a9bdd-d178-414d-a210-c5171dfe1498 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:49:54.215364 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-c71a9bdd-d178-414d-a210-c5171dfe1498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:49:54.223835 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1258/2533] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:49:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:49:54.228618 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2351c8c2-d961-48c6-90ab-303598b39934 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:49:54.238244 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2351c8c2-d961-48c6-90ab-303598b39934 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:49:54.243124 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dc69ef-befd-4b86-b605-a16ca00e4bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:49:54.243848 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dc69ef-befd-4b86-b605-a16ca00e4bc5 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:49:54.244136 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dc69ef-befd-4b86-b605-a16ca00e4bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:49:54.244411 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dc69ef-befd-4b86-b605-a16ca00e4bc5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:49:54.245137 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dc69ef-befd-4b86-b605-a16ca00e4bc5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:49:54.245444 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dc69ef-befd-4b86-b605-a16ca00e4bc5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:49:54.247015 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dc69ef-befd-4b86-b605-a16ca00e4bc5 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:49:54.259275 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1276/2534] 10.222.0.86 () {58 vars in 1152 bytes} [Tue Jun 7 14:49:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:49:54.263643 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71a9bdd-d178-414d-a210-c5171dfe1498 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:49:54.273455 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71a9bdd-d178-414d-a210-c5171dfe1498 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:49:54.278276 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fb5cf7-56cd-4ca9-98c2-40dc8f4407e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:49:54.278947 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fb5cf7-56cd-4ca9-98c2-40dc8f4407e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:49:54.279228 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fb5cf7-56cd-4ca9-98c2-40dc8f4407e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:49:54.279501 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fb5cf7-56cd-4ca9-98c2-40dc8f4407e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:49:54.280250 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fb5cf7-56cd-4ca9-98c2-40dc8f4407e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:49:54.282131 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fb5cf7-56cd-4ca9-98c2-40dc8f4407e0 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:49:54.386913 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1259/2535] 10.222.0.86 () {60 vars in 1152 bytes} [Tue Jun 7 14:49:54 2022] POST /identity/v3/projects => generated 379 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:49:54.391125 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dc69ef-befd-4b86-b605-a16ca00e4bc5 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:49:54.402957 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dc69ef-befd-4b86-b605-a16ca00e4bc5 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:49:54.465186 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9188d7a9-46d0-4e2b-b8c9-0c4f94e023c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:49:54.465943 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9188d7a9-46d0-4e2b-b8c9-0c4f94e023c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:49:54.466241 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9188d7a9-46d0-4e2b-b8c9-0c4f94e023c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:49:54.466519 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9188d7a9-46d0-4e2b-b8c9-0c4f94e023c4 admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:49:54.467234 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9188d7a9-46d0-4e2b-b8c9-0c4f94e023c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:49:54.469487 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9188d7a9-46d0-4e2b-b8c9-0c4f94e023c4 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:49:54.579259 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1277/2536] 10.222.0.86 () {60 vars in 1143 bytes} [Tue Jun 7 14:49:54 2022] POST /identity/v3/users => generated 290 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 14:49:54.584305 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fb5cf7-56cd-4ca9-98c2-40dc8f4407e0 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:49:54.596363 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fb5cf7-56cd-4ca9-98c2-40dc8f4407e0 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:49:54.601568 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0417415-df9a-49d4-9525-73a611af8224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:49:54.609321 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0417415-df9a-49d4-9525-73a611af8224 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:49:54.609321 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0417415-df9a-49d4-9525-73a611af8224 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:49:54.609321 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0417415-df9a-49d4-9525-73a611af8224 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:49:54.609321 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0417415-df9a-49d4-9525-73a611af8224 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:49:54.609321 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0417415-df9a-49d4-9525-73a611af8224 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:49:54.616988 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1260/2537] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:49:54 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:49:54.620982 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9188d7a9-46d0-4e2b-b8c9-0c4f94e023c4 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:49:54.632378 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9188d7a9-46d0-4e2b-b8c9-0c4f94e023c4 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:49:54.637410 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e00afd3-a0a7-4997-b11d-8aaca4833c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:49:54.638315 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e00afd3-a0a7-4997-b11d-8aaca4833c9b admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:49:54.638608 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e00afd3-a0a7-4997-b11d-8aaca4833c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:49:54.638891 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e00afd3-a0a7-4997-b11d-8aaca4833c9b admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:49:54.639630 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e00afd3-a0a7-4997-b11d-8aaca4833c9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:49:54.641284 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e00afd3-a0a7-4997-b11d-8aaca4833c9b admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:49:54.647879 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:49:54.655321 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1278/2538] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:49:54 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:49:54.658549 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0417415-df9a-49d4-9525-73a611af8224 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:49:54.668947 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0417415-df9a-49d4-9525-73a611af8224 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:49:54.673639 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1bdaf9-a254-4f80-ae1c-eddc6f0fadad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:49:54.674514 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1bdaf9-a254-4f80-ae1c-eddc6f0fadad admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:49:54.677771 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1bdaf9-a254-4f80-ae1c-eddc6f0fadad admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:49:54.677771 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1bdaf9-a254-4f80-ae1c-eddc6f0fadad admin admin] PATH_INFO: `/v3/projects/620f25a8ff71477682ac42664879c811/users/4ae639db76004c0d9c6897a0bed6ff8b/roles/c17acc2a8bb348f59ba7edd22fcf0c47` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:49:54.689726 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1bdaf9-a254-4f80-ae1c-eddc6f0fadad admin admin] RBAC: Authorizing `identity:create_grant(project_id=620f25a8ff71477682ac42664879c811, user_id=4ae639db76004c0d9c6897a0bed6ff8b, role_id=c17acc2a8bb348f59ba7edd22fcf0c47)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:49:54.692431 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1bdaf9-a254-4f80-ae1c-eddc6f0fadad admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:49:54.766954 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:DELETE=11,keystone:SELECT=85,keystone:INSERT=4 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:49:54.772483 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1261/2539] 10.222.0.86 () {60 vars in 1482 bytes} [Tue Jun 7 14:49:54 2022] PUT /identity/v3/projects/620f25a8ff71477682ac42664879c811/users/4ae639db76004c0d9c6897a0bed6ff8b/roles/c17acc2a8bb348f59ba7edd22fcf0c47 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:49:54.784224 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e11e71-d43d-47fe-99ed-6fb2935fa579 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:49:54.784593 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e11e71-d43d-47fe-99ed-6fb2935fa579 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:49:54.784949 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e11e71-d43d-47fe-99ed-6fb2935fa579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:49:54.813629 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-f8e11e71-d43d-47fe-99ed-6fb2935fa579 None None] MFA Rules not processed for user `4ae639db76004c0d9c6897a0bed6ff8b`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:49:54.815056 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-f8e11e71-d43d-47fe-99ed-6fb2935fa579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:49:54.887542 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1279/2540] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:49:54 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:49:54.892264 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1bdaf9-a254-4f80-ae1c-eddc6f0fadad admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:49:54.956722 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1bdaf9-a254-4f80-ae1c-eddc6f0fadad admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:49:54.961487 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9193c409-1e41-4627-90cd-a35367140099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:49:54.962153 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9193c409-1e41-4627-90cd-a35367140099 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:49:54.962442 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9193c409-1e41-4627-90cd-a35367140099 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:49:54.962723 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9193c409-1e41-4627-90cd-a35367140099 admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:49:54.963521 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9193c409-1e41-4627-90cd-a35367140099 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:49:54.965460 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9193c409-1e41-4627-90cd-a35367140099 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:49:55.057079 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1262/2541] 10.222.0.86 () {60 vars in 1152 bytes} [Tue Jun 7 14:49:54 2022] POST /identity/v3/projects => generated 379 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:49:55.058617 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e11e71-d43d-47fe-99ed-6fb2935fa579 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:49:55.070763 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e11e71-d43d-47fe-99ed-6fb2935fa579 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:49:55.139505 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d832cc6-1aec-46a8-ba75-45e227221843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:49:55.140326 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d832cc6-1aec-46a8-ba75-45e227221843 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:49:55.140684 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d832cc6-1aec-46a8-ba75-45e227221843 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:49:55.141031 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d832cc6-1aec-46a8-ba75-45e227221843 admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:49:55.142009 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d832cc6-1aec-46a8-ba75-45e227221843 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:49:55.144051 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d832cc6-1aec-46a8-ba75-45e227221843 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:49:55.248620 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1280/2542] 10.222.0.86 () {60 vars in 1143 bytes} [Tue Jun 7 14:49:55 2022] POST /identity/v3/users => generated 296 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:49:55.252456 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9193c409-1e41-4627-90cd-a35367140099 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:49:55.264590 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9193c409-1e41-4627-90cd-a35367140099 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:49:55.270485 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27c5a35-0d81-42ea-bb39-70674cb36375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:49:55.271407 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27c5a35-0d81-42ea-bb39-70674cb36375 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:49:55.271777 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27c5a35-0d81-42ea-bb39-70674cb36375 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:49:55.272202 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27c5a35-0d81-42ea-bb39-70674cb36375 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:49:55.273232 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27c5a35-0d81-42ea-bb39-70674cb36375 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:49:55.275943 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27c5a35-0d81-42ea-bb39-70674cb36375 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:49:55.288792 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1263/2543] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:49:55 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 07 14:49:55.293093 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d832cc6-1aec-46a8-ba75-45e227221843 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:49:55.304277 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d832cc6-1aec-46a8-ba75-45e227221843 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:49:55.311293 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a551d2-ed86-420a-9028-6c23ade990ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:49:55.312253 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a551d2-ed86-420a-9028-6c23ade990ce admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:49:55.314604 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a551d2-ed86-420a-9028-6c23ade990ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:49:55.314604 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a551d2-ed86-420a-9028-6c23ade990ce admin admin] PATH_INFO: `/v3/projects/cf8c7783fd7648178246e05ee804a94a/users/9b13aa6bc7974e3db99e17a2dd7bd740/roles/e3bf6239f5bf477b965704b086786f11` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:49:55.329503 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a551d2-ed86-420a-9028-6c23ade990ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf8c7783fd7648178246e05ee804a94a, user_id=9b13aa6bc7974e3db99e17a2dd7bd740, role_id=e3bf6239f5bf477b965704b086786f11)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:49:55.332273 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a551d2-ed86-420a-9028-6c23ade990ce admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:49:55.429007 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1281/2544] 10.222.0.86 () {60 vars in 1482 bytes} [Tue Jun 7 14:49:55 2022] PUT /identity/v3/projects/cf8c7783fd7648178246e05ee804a94a/users/9b13aa6bc7974e3db99e17a2dd7bd740/roles/e3bf6239f5bf477b965704b086786f11 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:49:55.430856 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27c5a35-0d81-42ea-bb39-70674cb36375 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:49:55.442541 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27c5a35-0d81-42ea-bb39-70674cb36375 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:49:55.518436 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cf5461-60fa-4d18-ad3c-8c3a0d6ed55b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:49:55.519974 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cf5461-60fa-4d18-ad3c-8c3a0d6ed55b admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:49:55.519974 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cf5461-60fa-4d18-ad3c-8c3a0d6ed55b admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:49:55.519974 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cf5461-60fa-4d18-ad3c-8c3a0d6ed55b admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:49:55.520722 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cf5461-60fa-4d18-ad3c-8c3a0d6ed55b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:49:55.522483 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cf5461-60fa-4d18-ad3c-8c3a0d6ed55b admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:49:55.535300 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1264/2545] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:49:55 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:49:55.539842 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a551d2-ed86-420a-9028-6c23ade990ce admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:49:55.550806 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a551d2-ed86-420a-9028-6c23ade990ce admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:49:55.557075 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e6a63f-740b-4955-8763-49ec6b47b5ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:49:55.558179 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e6a63f-740b-4955-8763-49ec6b47b5ce admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:49:55.558541 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e6a63f-740b-4955-8763-49ec6b47b5ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:49:55.558899 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e6a63f-740b-4955-8763-49ec6b47b5ce admin admin] PATH_INFO: `/v3/projects/cf8c7783fd7648178246e05ee804a94a/users/9b13aa6bc7974e3db99e17a2dd7bd740/roles/e3bf6239f5bf477b965704b086786f11` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:49:55.561191 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e6a63f-740b-4955-8763-49ec6b47b5ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf8c7783fd7648178246e05ee804a94a, user_id=9b13aa6bc7974e3db99e17a2dd7bd740, role_id=e3bf6239f5bf477b965704b086786f11)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:49:55.564112 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e6a63f-740b-4955-8763-49ec6b47b5ce admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:49:55.577633 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1282/2546] 10.222.0.86 () {60 vars in 1482 bytes} [Tue Jun 7 14:49:55 2022] PUT /identity/v3/projects/cf8c7783fd7648178246e05ee804a94a/users/9b13aa6bc7974e3db99e17a2dd7bd740/roles/e3bf6239f5bf477b965704b086786f11 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:49:55.590851 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fe1409-1e52-4991-94c0-361e363cdfc2 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:49:55.591219 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fe1409-1e52-4991-94c0-361e363cdfc2 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:49:55.592287 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fe1409-1e52-4991-94c0-361e363cdfc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:49:55.634246 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-75fe1409-1e52-4991-94c0-361e363cdfc2 None None] MFA Rules not processed for user `9b13aa6bc7974e3db99e17a2dd7bd740`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:49:55.634990 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-75fe1409-1e52-4991-94c0-361e363cdfc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:49:55.700645 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:49:55.709356 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1265/2547] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:49:55 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:49:55.720516 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e6a63f-740b-4955-8763-49ec6b47b5ce admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:49:55.722216 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-00e6a63f-740b-4955-8763-49ec6b47b5ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:49:55.756759 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fe1409-1e52-4991-94c0-361e363cdfc2 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:49:55.758405 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-75fe1409-1e52-4991-94c0-361e363cdfc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:49:55.769895 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:49:55.781913 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e6a63f-740b-4955-8763-49ec6b47b5ce admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:49:55.785875 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ee0143-cd66-4ef3-9b1d-ae5cf738f392 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af5a95620a4b43538abfe09eed4bf115', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:49:55.786531 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ee0143-cd66-4ef3-9b1d-ae5cf738f392 service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:49:55.786970 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ee0143-cd66-4ef3-9b1d-ae5cf738f392 service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:49:55.787251 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ee0143-cd66-4ef3-9b1d-ae5cf738f392 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:49:55.828748 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fe1409-1e52-4991-94c0-361e363cdfc2 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:49:55.833537 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66447b0f-1bb3-4d32-8b3f-e8273181efbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:49:55.834435 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66447b0f-1bb3-4d32-8b3f-e8273181efbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:49:55.838439 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66447b0f-1bb3-4d32-8b3f-e8273181efbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:49:55.838439 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66447b0f-1bb3-4d32-8b3f-e8273181efbb admin admin] PATH_INFO: `/v3/users/bd70563183ab43d68df41f1be27cadc3` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:49:55.838439 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66447b0f-1bb3-4d32-8b3f-e8273181efbb admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd70563183ab43d68df41f1be27cadc3)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:49:55.838439 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66447b0f-1bb3-4d32-8b3f-e8273181efbb admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:49:55.843202 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ee0143-cd66-4ef3-9b1d-ae5cf738f392 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:49:55.844707 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ee0143-cd66-4ef3-9b1d-ae5cf738f392 service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:49:55.853668 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1283/2548] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:49:55 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:49:56.054765 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-66447b0f-1bb3-4d32-8b3f-e8273181efbb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd70563183ab43d68df41f1be27cadc3'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:49:56.062015 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-66447b0f-1bb3-4d32-8b3f-e8273181efbb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd70563183ab43d68df41f1be27cadc3'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:49:56.069733 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-66447b0f-1bb3-4d32-8b3f-e8273181efbb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd70563183ab43d68df41f1be27cadc3'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:49:56.076077 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-66447b0f-1bb3-4d32-8b3f-e8273181efbb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd70563183ab43d68df41f1be27cadc3'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:49:56.076742 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-66447b0f-1bb3-4d32-8b3f-e8273181efbb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd70563183ab43d68df41f1be27cadc3'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:49:56.176631 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1266/2549] 10.222.0.86 () {58 vars in 1223 bytes} [Tue Jun 7 14:49:55 2022] DELETE /identity/v3/users/bd70563183ab43d68df41f1be27cadc3 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:49:56.442945 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ee0143-cd66-4ef3-9b1d-ae5cf738f392 service cinder] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:49:56.455637 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ee0143-cd66-4ef3-9b1d-ae5cf738f392 service cinder] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:49:56.530879 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15caee07-d3f6-4896-a53b-538e8fc9c20b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:49:56.532088 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15caee07-d3f6-4896-a53b-538e8fc9c20b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:49:56.532380 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15caee07-d3f6-4896-a53b-538e8fc9c20b admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:49:56.532645 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15caee07-d3f6-4896-a53b-538e8fc9c20b admin admin] PATH_INFO: `/v3/projects/84fbbe1a32c745aabbde02f8eff9343a` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:49:56.535143 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15caee07-d3f6-4896-a53b-538e8fc9c20b admin admin] RBAC: Authorizing `identity:delete_project(project_id=84fbbe1a32c745aabbde02f8eff9343a)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:49:56.539374 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15caee07-d3f6-4896-a53b-538e8fc9c20b admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:49:56.654357 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-15caee07-d3f6-4896-a53b-538e8fc9c20b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84fbbe1a32c745aabbde02f8eff9343a', 'request_id': 'req-15caee07-d3f6-4896-a53b-538e8fc9c20b'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:49:56.660839 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-15caee07-d3f6-4896-a53b-538e8fc9c20b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84fbbe1a32c745aabbde02f8eff9343a', 'request_id': 'req-15caee07-d3f6-4896-a53b-538e8fc9c20b'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:49:56.725561 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-15caee07-d3f6-4896-a53b-538e8fc9c20b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84fbbe1a32c745aabbde02f8eff9343a', 'request_id': 'req-15caee07-d3f6-4896-a53b-538e8fc9c20b'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:49:56.736455 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-15caee07-d3f6-4896-a53b-538e8fc9c20b admin admin] The token cache is being invalidate because project 84fbbe1a32c745aabbde02f8eff9343a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:49:56.736743 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-15caee07-d3f6-4896-a53b-538e8fc9c20b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:49:56.737360 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-15caee07-d3f6-4896-a53b-538e8fc9c20b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:49:56.738920 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1284/2550] 10.222.0.86 () {58 vars in 1232 bytes} [Tue Jun 7 14:49:56 2022] DELETE /identity/v3/projects/84fbbe1a32c745aabbde02f8eff9343a => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:49:56.743907 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97567116-90ed-45f1-a77a-32f29ea3a980 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:49:56.744204 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97567116-90ed-45f1-a77a-32f29ea3a980 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:49:56.744488 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97567116-90ed-45f1-a77a-32f29ea3a980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:49:56.762952 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-97567116-90ed-45f1-a77a-32f29ea3a980 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:49:56.764214 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-97567116-90ed-45f1-a77a-32f29ea3a980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:49:56.824716 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1267/2551] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:49:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:49:56.832792 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dd94ac-480b-4323-b14a-f036a5639739 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:49:56.833089 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dd94ac-480b-4323-b14a-f036a5639739 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:49:56.833373 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dd94ac-480b-4323-b14a-f036a5639739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:49:56.854620 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-e9dd94ac-480b-4323-b14a-f036a5639739 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:49:56.855974 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-e9dd94ac-480b-4323-b14a-f036a5639739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:49:56.864346 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1285/2552] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:49:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:49:56.868610 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97567116-90ed-45f1-a77a-32f29ea3a980 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:49:56.878373 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97567116-90ed-45f1-a77a-32f29ea3a980 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:49:56.883540 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c480735f-78b2-4e1e-a884-f973afbcc8d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:49:56.884491 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c480735f-78b2-4e1e-a884-f973afbcc8d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:49:56.884781 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c480735f-78b2-4e1e-a884-f973afbcc8d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:49:56.885065 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c480735f-78b2-4e1e-a884-f973afbcc8d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:49:56.885802 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c480735f-78b2-4e1e-a884-f973afbcc8d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:49:56.886116 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c480735f-78b2-4e1e-a884-f973afbcc8d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:49:56.887713 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c480735f-78b2-4e1e-a884-f973afbcc8d2 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:49:56.900143 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1268/2553] 10.222.0.86 () {58 vars in 1152 bytes} [Tue Jun 7 14:49:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:49:56.904668 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dd94ac-480b-4323-b14a-f036a5639739 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:49:56.913803 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dd94ac-480b-4323-b14a-f036a5639739 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:49:56.918528 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe69575-5946-4cad-9b69-04d25079ff89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:49:56.919103 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe69575-5946-4cad-9b69-04d25079ff89 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:49:56.919383 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe69575-5946-4cad-9b69-04d25079ff89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:49:56.919653 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe69575-5946-4cad-9b69-04d25079ff89 admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:49:56.920371 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe69575-5946-4cad-9b69-04d25079ff89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:49:56.922407 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe69575-5946-4cad-9b69-04d25079ff89 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:49:57.018787 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:49:57.026893 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1286/2554] 10.222.0.86 () {60 vars in 1152 bytes} [Tue Jun 7 14:49:56 2022] POST /identity/v3/projects => generated 381 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:49:57.031155 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c480735f-78b2-4e1e-a884-f973afbcc8d2 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:49:57.036348 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:49:57.041782 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c480735f-78b2-4e1e-a884-f973afbcc8d2 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:49:57.103333 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fcac0a-a29a-4ebd-8b85-f9d51e360f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:49:57.104201 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fcac0a-a29a-4ebd-8b85-f9d51e360f9c admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:49:57.104488 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fcac0a-a29a-4ebd-8b85-f9d51e360f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:49:57.104769 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fcac0a-a29a-4ebd-8b85-f9d51e360f9c admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:49:57.105490 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fcac0a-a29a-4ebd-8b85-f9d51e360f9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:49:57.107576 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fcac0a-a29a-4ebd-8b85-f9d51e360f9c admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:49:57.191602 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1269/2555] 10.222.0.86 () {60 vars in 1143 bytes} [Tue Jun 7 14:49:57 2022] POST /identity/v3/users => generated 291 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:49:57.196580 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe69575-5946-4cad-9b69-04d25079ff89 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:49:57.207118 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe69575-5946-4cad-9b69-04d25079ff89 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:49:57.211708 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8805108-7fac-474e-bff2-d2c7fc490089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:49:57.212433 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8805108-7fac-474e-bff2-d2c7fc490089 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:49:57.212714 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8805108-7fac-474e-bff2-d2c7fc490089 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:49:57.212986 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8805108-7fac-474e-bff2-d2c7fc490089 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:49:57.213706 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8805108-7fac-474e-bff2-d2c7fc490089 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:49:57.215280 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8805108-7fac-474e-bff2-d2c7fc490089 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:49:57.225517 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1287/2556] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:49:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:49:57.229875 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fcac0a-a29a-4ebd-8b85-f9d51e360f9c admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:49:57.240660 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fcac0a-a29a-4ebd-8b85-f9d51e360f9c admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:49:57.245371 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964f8451-416e-4e39-8fac-8704f5e303b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:49:57.246030 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964f8451-416e-4e39-8fac-8704f5e303b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:49:57.246319 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964f8451-416e-4e39-8fac-8704f5e303b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:49:57.246602 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964f8451-416e-4e39-8fac-8704f5e303b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:49:57.247336 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964f8451-416e-4e39-8fac-8704f5e303b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:49:57.248945 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964f8451-416e-4e39-8fac-8704f5e303b4 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:49:57.259676 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1270/2557] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:49:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:49:57.263767 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8805108-7fac-474e-bff2-d2c7fc490089 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:49:57.273497 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8805108-7fac-474e-bff2-d2c7fc490089 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:49:57.278049 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b34e711-75c7-49e0-958c-5caf19603e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:49:57.278937 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b34e711-75c7-49e0-958c-5caf19603e06 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:49:57.279216 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b34e711-75c7-49e0-958c-5caf19603e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:49:57.279487 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b34e711-75c7-49e0-958c-5caf19603e06 admin admin] PATH_INFO: `/v3/projects/8bda5fcfb0464d09b2b1ccc889825a29/users/c2b9e77c2a004e5581dff0942c852cda/roles/c17acc2a8bb348f59ba7edd22fcf0c47` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:49:57.293688 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b34e711-75c7-49e0-958c-5caf19603e06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bda5fcfb0464d09b2b1ccc889825a29, user_id=c2b9e77c2a004e5581dff0942c852cda, role_id=c17acc2a8bb348f59ba7edd22fcf0c47)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:49:57.296447 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b34e711-75c7-49e0-958c-5caf19603e06 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:49:57.367405 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1288/2558] 10.222.0.86 () {60 vars in 1482 bytes} [Tue Jun 7 14:49:57 2022] PUT /identity/v3/projects/8bda5fcfb0464d09b2b1ccc889825a29/users/c2b9e77c2a004e5581dff0942c852cda/roles/c17acc2a8bb348f59ba7edd22fcf0c47 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 14:49:57.378249 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c289eed1-c0fd-4dca-8025-c44aaa7b665b None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:49:57.378548 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c289eed1-c0fd-4dca-8025-c44aaa7b665b None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:49:57.378827 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c289eed1-c0fd-4dca-8025-c44aaa7b665b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:49:57.405502 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-c289eed1-c0fd-4dca-8025-c44aaa7b665b None None] MFA Rules not processed for user `c2b9e77c2a004e5581dff0942c852cda`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:49:57.406708 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-c289eed1-c0fd-4dca-8025-c44aaa7b665b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:49:57.470763 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1271/2559] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:49:57 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:49:57.475254 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b34e711-75c7-49e0-958c-5caf19603e06 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:49:57.538882 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b34e711-75c7-49e0-958c-5caf19603e06 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:49:57.543694 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2ed6ad-2ffd-448c-9905-65b04ad54255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:49:57.544372 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2ed6ad-2ffd-448c-9905-65b04ad54255 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:49:57.544659 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2ed6ad-2ffd-448c-9905-65b04ad54255 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:49:57.544938 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2ed6ad-2ffd-448c-9905-65b04ad54255 admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:49:57.545620 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2ed6ad-2ffd-448c-9905-65b04ad54255 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:49:57.547529 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2ed6ad-2ffd-448c-9905-65b04ad54255 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:49:57.635558 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c289eed1-c0fd-4dca-8025-c44aaa7b665b None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:49:57.635558 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-c289eed1-c0fd-4dca-8025-c44aaa7b665b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:49:57.653628 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1289/2560] 10.222.0.86 () {60 vars in 1152 bytes} [Tue Jun 7 14:49:57 2022] POST /identity/v3/projects => generated 381 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:49:57.657928 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2ed6ad-2ffd-448c-9905-65b04ad54255 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:49:57.694857 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c289eed1-c0fd-4dca-8025-c44aaa7b665b None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:49:57.719819 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:49:57.724559 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2ed6ad-2ffd-448c-9905-65b04ad54255 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:49:57.729314 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171b410e-ce6f-40e8-9bad-0e940c9b29a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:49:57.729984 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171b410e-ce6f-40e8-9bad-0e940c9b29a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:49:57.730273 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171b410e-ce6f-40e8-9bad-0e940c9b29a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:49:57.730554 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171b410e-ce6f-40e8-9bad-0e940c9b29a7 admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:49:57.731244 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171b410e-ce6f-40e8-9bad-0e940c9b29a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:49:57.733291 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171b410e-ce6f-40e8-9bad-0e940c9b29a7 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:49:57.745352 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1001b9f-1ae5-4c85-bcff-624ea3b9c38f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af5a95620a4b43538abfe09eed4bf115', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:49:57.746000 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1001b9f-1ae5-4c85-bcff-624ea3b9c38f service cinder] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:49:57.746342 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1001b9f-1ae5-4c85-bcff-624ea3b9c38f service cinder] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:49:57.746618 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1001b9f-1ae5-4c85-bcff-624ea3b9c38f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:49:57.748411 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-b1001b9f-1ae5-4c85-bcff-624ea3b9c38f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:49:57.810541 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1001b9f-1ae5-4c85-bcff-624ea3b9c38f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:49:57.812067 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1001b9f-1ae5-4c85-bcff-624ea3b9c38f service cinder] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:49:57.816904 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1290/2561] 10.222.0.86 () {60 vars in 1143 bytes} [Tue Jun 7 14:49:57 2022] POST /identity/v3/users => generated 297 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 14:49:57.820684 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171b410e-ce6f-40e8-9bad-0e940c9b29a7 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:49:57.822367 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1272/2562] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:49:57 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:49:57.831053 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171b410e-ce6f-40e8-9bad-0e940c9b29a7 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:49:57.837214 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8aae1c-4e9b-4f79-9a7c-53f613dbc282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:49:57.837914 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8aae1c-4e9b-4f79-9a7c-53f613dbc282 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:49:57.838288 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8aae1c-4e9b-4f79-9a7c-53f613dbc282 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:49:57.838571 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8aae1c-4e9b-4f79-9a7c-53f613dbc282 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:49:57.839304 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8aae1c-4e9b-4f79-9a7c-53f613dbc282 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:49:57.840959 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8aae1c-4e9b-4f79-9a7c-53f613dbc282 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:49:57.851717 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1291/2563] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:49:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 07 14:49:57.855967 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1001b9f-1ae5-4c85-bcff-624ea3b9c38f service cinder] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:49:57.866976 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1001b9f-1ae5-4c85-bcff-624ea3b9c38f service cinder] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:49:57.871575 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9b1844-91ae-4de6-9521-601f2e6e4a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:49:57.872500 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9b1844-91ae-4de6-9521-601f2e6e4a0c admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:49:57.872785 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9b1844-91ae-4de6-9521-601f2e6e4a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:49:57.873062 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9b1844-91ae-4de6-9521-601f2e6e4a0c admin admin] PATH_INFO: `/v3/projects/b1a92d379c5d4c2a8016526e40681a26/users/fb3dc6eb22d7465eba2ed2147f9028f7/roles/e3bf6239f5bf477b965704b086786f11` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:49:57.888824 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9b1844-91ae-4de6-9521-601f2e6e4a0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1a92d379c5d4c2a8016526e40681a26, user_id=fb3dc6eb22d7465eba2ed2147f9028f7, role_id=e3bf6239f5bf477b965704b086786f11)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:49:57.891463 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9b1844-91ae-4de6-9521-601f2e6e4a0c admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:49:57.959503 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1273/2564] 10.222.0.86 () {60 vars in 1482 bytes} [Tue Jun 7 14:49:57 2022] PUT /identity/v3/projects/b1a92d379c5d4c2a8016526e40681a26/users/fb3dc6eb22d7465eba2ed2147f9028f7/roles/e3bf6239f5bf477b965704b086786f11 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:49:57.963500 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8aae1c-4e9b-4f79-9a7c-53f613dbc282 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:49:57.973309 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8aae1c-4e9b-4f79-9a7c-53f613dbc282 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:49:58.003469 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:49:58.039352 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef10896-91fd-40ca-8923-2f323a98f536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:49:58.040179 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef10896-91fd-40ca-8923-2f323a98f536 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:49:58.040453 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef10896-91fd-40ca-8923-2f323a98f536 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:49:58.040729 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef10896-91fd-40ca-8923-2f323a98f536 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:49:58.041552 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef10896-91fd-40ca-8923-2f323a98f536 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:49:58.043156 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef10896-91fd-40ca-8923-2f323a98f536 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:49:58.053418 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1292/2565] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:49:57 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:49:58.058018 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9b1844-91ae-4de6-9521-601f2e6e4a0c admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:49:58.068917 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9b1844-91ae-4de6-9521-601f2e6e4a0c admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:49:58.073607 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2060f7-1109-4a1d-9b11-7ca124de1905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:49:58.074477 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2060f7-1109-4a1d-9b11-7ca124de1905 admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:49:58.074763 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2060f7-1109-4a1d-9b11-7ca124de1905 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:49:58.075033 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2060f7-1109-4a1d-9b11-7ca124de1905 admin admin] PATH_INFO: `/v3/projects/b1a92d379c5d4c2a8016526e40681a26/users/fb3dc6eb22d7465eba2ed2147f9028f7/roles/e3bf6239f5bf477b965704b086786f11` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:49:58.077226 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2060f7-1109-4a1d-9b11-7ca124de1905 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1a92d379c5d4c2a8016526e40681a26, user_id=fb3dc6eb22d7465eba2ed2147f9028f7, role_id=e3bf6239f5bf477b965704b086786f11)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:49:58.079653 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2060f7-1109-4a1d-9b11-7ca124de1905 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:49:58.089805 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1274/2566] 10.222.0.86 () {60 vars in 1482 bytes} [Tue Jun 7 14:49:58 2022] PUT /identity/v3/projects/b1a92d379c5d4c2a8016526e40681a26/users/fb3dc6eb22d7465eba2ed2147f9028f7/roles/e3bf6239f5bf477b965704b086786f11 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:49:58.099677 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad818d67-e82e-46dd-b051-5b45cdf080fb None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:49:58.100034 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad818d67-e82e-46dd-b051-5b45cdf080fb None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:49:58.100318 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad818d67-e82e-46dd-b051-5b45cdf080fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:49:58.126575 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-ad818d67-e82e-46dd-b051-5b45cdf080fb None None] MFA Rules not processed for user `fb3dc6eb22d7465eba2ed2147f9028f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:49:58.127838 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-ad818d67-e82e-46dd-b051-5b45cdf080fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:49:58.201454 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1293/2567] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:49:58 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:49:58.212608 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2060f7-1109-4a1d-9b11-7ca124de1905 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:49:58.214320 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-bb2060f7-1109-4a1d-9b11-7ca124de1905 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:49:58.278266 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2060f7-1109-4a1d-9b11-7ca124de1905 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:49:58.282255 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57975093-739b-4a67-aaa7-a2755461968b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af5a95620a4b43538abfe09eed4bf115', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:49:58.282974 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57975093-739b-4a67-aaa7-a2755461968b service cinder] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:49:58.283328 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57975093-739b-4a67-aaa7-a2755461968b service cinder] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:49:58.283851 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57975093-739b-4a67-aaa7-a2755461968b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:49:58.299993 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57975093-739b-4a67-aaa7-a2755461968b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:49:58.301539 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57975093-739b-4a67-aaa7-a2755461968b service cinder] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:49:58.311945 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1275/2568] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:49:58 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:49:58.511109 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad818d67-e82e-46dd-b051-5b45cdf080fb None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:49:58.520932 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad818d67-e82e-46dd-b051-5b45cdf080fb None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:49:58.525137 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2977007c-a1df-4511-833b-76e230b62860 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af5a95620a4b43538abfe09eed4bf115', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:49:58.525801 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2977007c-a1df-4511-833b-76e230b62860 service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:49:58.526140 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2977007c-a1df-4511-833b-76e230b62860 service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:49:58.526414 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2977007c-a1df-4511-833b-76e230b62860 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:49:58.581759 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2977007c-a1df-4511-833b-76e230b62860 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:49:58.583172 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2977007c-a1df-4511-833b-76e230b62860 service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:49:58.592457 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1294/2569] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:49:58 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:50:03.275727 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57975093-739b-4a67-aaa7-a2755461968b service cinder] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:03.277177 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-57975093-739b-4a67-aaa7-a2755461968b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:03.322331 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:50:03.341428 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57975093-739b-4a67-aaa7-a2755461968b service cinder] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:03.346087 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c516c0-7b5f-404e-93cb-b22cac48fe62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:03.347688 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c516c0-7b5f-404e-93cb-b22cac48fe62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:03.347688 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c516c0-7b5f-404e-93cb-b22cac48fe62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:03.347688 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c516c0-7b5f-404e-93cb-b22cac48fe62 admin admin] PATH_INFO: `/v3/users/4ae639db76004c0d9c6897a0bed6ff8b` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:03.348733 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c516c0-7b5f-404e-93cb-b22cac48fe62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ae639db76004c0d9c6897a0bed6ff8b)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:03.351266 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c516c0-7b5f-404e-93cb-b22cac48fe62 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:03.619416 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-65c516c0-7b5f-404e-93cb-b22cac48fe62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ae639db76004c0d9c6897a0bed6ff8b'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:03.626150 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-65c516c0-7b5f-404e-93cb-b22cac48fe62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ae639db76004c0d9c6897a0bed6ff8b'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:03.626810 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-65c516c0-7b5f-404e-93cb-b22cac48fe62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ae639db76004c0d9c6897a0bed6ff8b'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:03.639244 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-65c516c0-7b5f-404e-93cb-b22cac48fe62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ae639db76004c0d9c6897a0bed6ff8b'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:03.642032 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-65c516c0-7b5f-404e-93cb-b22cac48fe62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ae639db76004c0d9c6897a0bed6ff8b'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:03.731014 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1276/2570] 10.222.0.86 () {58 vars in 1223 bytes} [Tue Jun 7 14:50:03 2022] DELETE /identity/v3/users/4ae639db76004c0d9c6897a0bed6ff8b => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:50:03.737375 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b5eda4-1ada-4e0d-b3c9-f6cf4c8cb173 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:03.737875 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b5eda4-1ada-4e0d-b3c9-f6cf4c8cb173 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:03.738105 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b5eda4-1ada-4e0d-b3c9-f6cf4c8cb173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:03.768959 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-c5b5eda4-1ada-4e0d-b3c9-f6cf4c8cb173 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:50:03.768959 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-c5b5eda4-1ada-4e0d-b3c9-f6cf4c8cb173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:03.822083 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:50:03.840350 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1295/2571] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:50:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:50:03.850180 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c516c0-7b5f-404e-93cb-b22cac48fe62 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:03.851671 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-65c516c0-7b5f-404e-93cb-b22cac48fe62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:03.908929 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c516c0-7b5f-404e-93cb-b22cac48fe62 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:03.912679 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4890d4a5-332a-49b4-bede-53fb3f0c36b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dda603ec5517460a83c333db2af804d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:03.913413 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4890d4a5-332a-49b4-bede-53fb3f0c36b2 service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:03.913677 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4890d4a5-332a-49b4-bede-53fb3f0c36b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:03.914015 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4890d4a5-332a-49b4-bede-53fb3f0c36b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:03.925048 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4890d4a5-332a-49b4-bede-53fb3f0c36b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:03.927638 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4890d4a5-332a-49b4-bede-53fb3f0c36b2 service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:03.938245 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1277/2572] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:50:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:50:04.355206 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b5eda4-1ada-4e0d-b3c9-f6cf4c8cb173 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:04.356707 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-c5b5eda4-1ada-4e0d-b3c9-f6cf4c8cb173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:04.373614 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b5eda4-1ada-4e0d-b3c9-f6cf4c8cb173 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:04.380507 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f7e783-21cd-431b-89fe-a437afc0aea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:04.382390 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f7e783-21cd-431b-89fe-a437afc0aea8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:04.382682 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f7e783-21cd-431b-89fe-a437afc0aea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:04.382964 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f7e783-21cd-431b-89fe-a437afc0aea8 admin admin] PATH_INFO: `/v3/projects/620f25a8ff71477682ac42664879c811` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:04.384459 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f7e783-21cd-431b-89fe-a437afc0aea8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=620f25a8ff71477682ac42664879c811)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:04.386378 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f7e783-21cd-431b-89fe-a437afc0aea8 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:04.544432 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-c5f7e783-21cd-431b-89fe-a437afc0aea8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '620f25a8ff71477682ac42664879c811', 'request_id': 'req-c5f7e783-21cd-431b-89fe-a437afc0aea8'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:04.550559 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-c5f7e783-21cd-431b-89fe-a437afc0aea8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '620f25a8ff71477682ac42664879c811', 'request_id': 'req-c5f7e783-21cd-431b-89fe-a437afc0aea8'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:04.634769 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-c5f7e783-21cd-431b-89fe-a437afc0aea8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '620f25a8ff71477682ac42664879c811', 'request_id': 'req-c5f7e783-21cd-431b-89fe-a437afc0aea8'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:04.645856 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-c5f7e783-21cd-431b-89fe-a437afc0aea8 admin admin] The token cache is being invalidate because project 620f25a8ff71477682ac42664879c811 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:50:04.646150 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-c5f7e783-21cd-431b-89fe-a437afc0aea8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:04.646779 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-c5f7e783-21cd-431b-89fe-a437afc0aea8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:04.648357 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1296/2573] 10.222.0.86 () {58 vars in 1232 bytes} [Tue Jun 7 14:50:04 2022] DELETE /identity/v3/projects/620f25a8ff71477682ac42664879c811 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 14:50:04.652288 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4890d4a5-332a-49b4-bede-53fb3f0c36b2 service neutron] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:04.662248 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4890d4a5-332a-49b4-bede-53fb3f0c36b2 service neutron] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:04.717338 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392c64bb-6838-46f1-b0f8-cc49ff5771bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:04.718213 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392c64bb-6838-46f1-b0f8-cc49ff5771bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:04.718501 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392c64bb-6838-46f1-b0f8-cc49ff5771bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:04.718781 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392c64bb-6838-46f1-b0f8-cc49ff5771bc admin admin] PATH_INFO: `/v3/users/9b13aa6bc7974e3db99e17a2dd7bd740` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:04.719992 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392c64bb-6838-46f1-b0f8-cc49ff5771bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b13aa6bc7974e3db99e17a2dd7bd740)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:04.721924 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392c64bb-6838-46f1-b0f8-cc49ff5771bc admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:04.727116 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:50:04.933629 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-392c64bb-6838-46f1-b0f8-cc49ff5771bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b13aa6bc7974e3db99e17a2dd7bd740'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:04.940406 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-392c64bb-6838-46f1-b0f8-cc49ff5771bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b13aa6bc7974e3db99e17a2dd7bd740'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:04.941108 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-392c64bb-6838-46f1-b0f8-cc49ff5771bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b13aa6bc7974e3db99e17a2dd7bd740'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:04.953219 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-392c64bb-6838-46f1-b0f8-cc49ff5771bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b13aa6bc7974e3db99e17a2dd7bd740'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:04.953890 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-392c64bb-6838-46f1-b0f8-cc49ff5771bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b13aa6bc7974e3db99e17a2dd7bd740'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:05.024108 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1278/2574] 10.222.0.86 () {58 vars in 1223 bytes} [Tue Jun 7 14:50:04 2022] DELETE /identity/v3/users/9b13aa6bc7974e3db99e17a2dd7bd740 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:50:05.128605 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f7e783-21cd-431b-89fe-a437afc0aea8 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:05.130998 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-c5f7e783-21cd-431b-89fe-a437afc0aea8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:05.189058 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f7e783-21cd-431b-89fe-a437afc0aea8 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:05.240933 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a06a92-3b0d-49a4-b5fe-b0a79f9db55c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dda603ec5517460a83c333db2af804d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:05.241592 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a06a92-3b0d-49a4-b5fe-b0a79f9db55c service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:05.241908 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a06a92-3b0d-49a4-b5fe-b0a79f9db55c service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:05.242199 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a06a92-3b0d-49a4-b5fe-b0a79f9db55c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:05.244064 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-02a06a92-3b0d-49a4-b5fe-b0a79f9db55c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:05.287559 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:50:05.309680 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a06a92-3b0d-49a4-b5fe-b0a79f9db55c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:05.311113 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a06a92-3b0d-49a4-b5fe-b0a79f9db55c service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:05.322203 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1297/2575] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:50:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:50:05.567033 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392c64bb-6838-46f1-b0f8-cc49ff5771bc admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:05.569346 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-392c64bb-6838-46f1-b0f8-cc49ff5771bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:05.588568 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392c64bb-6838-46f1-b0f8-cc49ff5771bc admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:05.603489 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d351b1f3-f71c-424d-9ccf-d8bb17b12875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:05.604487 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d351b1f3-f71c-424d-9ccf-d8bb17b12875 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:05.604842 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d351b1f3-f71c-424d-9ccf-d8bb17b12875 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:05.605190 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d351b1f3-f71c-424d-9ccf-d8bb17b12875 admin admin] PATH_INFO: `/v3/projects/cf8c7783fd7648178246e05ee804a94a` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:05.606494 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d351b1f3-f71c-424d-9ccf-d8bb17b12875 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf8c7783fd7648178246e05ee804a94a)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:05.608576 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d351b1f3-f71c-424d-9ccf-d8bb17b12875 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:05.733270 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-d351b1f3-f71c-424d-9ccf-d8bb17b12875 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf8c7783fd7648178246e05ee804a94a', 'request_id': 'req-d351b1f3-f71c-424d-9ccf-d8bb17b12875'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:05.740154 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-d351b1f3-f71c-424d-9ccf-d8bb17b12875 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf8c7783fd7648178246e05ee804a94a', 'request_id': 'req-d351b1f3-f71c-424d-9ccf-d8bb17b12875'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:05.812157 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-d351b1f3-f71c-424d-9ccf-d8bb17b12875 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf8c7783fd7648178246e05ee804a94a', 'request_id': 'req-d351b1f3-f71c-424d-9ccf-d8bb17b12875'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:05.824814 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-d351b1f3-f71c-424d-9ccf-d8bb17b12875 admin admin] The token cache is being invalidate because project cf8c7783fd7648178246e05ee804a94a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:50:05.825338 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-d351b1f3-f71c-424d-9ccf-d8bb17b12875 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:05.826108 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-d351b1f3-f71c-424d-9ccf-d8bb17b12875 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:05.827784 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1279/2576] 10.222.0.86 () {58 vars in 1232 bytes} [Tue Jun 7 14:50:05 2022] DELETE /identity/v3/projects/cf8c7783fd7648178246e05ee804a94a => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:50:05.832737 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d637d351-2cb9-4643-9528-4a44433bd28f None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:05.833097 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d637d351-2cb9-4643-9528-4a44433bd28f None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:05.833347 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d637d351-2cb9-4643-9528-4a44433bd28f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:05.856186 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-d637d351-2cb9-4643-9528-4a44433bd28f None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:50:05.857442 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-d637d351-2cb9-4643-9528-4a44433bd28f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:05.925786 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1298/2577] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:50:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:50:05.934596 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee6b4d2-2871-4573-a731-08809c3b5535 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:05.935008 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee6b4d2-2871-4573-a731-08809c3b5535 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:05.935333 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee6b4d2-2871-4573-a731-08809c3b5535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:05.954534 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-dee6b4d2-2871-4573-a731-08809c3b5535 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:50:05.955694 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-dee6b4d2-2871-4573-a731-08809c3b5535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:05.963680 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1280/2578] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:50:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:50:05.968021 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d637d351-2cb9-4643-9528-4a44433bd28f None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:05.979750 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d637d351-2cb9-4643-9528-4a44433bd28f None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:05.985083 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d0d655-2ad2-454a-abbf-b42476faa6ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:05.985754 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d0d655-2ad2-454a-abbf-b42476faa6ed admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:05.986042 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d0d655-2ad2-454a-abbf-b42476faa6ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:05.986324 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d0d655-2ad2-454a-abbf-b42476faa6ed admin admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:05.987253 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d0d655-2ad2-454a-abbf-b42476faa6ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:50:05.987565 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d0d655-2ad2-454a-abbf-b42476faa6ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:05.989363 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d0d655-2ad2-454a-abbf-b42476faa6ed admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:06.002702 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1299/2579] 10.222.0.86 () {58 vars in 1152 bytes} [Tue Jun 7 14:50:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:50:06.007274 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee6b4d2-2871-4573-a731-08809c3b5535 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:06.017354 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee6b4d2-2871-4573-a731-08809c3b5535 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:06.022522 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8769b99b-78b3-4b4a-86ae-e7d3ece8f579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:06.023253 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8769b99b-78b3-4b4a-86ae-e7d3ece8f579 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:06.023705 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8769b99b-78b3-4b4a-86ae-e7d3ece8f579 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:06.024092 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8769b99b-78b3-4b4a-86ae-e7d3ece8f579 admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:06.024936 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8769b99b-78b3-4b4a-86ae-e7d3ece8f579 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:06.026880 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8769b99b-78b3-4b4a-86ae-e7d3ece8f579 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:06.131578 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1281/2580] 10.222.0.86 () {60 vars in 1152 bytes} [Tue Jun 7 14:50:06 2022] POST /identity/v3/projects => generated 387 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 14:50:06.133059 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d0d655-2ad2-454a-abbf-b42476faa6ed admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:06.143410 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d0d655-2ad2-454a-abbf-b42476faa6ed admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:06.200249 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913993a2-0f0c-4cb3-928c-14ba1fdce35a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:06.201022 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913993a2-0f0c-4cb3-928c-14ba1fdce35a admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:06.201400 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913993a2-0f0c-4cb3-928c-14ba1fdce35a admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:06.202102 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913993a2-0f0c-4cb3-928c-14ba1fdce35a admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:06.202569 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913993a2-0f0c-4cb3-928c-14ba1fdce35a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:06.204498 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913993a2-0f0c-4cb3-928c-14ba1fdce35a admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:06.316013 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1300/2581] 10.222.0.86 () {60 vars in 1143 bytes} [Tue Jun 7 14:50:06 2022] POST /identity/v3/users => generated 294 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:50:06.320400 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8769b99b-78b3-4b4a-86ae-e7d3ece8f579 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:06.330842 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8769b99b-78b3-4b4a-86ae-e7d3ece8f579 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:06.336005 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2375b73-ac42-458d-b7cf-4098d86565e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:06.336740 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2375b73-ac42-458d-b7cf-4098d86565e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:06.337022 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2375b73-ac42-458d-b7cf-4098d86565e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:06.337333 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2375b73-ac42-458d-b7cf-4098d86565e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:06.338075 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2375b73-ac42-458d-b7cf-4098d86565e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:06.339735 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2375b73-ac42-458d-b7cf-4098d86565e6 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:06.362618 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1282/2582] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:50:06 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:50:06.363464 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913993a2-0f0c-4cb3-928c-14ba1fdce35a admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:06.377881 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913993a2-0f0c-4cb3-928c-14ba1fdce35a admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:06.380513 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c27a3bd-39ef-4150-8c99-7314c208f580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:06.381443 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c27a3bd-39ef-4150-8c99-7314c208f580 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:06.382518 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c27a3bd-39ef-4150-8c99-7314c208f580 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:06.382518 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c27a3bd-39ef-4150-8c99-7314c208f580 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:06.382970 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c27a3bd-39ef-4150-8c99-7314c208f580 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:06.385083 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c27a3bd-39ef-4150-8c99-7314c208f580 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:06.398176 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1301/2583] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:50:06 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:50:06.402803 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2375b73-ac42-458d-b7cf-4098d86565e6 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:06.414630 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2375b73-ac42-458d-b7cf-4098d86565e6 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:06.419519 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799463f5-72d4-430b-af1d-d3bae27ee4a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:06.420504 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799463f5-72d4-430b-af1d-d3bae27ee4a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:06.420864 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799463f5-72d4-430b-af1d-d3bae27ee4a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:06.421216 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799463f5-72d4-430b-af1d-d3bae27ee4a5 admin admin] PATH_INFO: `/v3/projects/ef1388abc785453fae0561dde1d6a578/users/139aa0b68f904631a39a2bea9f3f97bf/roles/c17acc2a8bb348f59ba7edd22fcf0c47` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:06.437941 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799463f5-72d4-430b-af1d-d3bae27ee4a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef1388abc785453fae0561dde1d6a578, user_id=139aa0b68f904631a39a2bea9f3f97bf, role_id=c17acc2a8bb348f59ba7edd22fcf0c47)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:06.440734 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799463f5-72d4-430b-af1d-d3bae27ee4a5 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:06.577997 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1283/2584] 10.222.0.86 () {60 vars in 1482 bytes} [Tue Jun 7 14:50:06 2022] PUT /identity/v3/projects/ef1388abc785453fae0561dde1d6a578/users/139aa0b68f904631a39a2bea9f3f97bf/roles/c17acc2a8bb348f59ba7edd22fcf0c47 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:50:06.590115 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd7a971-68b7-4acc-ae8f-3126b5909b77 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:06.591804 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd7a971-68b7-4acc-ae8f-3126b5909b77 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:06.591804 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd7a971-68b7-4acc-ae8f-3126b5909b77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:06.617549 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-efd7a971-68b7-4acc-ae8f-3126b5909b77 None None] MFA Rules not processed for user `139aa0b68f904631a39a2bea9f3f97bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:50:06.618716 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-efd7a971-68b7-4acc-ae8f-3126b5909b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:06.652261 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:50:06.685058 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1302/2585] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:50:06 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:50:06.689621 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799463f5-72d4-430b-af1d-d3bae27ee4a5 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:06.694867 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=79,keystone:DELETE=17,keystone:INSERT=4 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:50:06.751436 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799463f5-72d4-430b-af1d-d3bae27ee4a5 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:06.757721 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085e71ef-e2bf-485e-a518-70cd6b4da4a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:06.758796 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085e71ef-e2bf-485e-a518-70cd6b4da4a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:06.759085 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085e71ef-e2bf-485e-a518-70cd6b4da4a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:06.759369 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085e71ef-e2bf-485e-a518-70cd6b4da4a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:06.760117 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085e71ef-e2bf-485e-a518-70cd6b4da4a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:06.765520 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085e71ef-e2bf-485e-a518-70cd6b4da4a8 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:06.849083 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1284/2586] 10.222.0.86 () {60 vars in 1152 bytes} [Tue Jun 7 14:50:06 2022] POST /identity/v3/projects => generated 385 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:50:06.854660 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd7a971-68b7-4acc-ae8f-3126b5909b77 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:06.869179 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd7a971-68b7-4acc-ae8f-3126b5909b77 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:06.968743 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad76f270-a040-4ea1-a348-f48cfbf056f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:06.970147 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad76f270-a040-4ea1-a348-f48cfbf056f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:06.970147 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad76f270-a040-4ea1-a348-f48cfbf056f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:06.970147 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad76f270-a040-4ea1-a348-f48cfbf056f0 admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:06.971368 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad76f270-a040-4ea1-a348-f48cfbf056f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:06.973470 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad76f270-a040-4ea1-a348-f48cfbf056f0 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:07.070482 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1303/2587] 10.222.0.86 () {60 vars in 1143 bytes} [Tue Jun 7 14:50:06 2022] POST /identity/v3/users => generated 299 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 14:50:07.074550 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085e71ef-e2bf-485e-a518-70cd6b4da4a8 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:07.085655 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085e71ef-e2bf-485e-a518-70cd6b4da4a8 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:07.093487 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2532b597-389e-4191-9f47-34769365b164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:07.093487 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2532b597-389e-4191-9f47-34769365b164 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:07.093487 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2532b597-389e-4191-9f47-34769365b164 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:07.093487 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2532b597-389e-4191-9f47-34769365b164 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:07.094024 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2532b597-389e-4191-9f47-34769365b164 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:07.094851 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2532b597-389e-4191-9f47-34769365b164 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:07.107797 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1285/2588] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:50:07 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:50:07.112509 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad76f270-a040-4ea1-a348-f48cfbf056f0 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:07.128038 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad76f270-a040-4ea1-a348-f48cfbf056f0 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:07.132656 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bbf6aa-5efd-4243-ad10-04d7197941ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:07.133913 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bbf6aa-5efd-4243-ad10-04d7197941ba admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:07.134494 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bbf6aa-5efd-4243-ad10-04d7197941ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:07.134646 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bbf6aa-5efd-4243-ad10-04d7197941ba admin admin] PATH_INFO: `/v3/projects/39f540f1de0148d58ffe0a6207032a6d/users/98e47fbbc2f6473c970ba6841f1098bf/roles/e3bf6239f5bf477b965704b086786f11` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:07.151981 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bbf6aa-5efd-4243-ad10-04d7197941ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=39f540f1de0148d58ffe0a6207032a6d, user_id=98e47fbbc2f6473c970ba6841f1098bf, role_id=e3bf6239f5bf477b965704b086786f11)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:07.156307 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bbf6aa-5efd-4243-ad10-04d7197941ba admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:07.206852 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2532b597-389e-4191-9f47-34769365b164 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:07.208753 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-2532b597-389e-4191-9f47-34769365b164 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:07.224413 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2532b597-389e-4191-9f47-34769365b164 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:07.235064 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7115d211-c9b2-41d6-bc62-b042684f3f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:07.236012 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7115d211-c9b2-41d6-bc62-b042684f3f6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:07.236304 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7115d211-c9b2-41d6-bc62-b042684f3f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:07.236584 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7115d211-c9b2-41d6-bc62-b042684f3f6a admin admin] PATH_INFO: `/v3/users/c2b9e77c2a004e5581dff0942c852cda` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:07.238501 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7115d211-c9b2-41d6-bc62-b042684f3f6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2b9e77c2a004e5581dff0942c852cda)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:07.241001 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7115d211-c9b2-41d6-bc62-b042684f3f6a admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:07.278984 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1304/2589] 10.222.0.86 () {60 vars in 1482 bytes} [Tue Jun 7 14:50:07 2022] PUT /identity/v3/projects/39f540f1de0148d58ffe0a6207032a6d/users/98e47fbbc2f6473c970ba6841f1098bf/roles/e3bf6239f5bf477b965704b086786f11 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:50:07.280025 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bbf6aa-5efd-4243-ad10-04d7197941ba admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:07.378127 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bbf6aa-5efd-4243-ad10-04d7197941ba admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:07.383794 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be47ccc9-46fa-4df3-98f1-eb0af52f9447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:07.388721 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be47ccc9-46fa-4df3-98f1-eb0af52f9447 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:07.388721 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be47ccc9-46fa-4df3-98f1-eb0af52f9447 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:07.388721 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be47ccc9-46fa-4df3-98f1-eb0af52f9447 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:07.388721 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be47ccc9-46fa-4df3-98f1-eb0af52f9447 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:07.388721 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be47ccc9-46fa-4df3-98f1-eb0af52f9447 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:07.399079 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1305/2590] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:50:07 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:50:07.403794 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be47ccc9-46fa-4df3-98f1-eb0af52f9447 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:07.415798 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be47ccc9-46fa-4df3-98f1-eb0af52f9447 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:07.423613 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba539e84-1518-4557-aeab-98e83d9d7ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:07.424595 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba539e84-1518-4557-aeab-98e83d9d7ffd admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:07.424828 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba539e84-1518-4557-aeab-98e83d9d7ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:07.425102 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba539e84-1518-4557-aeab-98e83d9d7ffd admin admin] PATH_INFO: `/v3/projects/39f540f1de0148d58ffe0a6207032a6d/users/98e47fbbc2f6473c970ba6841f1098bf/roles/e3bf6239f5bf477b965704b086786f11` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:07.430333 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba539e84-1518-4557-aeab-98e83d9d7ffd admin admin] RBAC: Authorizing `identity:create_grant(project_id=39f540f1de0148d58ffe0a6207032a6d, user_id=98e47fbbc2f6473c970ba6841f1098bf, role_id=e3bf6239f5bf477b965704b086786f11)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:07.434583 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba539e84-1518-4557-aeab-98e83d9d7ffd admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:07.434900 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-7115d211-c9b2-41d6-bc62-b042684f3f6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2b9e77c2a004e5581dff0942c852cda'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:07.443447 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-7115d211-c9b2-41d6-bc62-b042684f3f6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2b9e77c2a004e5581dff0942c852cda'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:07.447747 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-7115d211-c9b2-41d6-bc62-b042684f3f6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2b9e77c2a004e5581dff0942c852cda'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:07.455567 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1306/2591] 10.222.0.86 () {60 vars in 1482 bytes} [Tue Jun 7 14:50:07 2022] PUT /identity/v3/projects/39f540f1de0148d58ffe0a6207032a6d/users/98e47fbbc2f6473c970ba6841f1098bf/roles/e3bf6239f5bf477b965704b086786f11 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:50:07.465892 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162162a1-e1bb-4ccf-a90e-4906aefa6195 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:07.471270 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162162a1-e1bb-4ccf-a90e-4906aefa6195 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:07.471270 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162162a1-e1bb-4ccf-a90e-4906aefa6195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:07.471561 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-7115d211-c9b2-41d6-bc62-b042684f3f6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2b9e77c2a004e5581dff0942c852cda'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:07.471561 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-7115d211-c9b2-41d6-bc62-b042684f3f6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2b9e77c2a004e5581dff0942c852cda'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:07.500527 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-162162a1-e1bb-4ccf-a90e-4906aefa6195 None None] MFA Rules not processed for user `98e47fbbc2f6473c970ba6841f1098bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:50:07.501783 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-162162a1-e1bb-4ccf-a90e-4906aefa6195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:07.510247 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:50:07.571143 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1307/2592] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:50:07 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:50:07.582238 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162162a1-e1bb-4ccf-a90e-4906aefa6195 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:07.583706 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-162162a1-e1bb-4ccf-a90e-4906aefa6195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:07.606994 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1286/2593] 10.222.0.86 () {58 vars in 1223 bytes} [Tue Jun 7 14:50:07 2022] DELETE /identity/v3/users/c2b9e77c2a004e5581dff0942c852cda => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:50:07.612189 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff853240-53cb-4b3c-a2d1-54230c03e878 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:07.612582 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff853240-53cb-4b3c-a2d1-54230c03e878 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:07.613601 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff853240-53cb-4b3c-a2d1-54230c03e878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:07.637712 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-ff853240-53cb-4b3c-a2d1-54230c03e878 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:50:07.639101 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-ff853240-53cb-4b3c-a2d1-54230c03e878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:07.646196 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162162a1-e1bb-4ccf-a90e-4906aefa6195 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:07.688050 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:50:07.700664 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230b9649-14d1-4b28-ade4-0d7ed4a84119 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af5a95620a4b43538abfe09eed4bf115', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:07.701451 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230b9649-14d1-4b28-ade4-0d7ed4a84119 service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:07.701742 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230b9649-14d1-4b28-ade4-0d7ed4a84119 service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:07.702024 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230b9649-14d1-4b28-ade4-0d7ed4a84119 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:07.705202 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1287/2594] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:50:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 14:50:07.717675 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff853240-53cb-4b3c-a2d1-54230c03e878 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:07.719330 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-ff853240-53cb-4b3c-a2d1-54230c03e878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:07.774347 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230b9649-14d1-4b28-ade4-0d7ed4a84119 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:07.775862 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230b9649-14d1-4b28-ade4-0d7ed4a84119 service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:07.780922 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff853240-53cb-4b3c-a2d1-54230c03e878 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:07.784549 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711318e1-87bc-4121-be7e-52a86d881f3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dda603ec5517460a83c333db2af804d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:07.785191 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711318e1-87bc-4121-be7e-52a86d881f3a service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:07.785586 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711318e1-87bc-4121-be7e-52a86d881f3a service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:07.785713 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1308/2595] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:50:07 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 14:50:07.785816 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711318e1-87bc-4121-be7e-52a86d881f3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:07.798238 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711318e1-87bc-4121-be7e-52a86d881f3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:07.798238 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711318e1-87bc-4121-be7e-52a86d881f3a service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:07.808615 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1288/2596] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:50:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:50:07.861499 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230b9649-14d1-4b28-ade4-0d7ed4a84119 service cinder] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:07.863508 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-230b9649-14d1-4b28-ade4-0d7ed4a84119 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:07.884651 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230b9649-14d1-4b28-ade4-0d7ed4a84119 service cinder] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:07.912685 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea51310-055c-401c-bfbe-d6ceca3af97a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:07.913591 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea51310-055c-401c-bfbe-d6ceca3af97a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:07.913876 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea51310-055c-401c-bfbe-d6ceca3af97a admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:07.914155 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea51310-055c-401c-bfbe-d6ceca3af97a admin admin] PATH_INFO: `/v3/users/139aa0b68f904631a39a2bea9f3f97bf` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:07.916312 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea51310-055c-401c-bfbe-d6ceca3af97a admin admin] RBAC: Authorizing `identity:delete_user(user_id=139aa0b68f904631a39a2bea9f3f97bf)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:07.918386 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea51310-055c-401c-bfbe-d6ceca3af97a admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:07.923903 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:50:08.185483 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-aea51310-055c-401c-bfbe-d6ceca3af97a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '139aa0b68f904631a39a2bea9f3f97bf'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:08.186115 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-aea51310-055c-401c-bfbe-d6ceca3af97a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '139aa0b68f904631a39a2bea9f3f97bf'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:08.193978 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-aea51310-055c-401c-bfbe-d6ceca3af97a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '139aa0b68f904631a39a2bea9f3f97bf'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:08.206264 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-aea51310-055c-401c-bfbe-d6ceca3af97a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '139aa0b68f904631a39a2bea9f3f97bf'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:08.206958 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-aea51310-055c-401c-bfbe-d6ceca3af97a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '139aa0b68f904631a39a2bea9f3f97bf'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:08.312603 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711318e1-87bc-4121-be7e-52a86d881f3a service neutron] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:08.315005 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-711318e1-87bc-4121-be7e-52a86d881f3a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:08.332839 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1309/2597] 10.222.0.86 () {58 vars in 1223 bytes} [Tue Jun 7 14:50:07 2022] DELETE /identity/v3/users/139aa0b68f904631a39a2bea9f3f97bf => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 14:50:08.337354 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76baf8a8-3c3e-48bf-a8e5-4c37eb68f132 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:08.337676 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76baf8a8-3c3e-48bf-a8e5-4c37eb68f132 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:08.337902 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76baf8a8-3c3e-48bf-a8e5-4c37eb68f132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:08.340369 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711318e1-87bc-4121-be7e-52a86d881f3a service neutron] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:08.363020 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-76baf8a8-3c3e-48bf-a8e5-4c37eb68f132 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:50:08.363518 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-76baf8a8-3c3e-48bf-a8e5-4c37eb68f132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:08.427998 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d3ba49-2eed-4e01-9455-5cb058517716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:08.429081 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d3ba49-2eed-4e01-9455-5cb058517716 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:08.429444 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d3ba49-2eed-4e01-9455-5cb058517716 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:08.429797 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d3ba49-2eed-4e01-9455-5cb058517716 admin admin] PATH_INFO: `/v3/projects/8bda5fcfb0464d09b2b1ccc889825a29` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:08.431260 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d3ba49-2eed-4e01-9455-5cb058517716 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bda5fcfb0464d09b2b1ccc889825a29)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:08.433142 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d3ba49-2eed-4e01-9455-5cb058517716 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:08.463152 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1310/2598] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:50:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 14:50:08.475328 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76baf8a8-3c3e-48bf-a8e5-4c37eb68f132 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:08.477107 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-76baf8a8-3c3e-48bf-a8e5-4c37eb68f132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:08.544037 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76baf8a8-3c3e-48bf-a8e5-4c37eb68f132 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:08.548200 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe72b97-20a5-40f0-94d4-3f0155eccdec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dda603ec5517460a83c333db2af804d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:08.549069 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe72b97-20a5-40f0-94d4-3f0155eccdec service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:08.549702 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe72b97-20a5-40f0-94d4-3f0155eccdec service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:08.550159 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe72b97-20a5-40f0-94d4-3f0155eccdec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:08.560455 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe72b97-20a5-40f0-94d4-3f0155eccdec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:08.562086 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe72b97-20a5-40f0-94d4-3f0155eccdec service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:08.581446 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1311/2599] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:50:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 14:50:08.590775 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-c2d3ba49-2eed-4e01-9455-5cb058517716 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bda5fcfb0464d09b2b1ccc889825a29', 'request_id': 'req-c2d3ba49-2eed-4e01-9455-5cb058517716'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:08.613477 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-c2d3ba49-2eed-4e01-9455-5cb058517716 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bda5fcfb0464d09b2b1ccc889825a29', 'request_id': 'req-c2d3ba49-2eed-4e01-9455-5cb058517716'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:08.772832 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-c2d3ba49-2eed-4e01-9455-5cb058517716 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bda5fcfb0464d09b2b1ccc889825a29', 'request_id': 'req-c2d3ba49-2eed-4e01-9455-5cb058517716'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:08.794341 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-c2d3ba49-2eed-4e01-9455-5cb058517716 admin admin] The token cache is being invalidate because project 8bda5fcfb0464d09b2b1ccc889825a29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:50:08.795004 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-c2d3ba49-2eed-4e01-9455-5cb058517716 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:08.796732 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-c2d3ba49-2eed-4e01-9455-5cb058517716 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:08.801461 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1289/2600] 10.222.0.86 () {58 vars in 1232 bytes} [Tue Jun 7 14:50:08 2022] DELETE /identity/v3/projects/8bda5fcfb0464d09b2b1ccc889825a29 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:50:08.802729 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe72b97-20a5-40f0-94d4-3f0155eccdec service neutron] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:08.804894 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-9fe72b97-20a5-40f0-94d4-3f0155eccdec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:08.834293 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe72b97-20a5-40f0-94d4-3f0155eccdec service neutron] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:08.865268 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:50:08.905225 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306f9055-6ee9-41c6-9c64-4cf24e2ecc22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:08.906422 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306f9055-6ee9-41c6-9c64-4cf24e2ecc22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:08.911239 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306f9055-6ee9-41c6-9c64-4cf24e2ecc22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:08.911239 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306f9055-6ee9-41c6-9c64-4cf24e2ecc22 admin admin] PATH_INFO: `/v3/users/fb3dc6eb22d7465eba2ed2147f9028f7` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:08.911239 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306f9055-6ee9-41c6-9c64-4cf24e2ecc22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb3dc6eb22d7465eba2ed2147f9028f7)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:08.911977 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306f9055-6ee9-41c6-9c64-4cf24e2ecc22 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:09.127844 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d3ba49-2eed-4e01-9455-5cb058517716 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:09.129468 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-c2d3ba49-2eed-4e01-9455-5cb058517716 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:09.144621 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d3ba49-2eed-4e01-9455-5cb058517716 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:09.151279 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89380a69-eb5f-497d-9e6c-4ec6d5221674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:09.152717 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89380a69-eb5f-497d-9e6c-4ec6d5221674 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:09.153120 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89380a69-eb5f-497d-9e6c-4ec6d5221674 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:09.153556 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89380a69-eb5f-497d-9e6c-4ec6d5221674 admin admin] PATH_INFO: `/v3/projects/ef1388abc785453fae0561dde1d6a578` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:09.154987 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89380a69-eb5f-497d-9e6c-4ec6d5221674 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef1388abc785453fae0561dde1d6a578)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:09.157134 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89380a69-eb5f-497d-9e6c-4ec6d5221674 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:09.172282 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-306f9055-6ee9-41c6-9c64-4cf24e2ecc22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb3dc6eb22d7465eba2ed2147f9028f7'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:09.173043 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-306f9055-6ee9-41c6-9c64-4cf24e2ecc22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb3dc6eb22d7465eba2ed2147f9028f7'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:09.178268 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:50:09.181560 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-306f9055-6ee9-41c6-9c64-4cf24e2ecc22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb3dc6eb22d7465eba2ed2147f9028f7'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:09.195518 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-306f9055-6ee9-41c6-9c64-4cf24e2ecc22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb3dc6eb22d7465eba2ed2147f9028f7'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:09.197272 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-306f9055-6ee9-41c6-9c64-4cf24e2ecc22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb3dc6eb22d7465eba2ed2147f9028f7'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:09.284945 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1312/2601] 10.222.0.86 () {58 vars in 1223 bytes} [Tue Jun 7 14:50:08 2022] DELETE /identity/v3/users/fb3dc6eb22d7465eba2ed2147f9028f7 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:50:09.285959 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306f9055-6ee9-41c6-9c64-4cf24e2ecc22 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:09.287308 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-306f9055-6ee9-41c6-9c64-4cf24e2ecc22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:09.297572 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-89380a69-eb5f-497d-9e6c-4ec6d5221674 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef1388abc785453fae0561dde1d6a578', 'request_id': 'req-89380a69-eb5f-497d-9e6c-4ec6d5221674'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:09.305047 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-89380a69-eb5f-497d-9e6c-4ec6d5221674 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef1388abc785453fae0561dde1d6a578', 'request_id': 'req-89380a69-eb5f-497d-9e6c-4ec6d5221674'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:09.361455 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306f9055-6ee9-41c6-9c64-4cf24e2ecc22 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:09.367560 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377c273b-66c5-4c88-8da1-a1cbf32a8a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:09.368476 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377c273b-66c5-4c88-8da1-a1cbf32a8a04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:09.368763 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377c273b-66c5-4c88-8da1-a1cbf32a8a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:09.369039 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377c273b-66c5-4c88-8da1-a1cbf32a8a04 admin admin] PATH_INFO: `/v3/users/65552520abca41ab8728a75046dc94d5` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:09.370364 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377c273b-66c5-4c88-8da1-a1cbf32a8a04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65552520abca41ab8728a75046dc94d5)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:09.372227 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377c273b-66c5-4c88-8da1-a1cbf32a8a04 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:09.383189 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-89380a69-eb5f-497d-9e6c-4ec6d5221674 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef1388abc785453fae0561dde1d6a578', 'request_id': 'req-89380a69-eb5f-497d-9e6c-4ec6d5221674'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:09.394297 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-89380a69-eb5f-497d-9e6c-4ec6d5221674 admin admin] The token cache is being invalidate because project ef1388abc785453fae0561dde1d6a578 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:50:09.394578 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-89380a69-eb5f-497d-9e6c-4ec6d5221674 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:09.395207 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-89380a69-eb5f-497d-9e6c-4ec6d5221674 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:09.396925 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1290/2602] 10.222.0.86 () {58 vars in 1232 bytes} [Tue Jun 7 14:50:09 2022] DELETE /identity/v3/projects/ef1388abc785453fae0561dde1d6a578 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 14:50:09.400877 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89380a69-eb5f-497d-9e6c-4ec6d5221674 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:09.402202 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-89380a69-eb5f-497d-9e6c-4ec6d5221674 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:09.466551 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89380a69-eb5f-497d-9e6c-4ec6d5221674 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:09.472301 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d2ce65-6b10-4fae-b326-999bc96b71c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:09.473317 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d2ce65-6b10-4fae-b326-999bc96b71c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:09.473655 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d2ce65-6b10-4fae-b326-999bc96b71c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:09.473935 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d2ce65-6b10-4fae-b326-999bc96b71c8 admin admin] PATH_INFO: `/v3/users/98e47fbbc2f6473c970ba6841f1098bf` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:09.475135 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d2ce65-6b10-4fae-b326-999bc96b71c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98e47fbbc2f6473c970ba6841f1098bf)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:09.477275 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d2ce65-6b10-4fae-b326-999bc96b71c8 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:09.571687 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-377c273b-66c5-4c88-8da1-a1cbf32a8a04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65552520abca41ab8728a75046dc94d5'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:09.572557 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-377c273b-66c5-4c88-8da1-a1cbf32a8a04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65552520abca41ab8728a75046dc94d5'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:09.585127 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-377c273b-66c5-4c88-8da1-a1cbf32a8a04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65552520abca41ab8728a75046dc94d5'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:09.598568 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-377c273b-66c5-4c88-8da1-a1cbf32a8a04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65552520abca41ab8728a75046dc94d5'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:09.600192 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-377c273b-66c5-4c88-8da1-a1cbf32a8a04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65552520abca41ab8728a75046dc94d5'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:09.674829 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1313/2603] 10.222.0.86 () {58 vars in 1223 bytes} [Tue Jun 7 14:50:09 2022] DELETE /identity/v3/users/65552520abca41ab8728a75046dc94d5 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:50:09.683650 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-12d2ce65-6b10-4fae-b326-999bc96b71c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98e47fbbc2f6473c970ba6841f1098bf'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:09.690410 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-12d2ce65-6b10-4fae-b326-999bc96b71c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98e47fbbc2f6473c970ba6841f1098bf'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:09.691081 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-12d2ce65-6b10-4fae-b326-999bc96b71c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98e47fbbc2f6473c970ba6841f1098bf'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:09.706236 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-12d2ce65-6b10-4fae-b326-999bc96b71c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98e47fbbc2f6473c970ba6841f1098bf'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:09.710798 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-12d2ce65-6b10-4fae-b326-999bc96b71c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98e47fbbc2f6473c970ba6841f1098bf'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:09.710924 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377c273b-66c5-4c88-8da1-a1cbf32a8a04 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:09.710924 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-377c273b-66c5-4c88-8da1-a1cbf32a8a04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:09.782444 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377c273b-66c5-4c88-8da1-a1cbf32a8a04 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:09.789093 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44599773-1175-4a99-a233-709bafaa52d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:09.790081 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44599773-1175-4a99-a233-709bafaa52d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:09.790431 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44599773-1175-4a99-a233-709bafaa52d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:09.790719 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1291/2604] 10.222.0.86 () {58 vars in 1223 bytes} [Tue Jun 7 14:50:09 2022] DELETE /identity/v3/users/98e47fbbc2f6473c970ba6841f1098bf => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 14:50:09.790889 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44599773-1175-4a99-a233-709bafaa52d7 admin admin] PATH_INFO: `/v3/projects/b1a92d379c5d4c2a8016526e40681a26` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:09.794661 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44599773-1175-4a99-a233-709bafaa52d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1a92d379c5d4c2a8016526e40681a26)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:09.796936 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44599773-1175-4a99-a233-709bafaa52d7 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:09.863406 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:50:09.908556 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-44599773-1175-4a99-a233-709bafaa52d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1a92d379c5d4c2a8016526e40681a26', 'request_id': 'req-44599773-1175-4a99-a233-709bafaa52d7'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:09.915214 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-44599773-1175-4a99-a233-709bafaa52d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1a92d379c5d4c2a8016526e40681a26', 'request_id': 'req-44599773-1175-4a99-a233-709bafaa52d7'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:09.928736 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d2ce65-6b10-4fae-b326-999bc96b71c8 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:09.930212 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-12d2ce65-6b10-4fae-b326-999bc96b71c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:09.998421 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d2ce65-6b10-4fae-b326-999bc96b71c8 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:10.034766 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-44599773-1175-4a99-a233-709bafaa52d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1a92d379c5d4c2a8016526e40681a26', 'request_id': 'req-44599773-1175-4a99-a233-709bafaa52d7'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:10.047598 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-44599773-1175-4a99-a233-709bafaa52d7 admin admin] The token cache is being invalidate because project b1a92d379c5d4c2a8016526e40681a26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:50:10.048007 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-44599773-1175-4a99-a233-709bafaa52d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:10.048762 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-44599773-1175-4a99-a233-709bafaa52d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:10.050661 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1314/2605] 10.222.0.86 () {58 vars in 1232 bytes} [Tue Jun 7 14:50:09 2022] DELETE /identity/v3/projects/b1a92d379c5d4c2a8016526e40681a26 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:50:10.055206 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0080396e-7ac7-4a4b-b59c-866973f7574c None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:10.055589 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0080396e-7ac7-4a4b-b59c-866973f7574c None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:10.055970 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0080396e-7ac7-4a4b-b59c-866973f7574c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:10.057136 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4e9b26-4efa-4578-a978-d45c5dff745f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:10.058248 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4e9b26-4efa-4578-a978-d45c5dff745f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:10.058692 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4e9b26-4efa-4578-a978-d45c5dff745f admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:10.059122 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4e9b26-4efa-4578-a978-d45c5dff745f admin admin] PATH_INFO: `/v3/projects/9fae31b8695447cbb1ad3e82004bffd7` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:10.060406 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4e9b26-4efa-4578-a978-d45c5dff745f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9fae31b8695447cbb1ad3e82004bffd7)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:10.062467 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4e9b26-4efa-4578-a978-d45c5dff745f admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:10.072534 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:50:10.074781 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-0080396e-7ac7-4a4b-b59c-866973f7574c None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:50:10.076078 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-0080396e-7ac7-4a4b-b59c-866973f7574c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:10.094229 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1315/2606] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:50:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 14:50:10.095656 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9a1f8f-bade-43cb-9b48-8fab34915f40 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:10.095979 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9a1f8f-bade-43cb-9b48-8fab34915f40 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:10.096267 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9a1f8f-bade-43cb-9b48-8fab34915f40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:10.115163 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-0a9a1f8f-bade-43cb-9b48-8fab34915f40 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:50:10.116423 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-0a9a1f8f-bade-43cb-9b48-8fab34915f40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:10.124612 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1316/2607] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:50:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:50:10.128640 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9a1f8f-bade-43cb-9b48-8fab34915f40 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:10.138764 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9a1f8f-bade-43cb-9b48-8fab34915f40 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:10.143480 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff360e0e-57d4-4f23-8a33-fb97c4011c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:10.144172 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff360e0e-57d4-4f23-8a33-fb97c4011c1c admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:10.144458 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff360e0e-57d4-4f23-8a33-fb97c4011c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:10.144972 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff360e0e-57d4-4f23-8a33-fb97c4011c1c admin admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:10.146303 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff360e0e-57d4-4f23-8a33-fb97c4011c1c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:50:10.146611 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff360e0e-57d4-4f23-8a33-fb97c4011c1c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:10.148285 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff360e0e-57d4-4f23-8a33-fb97c4011c1c admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:10.163730 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1317/2608] 10.222.0.86 () {58 vars in 1152 bytes} [Tue Jun 7 14:50:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:50:10.164831 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff360e0e-57d4-4f23-8a33-fb97c4011c1c admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:10.174725 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff360e0e-57d4-4f23-8a33-fb97c4011c1c admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:10.188449 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c2489c-a200-48a4-bcb6-af18243daeed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:10.188449 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c2489c-a200-48a4-bcb6-af18243daeed admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:10.188449 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c2489c-a200-48a4-bcb6-af18243daeed admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:10.188449 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c2489c-a200-48a4-bcb6-af18243daeed admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:10.188890 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c2489c-a200-48a4-bcb6-af18243daeed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:10.188890 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c2489c-a200-48a4-bcb6-af18243daeed admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:10.191791 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-5a4e9b26-4efa-4578-a978-d45c5dff745f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9fae31b8695447cbb1ad3e82004bffd7', 'request_id': 'req-5a4e9b26-4efa-4578-a978-d45c5dff745f'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:10.200484 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-5a4e9b26-4efa-4578-a978-d45c5dff745f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9fae31b8695447cbb1ad3e82004bffd7', 'request_id': 'req-5a4e9b26-4efa-4578-a978-d45c5dff745f'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:10.274687 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-5a4e9b26-4efa-4578-a978-d45c5dff745f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9fae31b8695447cbb1ad3e82004bffd7', 'request_id': 'req-5a4e9b26-4efa-4578-a978-d45c5dff745f'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:10.287559 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1318/2609] 10.222.0.86 () {60 vars in 1152 bytes} [Tue Jun 7 14:50:10 2022] POST /identity/v3/projects => generated 393 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 14:50:10.291997 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-5a4e9b26-4efa-4578-a978-d45c5dff745f admin admin] The token cache is being invalidate because project 9fae31b8695447cbb1ad3e82004bffd7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:50:10.291997 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-5a4e9b26-4efa-4578-a978-d45c5dff745f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:10.292342 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c2489c-a200-48a4-bcb6-af18243daeed admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:10.292458 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-5a4e9b26-4efa-4578-a978-d45c5dff745f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:10.292458 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1292/2610] 10.222.0.86 () {58 vars in 1232 bytes} [Tue Jun 7 14:50:09 2022] DELETE /identity/v3/projects/9fae31b8695447cbb1ad3e82004bffd7 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:50:10.292620 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-70c2489c-a200-48a4-bcb6-af18243daeed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:10.294639 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4e9b26-4efa-4578-a978-d45c5dff745f admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:10.296027 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-5a4e9b26-4efa-4578-a978-d45c5dff745f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:10.367569 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c2489c-a200-48a4-bcb6-af18243daeed admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:10.368643 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4e9b26-4efa-4578-a978-d45c5dff745f admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:10.372716 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8499ebf-86c1-4553-939b-6173b8017e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:10.373252 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f364134-f288-4680-beed-6686c34386eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:10.373572 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8499ebf-86c1-4553-939b-6173b8017e29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:10.373850 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8499ebf-86c1-4553-939b-6173b8017e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:10.373952 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f364134-f288-4680-beed-6686c34386eb admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:10.374120 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8499ebf-86c1-4553-939b-6173b8017e29 admin admin] PATH_INFO: `/v3/projects/39f540f1de0148d58ffe0a6207032a6d` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:10.374222 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f364134-f288-4680-beed-6686c34386eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:10.374448 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f364134-f288-4680-beed-6686c34386eb admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:10.375146 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f364134-f288-4680-beed-6686c34386eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:10.375319 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8499ebf-86c1-4553-939b-6173b8017e29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39f540f1de0148d58ffe0a6207032a6d)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:10.377087 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f364134-f288-4680-beed-6686c34386eb admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:10.377288 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8499ebf-86c1-4553-939b-6173b8017e29 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:10.475725 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1293/2611] 10.222.0.86 () {60 vars in 1143 bytes} [Tue Jun 7 14:50:10 2022] POST /identity/v3/users => generated 297 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 14:50:10.476895 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2591c558-0cc2-4ce2-8914-bcb3c74388e8 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:10.477190 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2591c558-0cc2-4ce2-8914-bcb3c74388e8 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:10.477475 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2591c558-0cc2-4ce2-8914-bcb3c74388e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:10.495238 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-2591c558-0cc2-4ce2-8914-bcb3c74388e8 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:50:10.496456 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-2591c558-0cc2-4ce2-8914-bcb3c74388e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:10.504812 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1294/2612] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:50:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:50:10.505762 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2591c558-0cc2-4ce2-8914-bcb3c74388e8 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:10.516304 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2591c558-0cc2-4ce2-8914-bcb3c74388e8 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:10.521180 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc5bd1a-7e2b-4442-be59-34b3687e69cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:10.521918 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc5bd1a-7e2b-4442-be59-34b3687e69cd admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:10.522208 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc5bd1a-7e2b-4442-be59-34b3687e69cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:10.522484 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc5bd1a-7e2b-4442-be59-34b3687e69cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:10.523263 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc5bd1a-7e2b-4442-be59-34b3687e69cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:10.524887 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc5bd1a-7e2b-4442-be59-34b3687e69cd admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:10.531673 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-c8499ebf-86c1-4553-939b-6173b8017e29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39f540f1de0148d58ffe0a6207032a6d', 'request_id': 'req-c8499ebf-86c1-4553-939b-6173b8017e29'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:10.534856 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1295/2613] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:50:10 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:50:10.536600 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67352fca-2bb2-4814-b6c7-a33701f40f48 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:10.536891 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67352fca-2bb2-4814-b6c7-a33701f40f48 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:10.537171 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67352fca-2bb2-4814-b6c7-a33701f40f48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:10.539098 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-c8499ebf-86c1-4553-939b-6173b8017e29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39f540f1de0148d58ffe0a6207032a6d', 'request_id': 'req-c8499ebf-86c1-4553-939b-6173b8017e29'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:10.555253 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-67352fca-2bb2-4814-b6c7-a33701f40f48 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:50:10.556497 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-67352fca-2bb2-4814-b6c7-a33701f40f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:10.613400 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1296/2614] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:50:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:50:10.614889 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67352fca-2bb2-4814-b6c7-a33701f40f48 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:10.623639 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67352fca-2bb2-4814-b6c7-a33701f40f48 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:10.628244 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8da083-e9bc-4112-9101-7624102f0271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:10.628873 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8da083-e9bc-4112-9101-7624102f0271 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:10.629160 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8da083-e9bc-4112-9101-7624102f0271 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:10.629441 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8da083-e9bc-4112-9101-7624102f0271 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:10.630195 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8da083-e9bc-4112-9101-7624102f0271 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:10.631781 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8da083-e9bc-4112-9101-7624102f0271 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:10.641522 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1297/2615] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:50:10 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:50:10.642280 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8da083-e9bc-4112-9101-7624102f0271 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:10.651994 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8da083-e9bc-4112-9101-7624102f0271 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:10.656583 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46726b9-8f61-4813-8230-85c3922218bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:10.657170 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46726b9-8f61-4813-8230-85c3922218bb admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:10.657455 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46726b9-8f61-4813-8230-85c3922218bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:10.657732 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46726b9-8f61-4813-8230-85c3922218bb admin admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:10.658433 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46726b9-8f61-4813-8230-85c3922218bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:50:10.658742 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46726b9-8f61-4813-8230-85c3922218bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:10.660348 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46726b9-8f61-4813-8230-85c3922218bb admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:10.672373 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1298/2616] 10.222.0.86 () {58 vars in 1152 bytes} [Tue Jun 7 14:50:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:50:10.673110 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46726b9-8f61-4813-8230-85c3922218bb admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:10.682692 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46726b9-8f61-4813-8230-85c3922218bb admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:10.687304 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09593584-2d1f-43e8-bd42-e039c3052f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:10.688167 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09593584-2d1f-43e8-bd42-e039c3052f12 admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:10.688448 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09593584-2d1f-43e8-bd42-e039c3052f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:10.688725 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09593584-2d1f-43e8-bd42-e039c3052f12 admin admin] PATH_INFO: `/v3/projects/77a6af6e39b54567bbc0a6f3ca3ba743/users/6b12f3b4f87d48548f4d6771a6445c01/roles/c17acc2a8bb348f59ba7edd22fcf0c47` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:10.697671 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-c8499ebf-86c1-4553-939b-6173b8017e29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39f540f1de0148d58ffe0a6207032a6d', 'request_id': 'req-c8499ebf-86c1-4553-939b-6173b8017e29'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:10.703991 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09593584-2d1f-43e8-bd42-e039c3052f12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77a6af6e39b54567bbc0a6f3ca3ba743, user_id=6b12f3b4f87d48548f4d6771a6445c01, role_id=c17acc2a8bb348f59ba7edd22fcf0c47)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:10.706617 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09593584-2d1f-43e8-bd42-e039c3052f12 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:10.709000 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-c8499ebf-86c1-4553-939b-6173b8017e29 admin admin] The token cache is being invalidate because project 39f540f1de0148d58ffe0a6207032a6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:50:10.709292 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-c8499ebf-86c1-4553-939b-6173b8017e29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:10.709946 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-c8499ebf-86c1-4553-939b-6173b8017e29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:10.711505 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1319/2617] 10.222.0.86 () {58 vars in 1232 bytes} [Tue Jun 7 14:50:10 2022] DELETE /identity/v3/projects/39f540f1de0148d58ffe0a6207032a6d => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:50:10.712285 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8499ebf-86c1-4553-939b-6173b8017e29 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:10.713571 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-c8499ebf-86c1-4553-939b-6173b8017e29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:10.726612 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8499ebf-86c1-4553-939b-6173b8017e29 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:10.731172 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147f1603-2932-4a2e-8a62-09aa4028c4a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:10.731835 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147f1603-2932-4a2e-8a62-09aa4028c4a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:10.732124 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147f1603-2932-4a2e-8a62-09aa4028c4a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:10.732430 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147f1603-2932-4a2e-8a62-09aa4028c4a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:10.733110 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147f1603-2932-4a2e-8a62-09aa4028c4a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:10.734983 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147f1603-2932-4a2e-8a62-09aa4028c4a9 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:10.766441 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:50:10.790135 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1299/2618] 10.222.0.86 () {60 vars in 1482 bytes} [Tue Jun 7 14:50:10 2022] PUT /identity/v3/projects/77a6af6e39b54567bbc0a6f3ca3ba743/users/6b12f3b4f87d48548f4d6771a6445c01/roles/c17acc2a8bb348f59ba7edd22fcf0c47 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:50:10.791412 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392d6b25-e264-4aae-9101-3a277c3afa52 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:10.793792 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392d6b25-e264-4aae-9101-3a277c3afa52 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:10.793792 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392d6b25-e264-4aae-9101-3a277c3afa52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:10.808773 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-392d6b25-e264-4aae-9101-3a277c3afa52 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:50:10.809977 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-392d6b25-e264-4aae-9101-3a277c3afa52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:10.859299 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1320/2619] 10.222.0.86 () {60 vars in 1152 bytes} [Tue Jun 7 14:50:10 2022] POST /identity/v3/projects => generated 367 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:50:10.860651 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935992bc-78b5-4a0e-a2c0-92363ada5a6f None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:10.860944 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935992bc-78b5-4a0e-a2c0-92363ada5a6f None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:10.861226 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935992bc-78b5-4a0e-a2c0-92363ada5a6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:10.871445 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1300/2620] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:50:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:50:10.872301 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392d6b25-e264-4aae-9101-3a277c3afa52 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:10.881749 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392d6b25-e264-4aae-9101-3a277c3afa52 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:10.887405 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:50:10.888352 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-935992bc-78b5-4a0e-a2c0-92363ada5a6f None None] MFA Rules not processed for user `6b12f3b4f87d48548f4d6771a6445c01`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:50:10.889579 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-935992bc-78b5-4a0e-a2c0-92363ada5a6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:10.947492 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668cb22d-c23f-4099-823d-36734b387e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:10.948361 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668cb22d-c23f-4099-823d-36734b387e62 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:10.948652 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668cb22d-c23f-4099-823d-36734b387e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:10.948943 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668cb22d-c23f-4099-823d-36734b387e62 admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:10.949631 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668cb22d-c23f-4099-823d-36734b387e62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:10.952540 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668cb22d-c23f-4099-823d-36734b387e62 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:10.955308 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1321/2621] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:50:10 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:50:10.959599 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc22e341-b39d-498e-b92a-9f56e2d288c7 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:10.959599 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc22e341-b39d-498e-b92a-9f56e2d288c7 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:10.959599 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc22e341-b39d-498e-b92a-9f56e2d288c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:10.975704 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-dc22e341-b39d-498e-b92a-9f56e2d288c7 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:50:10.976971 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-dc22e341-b39d-498e-b92a-9f56e2d288c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:10.984890 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1322/2622] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:50:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:50:10.985807 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc22e341-b39d-498e-b92a-9f56e2d288c7 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:10.987209 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-dc22e341-b39d-498e-b92a-9f56e2d288c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:10.998577 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc22e341-b39d-498e-b92a-9f56e2d288c7 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:11.003269 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7692a328-5c79-4711-8ba6-14ad93c3529d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:11.003934 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7692a328-5c79-4711-8ba6-14ad93c3529d admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:11.004221 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7692a328-5c79-4711-8ba6-14ad93c3529d admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:11.004502 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7692a328-5c79-4711-8ba6-14ad93c3529d admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:11.005215 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7692a328-5c79-4711-8ba6-14ad93c3529d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:11.007090 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7692a328-5c79-4711-8ba6-14ad93c3529d admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:11.111389 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1301/2623] 10.222.0.86 () {60 vars in 1143 bytes} [Tue Jun 7 14:50:10 2022] POST /identity/v3/users => generated 284 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:50:11.111389 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668cb22d-c23f-4099-823d-36734b387e62 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:11.113503 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1323/2624] 10.222.0.86 () {60 vars in 1152 bytes} [Tue Jun 7 14:50:10 2022] POST /identity/v3/projects => generated 393 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:50:11.113503 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7692a328-5c79-4711-8ba6-14ad93c3529d admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:11.120208 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668cb22d-c23f-4099-823d-36734b387e62 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:11.172995 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7692a328-5c79-4711-8ba6-14ad93c3529d admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:11.175679 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66789fa9-4a88-4fea-af14-d3fbec8be3ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:11.176375 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66789fa9-4a88-4fea-af14-d3fbec8be3ea admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:11.176688 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66789fa9-4a88-4fea-af14-d3fbec8be3ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:11.176965 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66789fa9-4a88-4fea-af14-d3fbec8be3ea admin admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:11.177696 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66789fa9-4a88-4fea-af14-d3fbec8be3ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:50:11.177814 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b17340-824c-4e17-9c63-05c21fe50d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:11.178006 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66789fa9-4a88-4fea-af14-d3fbec8be3ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:11.178444 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b17340-824c-4e17-9c63-05c21fe50d7c admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:11.178729 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b17340-824c-4e17-9c63-05c21fe50d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:11.179002 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b17340-824c-4e17-9c63-05c21fe50d7c admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:11.179591 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66789fa9-4a88-4fea-af14-d3fbec8be3ea admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:11.179749 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b17340-824c-4e17-9c63-05c21fe50d7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:11.181446 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b17340-824c-4e17-9c63-05c21fe50d7c admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:11.190776 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1302/2625] 10.222.0.86 () {58 vars in 1152 bytes} [Tue Jun 7 14:50:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:50:11.191575 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66789fa9-4a88-4fea-af14-d3fbec8be3ea admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:11.195855 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1324/2626] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:50:11 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:50:11.196746 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b17340-824c-4e17-9c63-05c21fe50d7c admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:11.205604 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66789fa9-4a88-4fea-af14-d3fbec8be3ea admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:11.210862 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b17340-824c-4e17-9c63-05c21fe50d7c admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:11.210984 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4d8d5b-a395-445e-b71c-c48d865dce31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:11.211579 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4d8d5b-a395-445e-b71c-c48d865dce31 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:11.211721 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0f706c-af4b-49eb-964e-b0f48ef4aa61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:11.211900 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4d8d5b-a395-445e-b71c-c48d865dce31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:11.212183 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4d8d5b-a395-445e-b71c-c48d865dce31 admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:11.212395 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0f706c-af4b-49eb-964e-b0f48ef4aa61 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:11.212680 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0f706c-af4b-49eb-964e-b0f48ef4aa61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:11.212881 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4d8d5b-a395-445e-b71c-c48d865dce31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:11.212979 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0f706c-af4b-49eb-964e-b0f48ef4aa61 admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:11.213630 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0f706c-af4b-49eb-964e-b0f48ef4aa61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:11.214796 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4d8d5b-a395-445e-b71c-c48d865dce31 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:11.215497 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0f706c-af4b-49eb-964e-b0f48ef4aa61 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:11.321879 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1303/2627] 10.222.0.86 () {60 vars in 1143 bytes} [Tue Jun 7 14:50:11 2022] POST /identity/v3/users => generated 303 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:50:11.322782 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4d8d5b-a395-445e-b71c-c48d865dce31 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:11.332385 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4d8d5b-a395-445e-b71c-c48d865dce31 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:11.337775 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f87f7c3-40d7-45de-a5f7-4be0749e9574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:11.338415 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f87f7c3-40d7-45de-a5f7-4be0749e9574 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:11.338702 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f87f7c3-40d7-45de-a5f7-4be0749e9574 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:11.338981 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f87f7c3-40d7-45de-a5f7-4be0749e9574 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:11.339728 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f87f7c3-40d7-45de-a5f7-4be0749e9574 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:11.341428 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f87f7c3-40d7-45de-a5f7-4be0749e9574 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:11.351571 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1304/2628] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:50:11 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:50:11.352418 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f87f7c3-40d7-45de-a5f7-4be0749e9574 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:11.362183 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1325/2629] 10.222.0.86 () {60 vars in 1152 bytes} [Tue Jun 7 14:50:11 2022] POST /identity/v3/projects => generated 361 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:50:11.365560 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f87f7c3-40d7-45de-a5f7-4be0749e9574 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:11.365698 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0f706c-af4b-49eb-964e-b0f48ef4aa61 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:11.419610 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02c69ba-4a18-41b1-b15b-912e8b8334ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:11.420386 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02c69ba-4a18-41b1-b15b-912e8b8334ac admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:11.420678 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02c69ba-4a18-41b1-b15b-912e8b8334ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:11.420961 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02c69ba-4a18-41b1-b15b-912e8b8334ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:11.421697 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02c69ba-4a18-41b1-b15b-912e8b8334ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:11.423347 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02c69ba-4a18-41b1-b15b-912e8b8334ac admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:11.428359 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0f706c-af4b-49eb-964e-b0f48ef4aa61 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:11.433099 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0106f349-13f9-4a81-ad6c-18d61be6e149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:11.433643 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1305/2630] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:50:11 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:50:11.433991 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0106f349-13f9-4a81-ad6c-18d61be6e149 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:11.434300 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0106f349-13f9-4a81-ad6c-18d61be6e149 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:11.434570 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02c69ba-4a18-41b1-b15b-912e8b8334ac admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:11.434684 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0106f349-13f9-4a81-ad6c-18d61be6e149 admin admin] PATH_INFO: `/v3/projects/e93b7c74eec1414c9b4f891ad9223581/users/3dc0d80109114140806e401234ad57d6/roles/c17acc2a8bb348f59ba7edd22fcf0c47` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:11.446787 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02c69ba-4a18-41b1-b15b-912e8b8334ac admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:11.450203 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0106f349-13f9-4a81-ad6c-18d61be6e149 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e93b7c74eec1414c9b4f891ad9223581, user_id=3dc0d80109114140806e401234ad57d6, role_id=c17acc2a8bb348f59ba7edd22fcf0c47)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:11.460931 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b83686c-f3a6-45c8-823d-61e3241c16d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:11.461079 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:50:11.461193 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b83686c-f3a6-45c8-823d-61e3241c16d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:11.461193 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b83686c-f3a6-45c8-823d-61e3241c16d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:11.461193 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b83686c-f3a6-45c8-823d-61e3241c16d9 admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:11.461193 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b83686c-f3a6-45c8-823d-61e3241c16d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:11.461529 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0106f349-13f9-4a81-ad6c-18d61be6e149 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:11.461620 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b83686c-f3a6-45c8-823d-61e3241c16d9 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:11.506348 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:50:11.555234 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1326/2631] 10.222.0.86 () {60 vars in 1482 bytes} [Tue Jun 7 14:50:11 2022] PUT /identity/v3/projects/e93b7c74eec1414c9b4f891ad9223581/users/3dc0d80109114140806e401234ad57d6/roles/c17acc2a8bb348f59ba7edd22fcf0c47 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:50:11.556080 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0106f349-13f9-4a81-ad6c-18d61be6e149 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:11.604273 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1306/2632] 10.222.0.86 () {60 vars in 1143 bytes} [Tue Jun 7 14:50:11 2022] POST /identity/v3/users => generated 281 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:50:11.604273 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba599a10-fde5-4c0d-b392-93f449f34e3e None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:11.604273 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba599a10-fde5-4c0d-b392-93f449f34e3e None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:11.604273 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba599a10-fde5-4c0d-b392-93f449f34e3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:11.619346 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0106f349-13f9-4a81-ad6c-18d61be6e149 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:11.624304 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f800447-8eb5-43a4-b29e-f6004fafd878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:11.625221 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f800447-8eb5-43a4-b29e-f6004fafd878 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:11.625511 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f800447-8eb5-43a4-b29e-f6004fafd878 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:11.625823 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f800447-8eb5-43a4-b29e-f6004fafd878 admin admin] PATH_INFO: `/v3/projects/9b60a58a428344ae80d1ab03dccde6ed/users/0fa253bba2ce4670af106ae1f4dd47f1/roles/e3bf6239f5bf477b965704b086786f11` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:11.630990 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-ba599a10-fde5-4c0d-b392-93f449f34e3e None None] MFA Rules not processed for user `3dc0d80109114140806e401234ad57d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:50:11.632385 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-ba599a10-fde5-4c0d-b392-93f449f34e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:11.641937 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f800447-8eb5-43a4-b29e-f6004fafd878 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b60a58a428344ae80d1ab03dccde6ed, user_id=0fa253bba2ce4670af106ae1f4dd47f1, role_id=e3bf6239f5bf477b965704b086786f11)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:11.644976 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f800447-8eb5-43a4-b29e-f6004fafd878 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:11.695415 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1307/2633] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:50:11 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:50:11.696269 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba599a10-fde5-4c0d-b392-93f449f34e3e None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:11.706417 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba599a10-fde5-4c0d-b392-93f449f34e3e None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:11.711123 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fdf18e-e303-431d-b90f-4158e2e713c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:11.711810 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fdf18e-e303-431d-b90f-4158e2e713c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:11.712101 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fdf18e-e303-431d-b90f-4158e2e713c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:11.712386 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fdf18e-e303-431d-b90f-4158e2e713c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:11.713146 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fdf18e-e303-431d-b90f-4158e2e713c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:11.714805 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fdf18e-e303-431d-b90f-4158e2e713c4 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:11.724550 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1308/2634] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:50:11 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:50:11.725323 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fdf18e-e303-431d-b90f-4158e2e713c4 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:11.726855 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-95fdf18e-e303-431d-b90f-4158e2e713c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:11.737436 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1327/2635] 10.222.0.86 () {60 vars in 1482 bytes} [Tue Jun 7 14:50:11 2022] PUT /identity/v3/projects/9b60a58a428344ae80d1ab03dccde6ed/users/0fa253bba2ce4670af106ae1f4dd47f1/roles/e3bf6239f5bf477b965704b086786f11 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:50:11.738193 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f800447-8eb5-43a4-b29e-f6004fafd878 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:11.784576 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fdf18e-e303-431d-b90f-4158e2e713c4 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:11.799836 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f800447-8eb5-43a4-b29e-f6004fafd878 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:11.805173 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d597a3d-c57b-4c34-aa42-d5291c15db76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:11.805839 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d597a3d-c57b-4c34-aa42-d5291c15db76 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:11.806126 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d597a3d-c57b-4c34-aa42-d5291c15db76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:11.806404 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d597a3d-c57b-4c34-aa42-d5291c15db76 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:11.807130 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d597a3d-c57b-4c34-aa42-d5291c15db76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:11.808815 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d597a3d-c57b-4c34-aa42-d5291c15db76 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:11.818932 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1328/2636] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:50:11 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:50:11.819870 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d597a3d-c57b-4c34-aa42-d5291c15db76 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:11.830366 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d597a3d-c57b-4c34-aa42-d5291c15db76 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:11.833307 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcee749-1845-4f90-bcf5-2ce5300fc940 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af5a95620a4b43538abfe09eed4bf115', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:11.833964 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcee749-1845-4f90-bcf5-2ce5300fc940 service cinder] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:11.834251 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcee749-1845-4f90-bcf5-2ce5300fc940 service cinder] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:11.834696 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcee749-1845-4f90-bcf5-2ce5300fc940 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:11.835252 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34a850a-21b4-45da-b163-22a6e391384e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:11.835928 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34a850a-21b4-45da-b163-22a6e391384e admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:11.836218 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34a850a-21b4-45da-b163-22a6e391384e admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:11.836494 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34a850a-21b4-45da-b163-22a6e391384e admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:11.837211 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34a850a-21b4-45da-b163-22a6e391384e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:11.838937 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34a850a-21b4-45da-b163-22a6e391384e admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:11.850504 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1329/2637] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:50:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:50:11.850504 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34a850a-21b4-45da-b163-22a6e391384e admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:11.860911 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34a850a-21b4-45da-b163-22a6e391384e admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:11.866336 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5056a327-b8b2-436e-8026-3404eb7f2882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:11.867287 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5056a327-b8b2-436e-8026-3404eb7f2882 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:11.867570 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5056a327-b8b2-436e-8026-3404eb7f2882 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:11.867886 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5056a327-b8b2-436e-8026-3404eb7f2882 admin admin] PATH_INFO: `/v3/projects/b615db9cc3844120b6b8d61cc8eee3dc/users/e91b4a56cb834803a52a45717c77f620/roles/c17acc2a8bb348f59ba7edd22fcf0c47` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:11.882870 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5056a327-b8b2-436e-8026-3404eb7f2882 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b615db9cc3844120b6b8d61cc8eee3dc, user_id=e91b4a56cb834803a52a45717c77f620, role_id=c17acc2a8bb348f59ba7edd22fcf0c47)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:11.885832 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5056a327-b8b2-436e-8026-3404eb7f2882 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:11.891942 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcee749-1845-4f90-bcf5-2ce5300fc940 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:11.893501 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcee749-1845-4f90-bcf5-2ce5300fc940 service cinder] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:11.898135 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:50:11.904080 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1309/2638] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:50:11 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:50:11.904887 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcee749-1845-4f90-bcf5-2ce5300fc940 service cinder] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:11.915381 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcee749-1845-4f90-bcf5-2ce5300fc940 service cinder] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:11.920291 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98cf842-279e-4d42-b995-156b9c9515bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:11.921165 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98cf842-279e-4d42-b995-156b9c9515bd admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:11.921452 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98cf842-279e-4d42-b995-156b9c9515bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:11.921794 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98cf842-279e-4d42-b995-156b9c9515bd admin admin] PATH_INFO: `/v3/projects/9b60a58a428344ae80d1ab03dccde6ed/users/0fa253bba2ce4670af106ae1f4dd47f1/roles/e3bf6239f5bf477b965704b086786f11` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:11.923787 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98cf842-279e-4d42-b995-156b9c9515bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b60a58a428344ae80d1ab03dccde6ed, user_id=0fa253bba2ce4670af106ae1f4dd47f1, role_id=e3bf6239f5bf477b965704b086786f11)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:11.926506 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98cf842-279e-4d42-b995-156b9c9515bd admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:11.937665 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1310/2639] 10.222.0.86 () {60 vars in 1482 bytes} [Tue Jun 7 14:50:11 2022] PUT /identity/v3/projects/9b60a58a428344ae80d1ab03dccde6ed/users/0fa253bba2ce4670af106ae1f4dd47f1/roles/e3bf6239f5bf477b965704b086786f11 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:50:11.947500 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3860e27f-9938-45c1-ad95-8f26f6bc1fb7 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:11.947822 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3860e27f-9938-45c1-ad95-8f26f6bc1fb7 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:11.948372 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3860e27f-9938-45c1-ad95-8f26f6bc1fb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:11.950034 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1330/2640] 10.222.0.86 () {60 vars in 1482 bytes} [Tue Jun 7 14:50:11 2022] PUT /identity/v3/projects/b615db9cc3844120b6b8d61cc8eee3dc/users/e91b4a56cb834803a52a45717c77f620/roles/c17acc2a8bb348f59ba7edd22fcf0c47 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:50:11.967055 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd68c35-3b38-4111-8e7c-f5d050e920b5 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:11.967494 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd68c35-3b38-4111-8e7c-f5d050e920b5 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:11.967795 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd68c35-3b38-4111-8e7c-f5d050e920b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:11.975520 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-3860e27f-9938-45c1-ad95-8f26f6bc1fb7 None None] MFA Rules not processed for user `0fa253bba2ce4670af106ae1f4dd47f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:50:11.976773 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-3860e27f-9938-45c1-ad95-8f26f6bc1fb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:11.983954 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:50:11.996424 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-dcd68c35-3b38-4111-8e7c-f5d050e920b5 None None] MFA Rules not processed for user `e91b4a56cb834803a52a45717c77f620`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:50:11.997608 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-dcd68c35-3b38-4111-8e7c-f5d050e920b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:12.052349 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1311/2641] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:50:11 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 14:50:12.064273 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3860e27f-9938-45c1-ad95-8f26f6bc1fb7 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:12.065666 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-3860e27f-9938-45c1-ad95-8f26f6bc1fb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:12.070018 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1331/2642] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:50:11 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:50:12.122736 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3860e27f-9938-45c1-ad95-8f26f6bc1fb7 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:12.126614 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff963d2f-2ec1-4bd6-af62-03be642aabd3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af5a95620a4b43538abfe09eed4bf115', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:12.127321 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff963d2f-2ec1-4bd6-af62-03be642aabd3 service cinder] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:12.127592 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff963d2f-2ec1-4bd6-af62-03be642aabd3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:12.127901 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff963d2f-2ec1-4bd6-af62-03be642aabd3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:12.137503 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff963d2f-2ec1-4bd6-af62-03be642aabd3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:12.138934 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff963d2f-2ec1-4bd6-af62-03be642aabd3 service cinder] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:12.150355 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1312/2643] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:50:12 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 14:50:12.197159 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd68c35-3b38-4111-8e7c-f5d050e920b5 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:12.207310 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd68c35-3b38-4111-8e7c-f5d050e920b5 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:12.211827 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9b9241-ccf3-4b77-8b2e-9b0e5c9104b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af5a95620a4b43538abfe09eed4bf115', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:12.212481 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9b9241-ccf3-4b77-8b2e-9b0e5c9104b3 service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:12.212771 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9b9241-ccf3-4b77-8b2e-9b0e5c9104b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:12.213052 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9b9241-ccf3-4b77-8b2e-9b0e5c9104b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:12.263554 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:50:12.271113 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9b9241-ccf3-4b77-8b2e-9b0e5c9104b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:12.272664 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9b9241-ccf3-4b77-8b2e-9b0e5c9104b3 service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:12.284291 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1332/2644] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:50:12 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:50:12.320769 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:50:12.699046 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff963d2f-2ec1-4bd6-af62-03be642aabd3 service cinder] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:12.707603 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff963d2f-2ec1-4bd6-af62-03be642aabd3 service cinder] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:12.711808 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6306f74-90e2-48f2-a21d-475c2edbf162 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af5a95620a4b43538abfe09eed4bf115', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:12.712488 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6306f74-90e2-48f2-a21d-475c2edbf162 service cinder] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:12.712770 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6306f74-90e2-48f2-a21d-475c2edbf162 service cinder] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:12.713043 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6306f74-90e2-48f2-a21d-475c2edbf162 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:12.721656 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6306f74-90e2-48f2-a21d-475c2edbf162 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:12.723428 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6306f74-90e2-48f2-a21d-475c2edbf162 service cinder] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:12.732221 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1313/2645] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:50:12 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:50:12.746407 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9b9241-ccf3-4b77-8b2e-9b0e5c9104b3 service cinder] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:12.816413 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9b9241-ccf3-4b77-8b2e-9b0e5c9104b3 service cinder] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:12.820998 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62b124f-46da-49b6-81e7-c08911647a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:12.821865 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62b124f-46da-49b6-81e7-c08911647a70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:12.822148 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62b124f-46da-49b6-81e7-c08911647a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:12.822426 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62b124f-46da-49b6-81e7-c08911647a70 admin admin] PATH_INFO: `/v3/users/e91b4a56cb834803a52a45717c77f620` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:12.823610 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62b124f-46da-49b6-81e7-c08911647a70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e91b4a56cb834803a52a45717c77f620)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:12.825558 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62b124f-46da-49b6-81e7-c08911647a70 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:13.024090 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-b62b124f-46da-49b6-81e7-c08911647a70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e91b4a56cb834803a52a45717c77f620'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:13.024872 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-b62b124f-46da-49b6-81e7-c08911647a70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e91b4a56cb834803a52a45717c77f620'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:13.032574 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-b62b124f-46da-49b6-81e7-c08911647a70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e91b4a56cb834803a52a45717c77f620'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:13.046054 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-b62b124f-46da-49b6-81e7-c08911647a70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e91b4a56cb834803a52a45717c77f620'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:13.046814 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-b62b124f-46da-49b6-81e7-c08911647a70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e91b4a56cb834803a52a45717c77f620'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:13.104224 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1333/2646] 10.222.0.86 () {58 vars in 1223 bytes} [Tue Jun 7 14:50:12 2022] DELETE /identity/v3/users/e91b4a56cb834803a52a45717c77f620 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:50:13.108641 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3239a726-bb01-4af6-a8d4-5c80589c0bdc None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:13.110552 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3239a726-bb01-4af6-a8d4-5c80589c0bdc None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:13.110552 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3239a726-bb01-4af6-a8d4-5c80589c0bdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:13.126651 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-3239a726-bb01-4af6-a8d4-5c80589c0bdc None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:50:13.127919 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-3239a726-bb01-4af6-a8d4-5c80589c0bdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:13.173662 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:50:13.187461 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1314/2647] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:50:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:50:13.204390 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62b124f-46da-49b6-81e7-c08911647a70 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:13.205870 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-b62b124f-46da-49b6-81e7-c08911647a70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:13.235435 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:50:13.264449 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62b124f-46da-49b6-81e7-c08911647a70 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:13.268074 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf0c7b1-70f4-404b-9f03-b45848d28bd2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dda603ec5517460a83c333db2af804d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:13.268722 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf0c7b1-70f4-404b-9f03-b45848d28bd2 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:13.269012 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf0c7b1-70f4-404b-9f03-b45848d28bd2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:13.269307 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf0c7b1-70f4-404b-9f03-b45848d28bd2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:13.278707 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf0c7b1-70f4-404b-9f03-b45848d28bd2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:13.281266 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf0c7b1-70f4-404b-9f03-b45848d28bd2 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:13.290083 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1334/2648] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:50:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 14:50:13.750650 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3239a726-bb01-4af6-a8d4-5c80589c0bdc None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:13.752205 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-3239a726-bb01-4af6-a8d4-5c80589c0bdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:13.768312 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3239a726-bb01-4af6-a8d4-5c80589c0bdc None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:13.774574 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3739c8cb-e3ff-4eb7-9263-ce24df450a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:13.774574 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3739c8cb-e3ff-4eb7-9263-ce24df450a1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:13.775504 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3739c8cb-e3ff-4eb7-9263-ce24df450a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:13.775909 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3739c8cb-e3ff-4eb7-9263-ce24df450a1d admin admin] PATH_INFO: `/v3/projects/b615db9cc3844120b6b8d61cc8eee3dc` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:13.777418 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3739c8cb-e3ff-4eb7-9263-ce24df450a1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b615db9cc3844120b6b8d61cc8eee3dc)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:13.779440 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3739c8cb-e3ff-4eb7-9263-ce24df450a1d admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:13.920063 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-3739c8cb-e3ff-4eb7-9263-ce24df450a1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b615db9cc3844120b6b8d61cc8eee3dc', 'request_id': 'req-3739c8cb-e3ff-4eb7-9263-ce24df450a1d'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:13.926978 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-3739c8cb-e3ff-4eb7-9263-ce24df450a1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b615db9cc3844120b6b8d61cc8eee3dc', 'request_id': 'req-3739c8cb-e3ff-4eb7-9263-ce24df450a1d'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:14.010470 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-3739c8cb-e3ff-4eb7-9263-ce24df450a1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b615db9cc3844120b6b8d61cc8eee3dc', 'request_id': 'req-3739c8cb-e3ff-4eb7-9263-ce24df450a1d'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:14.021046 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-3739c8cb-e3ff-4eb7-9263-ce24df450a1d admin admin] The token cache is being invalidate because project b615db9cc3844120b6b8d61cc8eee3dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:50:14.021335 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-3739c8cb-e3ff-4eb7-9263-ce24df450a1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:14.021978 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-3739c8cb-e3ff-4eb7-9263-ce24df450a1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:14.023518 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1315/2649] 10.222.0.86 () {58 vars in 1232 bytes} [Tue Jun 7 14:50:13 2022] DELETE /identity/v3/projects/b615db9cc3844120b6b8d61cc8eee3dc => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:50:14.028612 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf15f9c-0cac-4433-be07-26adb02f425b None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:14.029122 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf15f9c-0cac-4433-be07-26adb02f425b None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:14.029248 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf15f9c-0cac-4433-be07-26adb02f425b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:14.048859 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-2bf15f9c-0cac-4433-be07-26adb02f425b None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:50:14.050050 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-2bf15f9c-0cac-4433-be07-26adb02f425b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:14.121746 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1335/2650] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:50:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 14:50:14.128292 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f629f9-4712-4c66-a89f-b4431561c34d None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:14.128753 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f629f9-4712-4c66-a89f-b4431561c34d None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:14.128987 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f629f9-4712-4c66-a89f-b4431561c34d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:14.148308 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-d8f629f9-4712-4c66-a89f-b4431561c34d None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:50:14.149664 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-d8f629f9-4712-4c66-a89f-b4431561c34d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:14.157919 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1316/2651] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:50:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 14:50:14.162533 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf15f9c-0cac-4433-be07-26adb02f425b None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:14.172519 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf15f9c-0cac-4433-be07-26adb02f425b None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:14.178257 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65d9a79-39cd-4710-acb0-eb2e3a8ea4af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:14.180478 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65d9a79-39cd-4710-acb0-eb2e3a8ea4af admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:14.180478 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65d9a79-39cd-4710-acb0-eb2e3a8ea4af admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:14.180478 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65d9a79-39cd-4710-acb0-eb2e3a8ea4af admin admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:14.180478 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65d9a79-39cd-4710-acb0-eb2e3a8ea4af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:50:14.181003 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65d9a79-39cd-4710-acb0-eb2e3a8ea4af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:14.182680 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65d9a79-39cd-4710-acb0-eb2e3a8ea4af admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:14.195119 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1336/2652] 10.222.0.86 () {58 vars in 1152 bytes} [Tue Jun 7 14:50:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:50:14.199783 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f629f9-4712-4c66-a89f-b4431561c34d None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:14.209353 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f629f9-4712-4c66-a89f-b4431561c34d None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:14.214220 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0987eee7-3de0-4fbf-967e-08eab4024745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:14.214877 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0987eee7-3de0-4fbf-967e-08eab4024745 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:14.215195 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0987eee7-3de0-4fbf-967e-08eab4024745 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:14.215477 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0987eee7-3de0-4fbf-967e-08eab4024745 admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:14.216280 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0987eee7-3de0-4fbf-967e-08eab4024745 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:14.218171 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0987eee7-3de0-4fbf-967e-08eab4024745 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:14.321598 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1317/2653] 10.222.0.86 () {60 vars in 1152 bytes} [Tue Jun 7 14:50:14 2022] POST /identity/v3/projects => generated 375 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:50:14.325755 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65d9a79-39cd-4710-acb0-eb2e3a8ea4af admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:14.335666 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65d9a79-39cd-4710-acb0-eb2e3a8ea4af admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:14.402302 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86708ebe-dbe0-47e4-92b8-464edcdac7ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:14.402982 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86708ebe-dbe0-47e4-92b8-464edcdac7ea admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:14.403346 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86708ebe-dbe0-47e4-92b8-464edcdac7ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:14.403789 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86708ebe-dbe0-47e4-92b8-464edcdac7ea admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:14.404497 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86708ebe-dbe0-47e4-92b8-464edcdac7ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:14.406448 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86708ebe-dbe0-47e4-92b8-464edcdac7ea admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:14.479306 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1337/2654] 10.222.0.86 () {60 vars in 1143 bytes} [Tue Jun 7 14:50:14 2022] POST /identity/v3/users => generated 288 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:50:14.481165 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0987eee7-3de0-4fbf-967e-08eab4024745 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:14.491853 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0987eee7-3de0-4fbf-967e-08eab4024745 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:14.496705 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ce5bb4-9019-4cb6-accc-f0a777b515c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:14.497423 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ce5bb4-9019-4cb6-accc-f0a777b515c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:14.503847 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ce5bb4-9019-4cb6-accc-f0a777b515c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:14.503847 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ce5bb4-9019-4cb6-accc-f0a777b515c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:14.503847 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ce5bb4-9019-4cb6-accc-f0a777b515c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:14.503847 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ce5bb4-9019-4cb6-accc-f0a777b515c5 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:14.511607 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1318/2655] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:50:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:50:14.515632 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86708ebe-dbe0-47e4-92b8-464edcdac7ea admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:14.526421 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86708ebe-dbe0-47e4-92b8-464edcdac7ea admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:14.531381 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc589db-110e-45d5-88e4-da6ffd54d4f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:14.532022 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc589db-110e-45d5-88e4-da6ffd54d4f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:14.532312 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc589db-110e-45d5-88e4-da6ffd54d4f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:14.532591 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc589db-110e-45d5-88e4-da6ffd54d4f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:14.533317 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc589db-110e-45d5-88e4-da6ffd54d4f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:14.534953 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc589db-110e-45d5-88e4-da6ffd54d4f4 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:14.545691 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1338/2656] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:50:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:50:14.549860 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ce5bb4-9019-4cb6-accc-f0a777b515c5 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:14.561881 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ce5bb4-9019-4cb6-accc-f0a777b515c5 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:14.566676 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58674376-7353-4f68-99b4-aa500db78ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:14.567684 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58674376-7353-4f68-99b4-aa500db78ddf admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:14.568011 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58674376-7353-4f68-99b4-aa500db78ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:14.568301 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58674376-7353-4f68-99b4-aa500db78ddf admin admin] PATH_INFO: `/v3/projects/03d1267074a44a64abba6d9ffd2f6677/users/935918cbf7c648d0892557ead6c43fd0/roles/c17acc2a8bb348f59ba7edd22fcf0c47` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:14.584486 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58674376-7353-4f68-99b4-aa500db78ddf admin admin] RBAC: Authorizing `identity:create_grant(project_id=03d1267074a44a64abba6d9ffd2f6677, user_id=935918cbf7c648d0892557ead6c43fd0, role_id=c17acc2a8bb348f59ba7edd22fcf0c47)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:14.587238 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58674376-7353-4f68-99b4-aa500db78ddf admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:14.664260 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1319/2657] 10.222.0.86 () {60 vars in 1482 bytes} [Tue Jun 7 14:50:14 2022] PUT /identity/v3/projects/03d1267074a44a64abba6d9ffd2f6677/users/935918cbf7c648d0892557ead6c43fd0/roles/c17acc2a8bb348f59ba7edd22fcf0c47 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 14:50:14.678774 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5facd0e5-607e-4b31-bb26-18c7669e457e None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:14.679149 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5facd0e5-607e-4b31-bb26-18c7669e457e None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:14.679434 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5facd0e5-607e-4b31-bb26-18c7669e457e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:14.704968 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-5facd0e5-607e-4b31-bb26-18c7669e457e None None] MFA Rules not processed for user `935918cbf7c648d0892557ead6c43fd0`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:50:14.706176 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-5facd0e5-607e-4b31-bb26-18c7669e457e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:14.726622 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:50:14.771271 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1339/2658] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:50:14 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:50:14.782528 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58674376-7353-4f68-99b4-aa500db78ddf admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:14.789153 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-58674376-7353-4f68-99b4-aa500db78ddf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:14.844719 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58674376-7353-4f68-99b4-aa500db78ddf admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:14.848592 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917d78f6-7f63-4a7a-a12a-e1d94bef2313 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af5a95620a4b43538abfe09eed4bf115', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:14.849261 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917d78f6-7f63-4a7a-a12a-e1d94bef2313 service cinder] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:14.849548 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917d78f6-7f63-4a7a-a12a-e1d94bef2313 service cinder] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:14.850546 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917d78f6-7f63-4a7a-a12a-e1d94bef2313 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:14.858398 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917d78f6-7f63-4a7a-a12a-e1d94bef2313 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:14.859924 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917d78f6-7f63-4a7a-a12a-e1d94bef2313 service cinder] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:14.868968 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1320/2659] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:50:14 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:50:17.169263 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5facd0e5-607e-4b31-bb26-18c7669e457e None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:17.172120 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-5facd0e5-607e-4b31-bb26-18c7669e457e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:17.241501 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5facd0e5-607e-4b31-bb26-18c7669e457e None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:17.245996 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8117df2c-79d0-4274-bcc7-6bbe32433fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:17.246838 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8117df2c-79d0-4274-bcc7-6bbe32433fdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:17.247058 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8117df2c-79d0-4274-bcc7-6bbe32433fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:17.247340 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8117df2c-79d0-4274-bcc7-6bbe32433fdd admin admin] PATH_INFO: `/v3/users/6b12f3b4f87d48548f4d6771a6445c01` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:17.248565 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8117df2c-79d0-4274-bcc7-6bbe32433fdd admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b12f3b4f87d48548f4d6771a6445c01)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:17.250490 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8117df2c-79d0-4274-bcc7-6bbe32433fdd admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:17.420972 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-8117df2c-79d0-4274-bcc7-6bbe32433fdd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b12f3b4f87d48548f4d6771a6445c01'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:17.420972 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-8117df2c-79d0-4274-bcc7-6bbe32433fdd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b12f3b4f87d48548f4d6771a6445c01'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:17.423924 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-8117df2c-79d0-4274-bcc7-6bbe32433fdd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b12f3b4f87d48548f4d6771a6445c01'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:17.437367 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-8117df2c-79d0-4274-bcc7-6bbe32433fdd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b12f3b4f87d48548f4d6771a6445c01'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:17.438068 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-8117df2c-79d0-4274-bcc7-6bbe32433fdd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b12f3b4f87d48548f4d6771a6445c01'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:17.520431 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1340/2660] 10.222.0.86 () {58 vars in 1223 bytes} [Tue Jun 7 14:50:17 2022] DELETE /identity/v3/users/6b12f3b4f87d48548f4d6771a6445c01 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:50:17.531540 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d8711f-d93a-4845-9928-65f06cc91df9 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:17.532010 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d8711f-d93a-4845-9928-65f06cc91df9 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:17.532198 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d8711f-d93a-4845-9928-65f06cc91df9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:17.548844 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-90d8711f-d93a-4845-9928-65f06cc91df9 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:50:17.551235 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-90d8711f-d93a-4845-9928-65f06cc91df9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:17.558676 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:50:17.610715 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1321/2661] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:50:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:50:17.621134 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8117df2c-79d0-4274-bcc7-6bbe32433fdd admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:17.628037 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-8117df2c-79d0-4274-bcc7-6bbe32433fdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:17.678210 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:50:17.691236 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8117df2c-79d0-4274-bcc7-6bbe32433fdd admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:17.696377 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f246369-628e-4865-9b27-29a201383829 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dda603ec5517460a83c333db2af804d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:17.697201 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f246369-628e-4865-9b27-29a201383829 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:17.697638 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f246369-628e-4865-9b27-29a201383829 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:17.698310 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f246369-628e-4865-9b27-29a201383829 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:17.710031 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f246369-628e-4865-9b27-29a201383829 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:17.711453 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f246369-628e-4865-9b27-29a201383829 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:17.721580 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1341/2662] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:50:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:50:18.201471 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d8711f-d93a-4845-9928-65f06cc91df9 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:18.202518 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-90d8711f-d93a-4845-9928-65f06cc91df9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:18.218403 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d8711f-d93a-4845-9928-65f06cc91df9 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:18.229566 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06cbffb-0293-42c9-a332-c28c70523722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:18.233875 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06cbffb-0293-42c9-a332-c28c70523722 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:18.234165 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06cbffb-0293-42c9-a332-c28c70523722 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:18.234448 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06cbffb-0293-42c9-a332-c28c70523722 admin admin] PATH_INFO: `/v3/projects/77a6af6e39b54567bbc0a6f3ca3ba743` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:18.236560 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06cbffb-0293-42c9-a332-c28c70523722 admin admin] RBAC: Authorizing `identity:delete_project(project_id=77a6af6e39b54567bbc0a6f3ca3ba743)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:18.239715 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06cbffb-0293-42c9-a332-c28c70523722 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:18.379236 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-d06cbffb-0293-42c9-a332-c28c70523722 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77a6af6e39b54567bbc0a6f3ca3ba743', 'request_id': 'req-d06cbffb-0293-42c9-a332-c28c70523722'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:18.386013 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-d06cbffb-0293-42c9-a332-c28c70523722 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77a6af6e39b54567bbc0a6f3ca3ba743', 'request_id': 'req-d06cbffb-0293-42c9-a332-c28c70523722'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:18.451768 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-d06cbffb-0293-42c9-a332-c28c70523722 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77a6af6e39b54567bbc0a6f3ca3ba743', 'request_id': 'req-d06cbffb-0293-42c9-a332-c28c70523722'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:18.463368 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-d06cbffb-0293-42c9-a332-c28c70523722 admin admin] The token cache is being invalidate because project 77a6af6e39b54567bbc0a6f3ca3ba743 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:50:18.463725 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-d06cbffb-0293-42c9-a332-c28c70523722 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:18.464380 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-d06cbffb-0293-42c9-a332-c28c70523722 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:18.465941 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1322/2663] 10.222.0.86 () {58 vars in 1232 bytes} [Tue Jun 7 14:50:18 2022] DELETE /identity/v3/projects/77a6af6e39b54567bbc0a6f3ca3ba743 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:50:18.469999 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f246369-628e-4865-9b27-29a201383829 service neutron] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:18.480680 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f246369-628e-4865-9b27-29a201383829 service neutron] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:18.538140 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e86c538-4b5b-47cd-a7ad-87f8cc450b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:18.539012 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e86c538-4b5b-47cd-a7ad-87f8cc450b09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:18.539294 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e86c538-4b5b-47cd-a7ad-87f8cc450b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:18.539569 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e86c538-4b5b-47cd-a7ad-87f8cc450b09 admin admin] PATH_INFO: `/v3/users/0fa253bba2ce4670af106ae1f4dd47f1` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:18.540783 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e86c538-4b5b-47cd-a7ad-87f8cc450b09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fa253bba2ce4670af106ae1f4dd47f1)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:18.542675 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e86c538-4b5b-47cd-a7ad-87f8cc450b09 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:18.829982 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-2e86c538-4b5b-47cd-a7ad-87f8cc450b09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fa253bba2ce4670af106ae1f4dd47f1'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:18.830643 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-2e86c538-4b5b-47cd-a7ad-87f8cc450b09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fa253bba2ce4670af106ae1f4dd47f1'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:18.838114 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-2e86c538-4b5b-47cd-a7ad-87f8cc450b09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fa253bba2ce4670af106ae1f4dd47f1'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:18.849650 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-2e86c538-4b5b-47cd-a7ad-87f8cc450b09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fa253bba2ce4670af106ae1f4dd47f1'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:18.850279 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-2e86c538-4b5b-47cd-a7ad-87f8cc450b09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fa253bba2ce4670af106ae1f4dd47f1'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:18.954289 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1342/2664] 10.222.0.86 () {58 vars in 1223 bytes} [Tue Jun 7 14:50:18 2022] DELETE /identity/v3/users/0fa253bba2ce4670af106ae1f4dd47f1 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:50:19.467629 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06cbffb-0293-42c9-a332-c28c70523722 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:19.469264 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-d06cbffb-0293-42c9-a332-c28c70523722 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:19.482602 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06cbffb-0293-42c9-a332-c28c70523722 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:19.548165 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ba05d7-a678-4ee9-b1ba-889e5283664c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:19.549063 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ba05d7-a678-4ee9-b1ba-889e5283664c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:19.549349 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ba05d7-a678-4ee9-b1ba-889e5283664c admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:19.549621 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ba05d7-a678-4ee9-b1ba-889e5283664c admin admin] PATH_INFO: `/v3/projects/9b60a58a428344ae80d1ab03dccde6ed` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:19.550818 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ba05d7-a678-4ee9-b1ba-889e5283664c admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b60a58a428344ae80d1ab03dccde6ed)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:19.552849 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ba05d7-a678-4ee9-b1ba-889e5283664c admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:19.686392 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:50:19.695675 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-64ba05d7-a678-4ee9-b1ba-889e5283664c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b60a58a428344ae80d1ab03dccde6ed', 'request_id': 'req-64ba05d7-a678-4ee9-b1ba-889e5283664c'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:19.701946 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-64ba05d7-a678-4ee9-b1ba-889e5283664c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b60a58a428344ae80d1ab03dccde6ed', 'request_id': 'req-64ba05d7-a678-4ee9-b1ba-889e5283664c'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:19.754659 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-64ba05d7-a678-4ee9-b1ba-889e5283664c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b60a58a428344ae80d1ab03dccde6ed', 'request_id': 'req-64ba05d7-a678-4ee9-b1ba-889e5283664c'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:19.765711 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-64ba05d7-a678-4ee9-b1ba-889e5283664c admin admin] The token cache is being invalidate because project 9b60a58a428344ae80d1ab03dccde6ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:50:19.766866 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-64ba05d7-a678-4ee9-b1ba-889e5283664c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:19.766866 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-64ba05d7-a678-4ee9-b1ba-889e5283664c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:19.768711 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1323/2665] 10.222.0.86 () {58 vars in 1232 bytes} [Tue Jun 7 14:50:19 2022] DELETE /identity/v3/projects/9b60a58a428344ae80d1ab03dccde6ed => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:50:19.774219 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28ee84e-b6f0-453b-9a33-eb4c49f8904d None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:19.774696 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28ee84e-b6f0-453b-9a33-eb4c49f8904d None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:19.774795 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28ee84e-b6f0-453b-9a33-eb4c49f8904d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:19.793655 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-e28ee84e-b6f0-453b-9a33-eb4c49f8904d None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:50:19.794860 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-e28ee84e-b6f0-453b-9a33-eb4c49f8904d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:19.853896 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1343/2666] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:50:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:50:19.862611 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563bdebb-4820-4fb6-b61d-b2a1f53b561c None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:19.862905 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563bdebb-4820-4fb6-b61d-b2a1f53b561c None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:19.863189 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563bdebb-4820-4fb6-b61d-b2a1f53b561c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:19.883397 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-563bdebb-4820-4fb6-b61d-b2a1f53b561c None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:50:19.884646 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-563bdebb-4820-4fb6-b61d-b2a1f53b561c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:19.892542 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1324/2667] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:50:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:50:19.897409 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28ee84e-b6f0-453b-9a33-eb4c49f8904d None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:19.903505 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:50:19.907200 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28ee84e-b6f0-453b-9a33-eb4c49f8904d None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:19.912407 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2641320d-9f4c-40fa-99e8-b8241c14ebc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:19.914212 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2641320d-9f4c-40fa-99e8-b8241c14ebc8 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:19.914212 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2641320d-9f4c-40fa-99e8-b8241c14ebc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:19.914212 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2641320d-9f4c-40fa-99e8-b8241c14ebc8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:19.914532 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2641320d-9f4c-40fa-99e8-b8241c14ebc8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:50:19.914793 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2641320d-9f4c-40fa-99e8-b8241c14ebc8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:19.916422 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2641320d-9f4c-40fa-99e8-b8241c14ebc8 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:19.928518 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1344/2668] 10.222.0.86 () {58 vars in 1152 bytes} [Tue Jun 7 14:50:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:50:19.940809 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563bdebb-4820-4fb6-b61d-b2a1f53b561c None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:19.950217 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563bdebb-4820-4fb6-b61d-b2a1f53b561c None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:19.955163 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04702cfb-0c08-4b7d-9a70-3aca8da82949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:19.955873 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04702cfb-0c08-4b7d-9a70-3aca8da82949 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:19.956247 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04702cfb-0c08-4b7d-9a70-3aca8da82949 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:19.956528 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04702cfb-0c08-4b7d-9a70-3aca8da82949 admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:19.957228 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04702cfb-0c08-4b7d-9a70-3aca8da82949 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:19.959613 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04702cfb-0c08-4b7d-9a70-3aca8da82949 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:20.056747 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1325/2669] 10.222.0.86 () {60 vars in 1152 bytes} [Tue Jun 7 14:50:19 2022] POST /identity/v3/projects => generated 383 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:50:20.058061 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2641320d-9f4c-40fa-99e8-b8241c14ebc8 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:20.069132 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2641320d-9f4c-40fa-99e8-b8241c14ebc8 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:20.125107 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c982374a-8a36-4df2-a6a3-4b6021a7ad2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:20.125719 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c982374a-8a36-4df2-a6a3-4b6021a7ad2c admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:20.126008 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c982374a-8a36-4df2-a6a3-4b6021a7ad2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:20.126293 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c982374a-8a36-4df2-a6a3-4b6021a7ad2c admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:20.126979 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c982374a-8a36-4df2-a6a3-4b6021a7ad2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:20.128925 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c982374a-8a36-4df2-a6a3-4b6021a7ad2c admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:20.251948 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1345/2670] 10.222.0.86 () {60 vars in 1143 bytes} [Tue Jun 7 14:50:20 2022] POST /identity/v3/users => generated 292 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:50:20.256703 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04702cfb-0c08-4b7d-9a70-3aca8da82949 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:20.267193 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04702cfb-0c08-4b7d-9a70-3aca8da82949 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:20.272445 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6540272-7e3d-4320-9527-e093fb11b02f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:20.273125 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6540272-7e3d-4320-9527-e093fb11b02f admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:20.273606 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6540272-7e3d-4320-9527-e093fb11b02f admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:20.274047 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6540272-7e3d-4320-9527-e093fb11b02f admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:20.275134 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6540272-7e3d-4320-9527-e093fb11b02f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:20.276802 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6540272-7e3d-4320-9527-e093fb11b02f admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:20.287305 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1326/2671] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:50:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:50:20.291088 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c982374a-8a36-4df2-a6a3-4b6021a7ad2c admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:20.301119 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c982374a-8a36-4df2-a6a3-4b6021a7ad2c admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:20.306012 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441e65fa-a86e-416a-bcc3-f35caa0e0b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:20.306672 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441e65fa-a86e-416a-bcc3-f35caa0e0b37 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:20.306955 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441e65fa-a86e-416a-bcc3-f35caa0e0b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:20.307236 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441e65fa-a86e-416a-bcc3-f35caa0e0b37 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:20.308048 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441e65fa-a86e-416a-bcc3-f35caa0e0b37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:20.309623 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441e65fa-a86e-416a-bcc3-f35caa0e0b37 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:20.320258 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1346/2672] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:50:20 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:50:20.324079 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6540272-7e3d-4320-9527-e093fb11b02f admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:20.334740 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6540272-7e3d-4320-9527-e093fb11b02f admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:20.339419 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07157fea-8343-497b-bc7d-70bce9f92543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:20.340401 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07157fea-8343-497b-bc7d-70bce9f92543 admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:20.340682 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07157fea-8343-497b-bc7d-70bce9f92543 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:20.340955 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07157fea-8343-497b-bc7d-70bce9f92543 admin admin] PATH_INFO: `/v3/projects/885c62283f0349e099e8121d22399335/users/289dff8a4efb4c73a78a069cec846756/roles/c17acc2a8bb348f59ba7edd22fcf0c47` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:20.355111 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07157fea-8343-497b-bc7d-70bce9f92543 admin admin] RBAC: Authorizing `identity:create_grant(project_id=885c62283f0349e099e8121d22399335, user_id=289dff8a4efb4c73a78a069cec846756, role_id=c17acc2a8bb348f59ba7edd22fcf0c47)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:20.357762 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07157fea-8343-497b-bc7d-70bce9f92543 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:20.417022 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1327/2673] 10.222.0.86 () {60 vars in 1482 bytes} [Tue Jun 7 14:50:20 2022] PUT /identity/v3/projects/885c62283f0349e099e8121d22399335/users/289dff8a4efb4c73a78a069cec846756/roles/c17acc2a8bb348f59ba7edd22fcf0c47 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:50:20.433256 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30fe0ea-7c1c-4c9d-8229-8de0771b5eb3 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:20.433547 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30fe0ea-7c1c-4c9d-8229-8de0771b5eb3 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:20.433829 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30fe0ea-7c1c-4c9d-8229-8de0771b5eb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:20.591616 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-f30fe0ea-7c1c-4c9d-8229-8de0771b5eb3 None None] MFA Rules not processed for user `289dff8a4efb4c73a78a069cec846756`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:50:20.592859 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-f30fe0ea-7c1c-4c9d-8229-8de0771b5eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:20.656104 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1347/2674] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:50:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:50:20.660577 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07157fea-8343-497b-bc7d-70bce9f92543 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:20.723392 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07157fea-8343-497b-bc7d-70bce9f92543 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:20.728295 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11379f5b-a352-48f9-9073-f78fe3230bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:20.728948 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11379f5b-a352-48f9-9073-f78fe3230bf0 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:20.729234 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11379f5b-a352-48f9-9073-f78fe3230bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:20.729515 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11379f5b-a352-48f9-9073-f78fe3230bf0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:20.730241 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11379f5b-a352-48f9-9073-f78fe3230bf0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:20.732158 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11379f5b-a352-48f9-9073-f78fe3230bf0 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:20.826057 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1328/2675] 10.222.0.86 () {60 vars in 1152 bytes} [Tue Jun 7 14:50:20 2022] POST /identity/v3/projects => generated 381 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:50:20.832256 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30fe0ea-7c1c-4c9d-8229-8de0771b5eb3 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:20.842914 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30fe0ea-7c1c-4c9d-8229-8de0771b5eb3 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:20.900252 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f8f07b-57cc-4509-b4bd-8ad22f5473c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:20.900926 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f8f07b-57cc-4509-b4bd-8ad22f5473c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:20.901214 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f8f07b-57cc-4509-b4bd-8ad22f5473c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:20.901512 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f8f07b-57cc-4509-b4bd-8ad22f5473c8 admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:20.902195 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f8f07b-57cc-4509-b4bd-8ad22f5473c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:20.904112 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f8f07b-57cc-4509-b4bd-8ad22f5473c8 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:20.911228 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:50:20.996160 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1348/2676] 10.222.0.86 () {60 vars in 1143 bytes} [Tue Jun 7 14:50:20 2022] POST /identity/v3/users => generated 297 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:50:21.000343 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11379f5b-a352-48f9-9073-f78fe3230bf0 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:21.011383 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11379f5b-a352-48f9-9073-f78fe3230bf0 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:21.016631 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871864fc-8cae-4ed9-afcf-a5b98b969ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:21.017373 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871864fc-8cae-4ed9-afcf-a5b98b969ec5 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:21.017730 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871864fc-8cae-4ed9-afcf-a5b98b969ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:21.018165 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871864fc-8cae-4ed9-afcf-a5b98b969ec5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:21.018970 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871864fc-8cae-4ed9-afcf-a5b98b969ec5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:21.020583 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871864fc-8cae-4ed9-afcf-a5b98b969ec5 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:21.039829 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1329/2677] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:50:20 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:50:21.042312 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f8f07b-57cc-4509-b4bd-8ad22f5473c8 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:21.052946 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f8f07b-57cc-4509-b4bd-8ad22f5473c8 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:21.057968 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc36a75-30d4-48b3-ba45-742a85740fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:21.058858 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc36a75-30d4-48b3-ba45-742a85740fd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:21.059146 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc36a75-30d4-48b3-ba45-742a85740fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:21.059421 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc36a75-30d4-48b3-ba45-742a85740fd1 admin admin] PATH_INFO: `/v3/projects/5b395961c464453785c864543e037af8/users/a248a6ea58f348ee85b80ed408fa05dc/roles/e3bf6239f5bf477b965704b086786f11` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:21.075876 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc36a75-30d4-48b3-ba45-742a85740fd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b395961c464453785c864543e037af8, user_id=a248a6ea58f348ee85b80ed408fa05dc, role_id=e3bf6239f5bf477b965704b086786f11)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:21.078495 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc36a75-30d4-48b3-ba45-742a85740fd1 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:21.126420 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1349/2678] 10.222.0.86 () {60 vars in 1482 bytes} [Tue Jun 7 14:50:21 2022] PUT /identity/v3/projects/5b395961c464453785c864543e037af8/users/a248a6ea58f348ee85b80ed408fa05dc/roles/e3bf6239f5bf477b965704b086786f11 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:50:21.130383 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871864fc-8cae-4ed9-afcf-a5b98b969ec5 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:21.140855 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871864fc-8cae-4ed9-afcf-a5b98b969ec5 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:21.177310 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:50:21.203655 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff4d2a3-a767-41ab-bab1-299b6f30ad9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:21.204573 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff4d2a3-a767-41ab-bab1-299b6f30ad9e admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:21.204934 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff4d2a3-a767-41ab-bab1-299b6f30ad9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:21.205288 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff4d2a3-a767-41ab-bab1-299b6f30ad9e admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:21.206099 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff4d2a3-a767-41ab-bab1-299b6f30ad9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:21.208390 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff4d2a3-a767-41ab-bab1-299b6f30ad9e admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:21.220733 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1330/2679] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:50:21 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:50:21.227860 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc36a75-30d4-48b3-ba45-742a85740fd1 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:21.238725 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc36a75-30d4-48b3-ba45-742a85740fd1 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:21.243393 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7f5eda-3e4d-4ad3-a2c5-99b75b378997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:21.244381 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f5eda-3e4d-4ad3-a2c5-99b75b378997 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:21.244756 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f5eda-3e4d-4ad3-a2c5-99b75b378997 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:21.245078 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f5eda-3e4d-4ad3-a2c5-99b75b378997 admin admin] PATH_INFO: `/v3/projects/5b395961c464453785c864543e037af8/users/a248a6ea58f348ee85b80ed408fa05dc/roles/e3bf6239f5bf477b965704b086786f11` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:21.247181 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7f5eda-3e4d-4ad3-a2c5-99b75b378997 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b395961c464453785c864543e037af8, user_id=a248a6ea58f348ee85b80ed408fa05dc, role_id=e3bf6239f5bf477b965704b086786f11)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:21.249869 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7f5eda-3e4d-4ad3-a2c5-99b75b378997 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:21.262807 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1350/2680] 10.222.0.86 () {60 vars in 1482 bytes} [Tue Jun 7 14:50:21 2022] PUT /identity/v3/projects/5b395961c464453785c864543e037af8/users/a248a6ea58f348ee85b80ed408fa05dc/roles/e3bf6239f5bf477b965704b086786f11 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:50:21.273695 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c160dd76-851f-4408-8978-c36d165ef58e None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:21.273995 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c160dd76-851f-4408-8978-c36d165ef58e None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:21.274279 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c160dd76-851f-4408-8978-c36d165ef58e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:21.302404 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-c160dd76-851f-4408-8978-c36d165ef58e None None] MFA Rules not processed for user `a248a6ea58f348ee85b80ed408fa05dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:50:21.303932 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-c160dd76-851f-4408-8978-c36d165ef58e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:21.373554 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1331/2681] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:50:21 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:50:21.384806 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7f5eda-3e4d-4ad3-a2c5-99b75b378997 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:21.386515 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-da7f5eda-3e4d-4ad3-a2c5-99b75b378997 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:21.446515 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7f5eda-3e4d-4ad3-a2c5-99b75b378997 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:21.450295 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08518b68-d1f6-454b-b90e-7df678dc1ab4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af5a95620a4b43538abfe09eed4bf115', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:21.450942 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08518b68-d1f6-454b-b90e-7df678dc1ab4 service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:21.451228 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08518b68-d1f6-454b-b90e-7df678dc1ab4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:21.451510 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08518b68-d1f6-454b-b90e-7df678dc1ab4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:21.463647 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08518b68-d1f6-454b-b90e-7df678dc1ab4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:21.463647 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08518b68-d1f6-454b-b90e-7df678dc1ab4 service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:21.479874 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1351/2682] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:50:21 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:50:21.581808 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c160dd76-851f-4408-8978-c36d165ef58e None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:21.591960 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c160dd76-851f-4408-8978-c36d165ef58e None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:21.595502 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463822b6-753f-4a96-a576-43247f9aac8c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af5a95620a4b43538abfe09eed4bf115', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:21.596168 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463822b6-753f-4a96-a576-43247f9aac8c service cinder] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:21.598514 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463822b6-753f-4a96-a576-43247f9aac8c service cinder] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:21.598514 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463822b6-753f-4a96-a576-43247f9aac8c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:21.656475 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463822b6-753f-4a96-a576-43247f9aac8c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:21.657945 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463822b6-753f-4a96-a576-43247f9aac8c service cinder] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:21.667832 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1332/2683] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:50:21 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:50:21.958650 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08518b68-d1f6-454b-b90e-7df678dc1ab4 service cinder] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:21.960257 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-08518b68-d1f6-454b-b90e-7df678dc1ab4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:22.028856 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08518b68-d1f6-454b-b90e-7df678dc1ab4 service cinder] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:22.033624 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fa4274-b04c-4926-8b34-a19127afcd1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:22.034346 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fa4274-b04c-4926-8b34-a19127afcd1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:22.034636 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fa4274-b04c-4926-8b34-a19127afcd1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:22.034940 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fa4274-b04c-4926-8b34-a19127afcd1d admin admin] PATH_INFO: `/v3/users/3dc0d80109114140806e401234ad57d6` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:22.036762 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fa4274-b04c-4926-8b34-a19127afcd1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3dc0d80109114140806e401234ad57d6)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:22.038691 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fa4274-b04c-4926-8b34-a19127afcd1d admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:22.226267 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-a5fa4274-b04c-4926-8b34-a19127afcd1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3dc0d80109114140806e401234ad57d6'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:22.226957 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-a5fa4274-b04c-4926-8b34-a19127afcd1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3dc0d80109114140806e401234ad57d6'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:22.244102 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-a5fa4274-b04c-4926-8b34-a19127afcd1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3dc0d80109114140806e401234ad57d6'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:22.250718 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:INSERT=5,keystone:SELECT=88,keystone:DELETE=7 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:50:22.256407 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-a5fa4274-b04c-4926-8b34-a19127afcd1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3dc0d80109114140806e401234ad57d6'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:22.257114 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-a5fa4274-b04c-4926-8b34-a19127afcd1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3dc0d80109114140806e401234ad57d6'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:22.356948 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1352/2684] 10.222.0.86 () {58 vars in 1223 bytes} [Tue Jun 7 14:50:21 2022] DELETE /identity/v3/users/3dc0d80109114140806e401234ad57d6 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:50:22.361560 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8048247f-8f76-4721-80f0-050fed4869b0 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:22.361855 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8048247f-8f76-4721-80f0-050fed4869b0 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:22.362132 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8048247f-8f76-4721-80f0-050fed4869b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:22.380814 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-8048247f-8f76-4721-80f0-050fed4869b0 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:50:22.382092 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-8048247f-8f76-4721-80f0-050fed4869b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:22.444907 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:50:22.454151 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1333/2685] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:50:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 14:50:22.464161 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fa4274-b04c-4926-8b34-a19127afcd1d admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:22.465673 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-a5fa4274-b04c-4926-8b34-a19127afcd1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:22.527986 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fa4274-b04c-4926-8b34-a19127afcd1d admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:22.531796 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ef55fd-b2b6-4c37-be7a-35b0e85614ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dda603ec5517460a83c333db2af804d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:22.532448 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ef55fd-b2b6-4c37-be7a-35b0e85614ef service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:22.532736 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ef55fd-b2b6-4c37-be7a-35b0e85614ef service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:22.533005 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ef55fd-b2b6-4c37-be7a-35b0e85614ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:22.542745 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ef55fd-b2b6-4c37-be7a-35b0e85614ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:22.544196 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ef55fd-b2b6-4c37-be7a-35b0e85614ef service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:22.554355 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1353/2686] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:50:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:50:23.020353 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8048247f-8f76-4721-80f0-050fed4869b0 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:23.021949 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-8048247f-8f76-4721-80f0-050fed4869b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:23.046879 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8048247f-8f76-4721-80f0-050fed4869b0 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:23.052878 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d755b2-cc43-435b-8947-f276992e3aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:23.053986 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d755b2-cc43-435b-8947-f276992e3aa2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:23.054360 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d755b2-cc43-435b-8947-f276992e3aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:23.054736 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d755b2-cc43-435b-8947-f276992e3aa2 admin admin] PATH_INFO: `/v3/projects/e93b7c74eec1414c9b4f891ad9223581` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:23.056092 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d755b2-cc43-435b-8947-f276992e3aa2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e93b7c74eec1414c9b4f891ad9223581)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:23.058088 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d755b2-cc43-435b-8947-f276992e3aa2 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:23.271867 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-e7d755b2-cc43-435b-8947-f276992e3aa2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e93b7c74eec1414c9b4f891ad9223581', 'request_id': 'req-e7d755b2-cc43-435b-8947-f276992e3aa2'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:23.278001 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-e7d755b2-cc43-435b-8947-f276992e3aa2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e93b7c74eec1414c9b4f891ad9223581', 'request_id': 'req-e7d755b2-cc43-435b-8947-f276992e3aa2'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:23.365798 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-e7d755b2-cc43-435b-8947-f276992e3aa2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e93b7c74eec1414c9b4f891ad9223581', 'request_id': 'req-e7d755b2-cc43-435b-8947-f276992e3aa2'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:23.378098 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-e7d755b2-cc43-435b-8947-f276992e3aa2 admin admin] The token cache is being invalidate because project e93b7c74eec1414c9b4f891ad9223581 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:50:23.378396 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-e7d755b2-cc43-435b-8947-f276992e3aa2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:23.379116 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-e7d755b2-cc43-435b-8947-f276992e3aa2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:23.382002 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1334/2687] 10.222.0.86 () {58 vars in 1232 bytes} [Tue Jun 7 14:50:23 2022] DELETE /identity/v3/projects/e93b7c74eec1414c9b4f891ad9223581 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:50:23.386855 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da9b516-d4f9-42a6-9982-e792d9729549 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:23.387383 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da9b516-d4f9-42a6-9982-e792d9729549 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:23.387533 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da9b516-d4f9-42a6-9982-e792d9729549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:23.405726 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-0da9b516-d4f9-42a6-9982-e792d9729549 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:50:23.406923 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-0da9b516-d4f9-42a6-9982-e792d9729549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:23.469591 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1354/2688] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:50:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:50:23.477028 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9443aa98-0415-47a1-99af-37fe221bbd14 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:23.477309 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9443aa98-0415-47a1-99af-37fe221bbd14 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:23.477588 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9443aa98-0415-47a1-99af-37fe221bbd14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:23.502019 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-9443aa98-0415-47a1-99af-37fe221bbd14 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:50:23.502019 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-9443aa98-0415-47a1-99af-37fe221bbd14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:23.511470 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1335/2689] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:50:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:50:23.515859 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da9b516-d4f9-42a6-9982-e792d9729549 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:23.530175 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da9b516-d4f9-42a6-9982-e792d9729549 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:23.538559 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6fd393-741c-43af-a2bb-05e72f6297d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:23.538559 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6fd393-741c-43af-a2bb-05e72f6297d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:23.538559 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6fd393-741c-43af-a2bb-05e72f6297d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:23.538559 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6fd393-741c-43af-a2bb-05e72f6297d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:23.538928 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6fd393-741c-43af-a2bb-05e72f6297d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:50:23.539104 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6fd393-741c-43af-a2bb-05e72f6297d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:23.540976 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6fd393-741c-43af-a2bb-05e72f6297d6 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:23.557297 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1355/2690] 10.222.0.86 () {58 vars in 1152 bytes} [Tue Jun 7 14:50:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:50:23.559077 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9443aa98-0415-47a1-99af-37fe221bbd14 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:23.569213 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9443aa98-0415-47a1-99af-37fe221bbd14 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:23.573861 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5456a39c-07df-4349-ae86-be4fb3f21ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:23.574502 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5456a39c-07df-4349-ae86-be4fb3f21ba4 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:23.574785 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5456a39c-07df-4349-ae86-be4fb3f21ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:23.576376 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5456a39c-07df-4349-ae86-be4fb3f21ba4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:23.576376 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5456a39c-07df-4349-ae86-be4fb3f21ba4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:23.578091 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5456a39c-07df-4349-ae86-be4fb3f21ba4 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:23.726089 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1336/2691] 10.222.0.86 () {60 vars in 1152 bytes} [Tue Jun 7 14:50:23 2022] POST /identity/v3/projects => generated 367 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:50:23.730325 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6fd393-741c-43af-a2bb-05e72f6297d6 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:23.740578 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6fd393-741c-43af-a2bb-05e72f6297d6 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:23.795294 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c546e7-3bf5-4ef5-b3ec-5339d8ebdd3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:23.799929 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c546e7-3bf5-4ef5-b3ec-5339d8ebdd3b admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:23.799929 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c546e7-3bf5-4ef5-b3ec-5339d8ebdd3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:23.799929 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c546e7-3bf5-4ef5-b3ec-5339d8ebdd3b admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:23.799929 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c546e7-3bf5-4ef5-b3ec-5339d8ebdd3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:23.799929 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c546e7-3bf5-4ef5-b3ec-5339d8ebdd3b admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:23.808575 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:50:23.886988 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1356/2692] 10.222.0.86 () {60 vars in 1143 bytes} [Tue Jun 7 14:50:23 2022] POST /identity/v3/users => generated 284 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:50:23.893969 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5456a39c-07df-4349-ae86-be4fb3f21ba4 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:23.904485 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5456a39c-07df-4349-ae86-be4fb3f21ba4 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:23.909263 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7da8eae-baf5-4ac9-b631-b6b3cde87ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:23.909911 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7da8eae-baf5-4ac9-b631-b6b3cde87ed2 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:23.910196 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7da8eae-baf5-4ac9-b631-b6b3cde87ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:23.911044 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7da8eae-baf5-4ac9-b631-b6b3cde87ed2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:23.911794 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7da8eae-baf5-4ac9-b631-b6b3cde87ed2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:23.913430 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7da8eae-baf5-4ac9-b631-b6b3cde87ed2 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:23.924735 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1337/2693] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:50:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:50:23.928845 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c546e7-3bf5-4ef5-b3ec-5339d8ebdd3b admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:23.938650 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c546e7-3bf5-4ef5-b3ec-5339d8ebdd3b admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:23.943798 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1279677f-b867-4fcb-a0df-08c842dfacea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:23.944452 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1279677f-b867-4fcb-a0df-08c842dfacea admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:23.944736 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1279677f-b867-4fcb-a0df-08c842dfacea admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:23.945011 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1279677f-b867-4fcb-a0df-08c842dfacea admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:23.945730 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1279677f-b867-4fcb-a0df-08c842dfacea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:23.947318 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1279677f-b867-4fcb-a0df-08c842dfacea admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:23.958370 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1357/2694] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:50:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:50:23.962581 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7da8eae-baf5-4ac9-b631-b6b3cde87ed2 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:23.972760 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7da8eae-baf5-4ac9-b631-b6b3cde87ed2 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:23.977552 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e453dbc0-f928-4125-8ac4-80620b60ecee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:23.978432 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e453dbc0-f928-4125-8ac4-80620b60ecee admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:23.978716 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e453dbc0-f928-4125-8ac4-80620b60ecee admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:23.979176 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e453dbc0-f928-4125-8ac4-80620b60ecee admin admin] PATH_INFO: `/v3/projects/0b2c950c32da4576aa487a42579918e5/users/6f0dc76295794c0bbae67a43ecc3f961/roles/c17acc2a8bb348f59ba7edd22fcf0c47` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:23.993873 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e453dbc0-f928-4125-8ac4-80620b60ecee admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b2c950c32da4576aa487a42579918e5, user_id=6f0dc76295794c0bbae67a43ecc3f961, role_id=c17acc2a8bb348f59ba7edd22fcf0c47)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:23.996594 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e453dbc0-f928-4125-8ac4-80620b60ecee admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:24.103518 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1338/2695] 10.222.0.86 () {60 vars in 1482 bytes} [Tue Jun 7 14:50:23 2022] PUT /identity/v3/projects/0b2c950c32da4576aa487a42579918e5/users/6f0dc76295794c0bbae67a43ecc3f961/roles/c17acc2a8bb348f59ba7edd22fcf0c47 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:50:24.114198 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5432d832-297e-4aea-822d-eb4389cc3de0 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:24.114485 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5432d832-297e-4aea-822d-eb4389cc3de0 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:24.114763 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5432d832-297e-4aea-822d-eb4389cc3de0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:24.141569 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-5432d832-297e-4aea-822d-eb4389cc3de0 None None] MFA Rules not processed for user `6f0dc76295794c0bbae67a43ecc3f961`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:50:24.142804 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-5432d832-297e-4aea-822d-eb4389cc3de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:24.209191 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1358/2696] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:50:24 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:50:24.213760 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e453dbc0-f928-4125-8ac4-80620b60ecee admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:24.278420 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e453dbc0-f928-4125-8ac4-80620b60ecee admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:24.283001 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8574d9-6056-478a-aab6-9c4e049b70b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:24.283649 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8574d9-6056-478a-aab6-9c4e049b70b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:24.283980 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8574d9-6056-478a-aab6-9c4e049b70b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:24.284238 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8574d9-6056-478a-aab6-9c4e049b70b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:24.284941 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8574d9-6056-478a-aab6-9c4e049b70b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:24.290091 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8574d9-6056-478a-aab6-9c4e049b70b4 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:24.372660 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1339/2697] 10.222.0.86 () {60 vars in 1152 bytes} [Tue Jun 7 14:50:24 2022] POST /identity/v3/projects => generated 369 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 14:50:24.376651 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5432d832-297e-4aea-822d-eb4389cc3de0 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:24.387919 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5432d832-297e-4aea-822d-eb4389cc3de0 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:24.444297 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1999f607-396c-45fd-ad2e-65212184547e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:24.444960 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1999f607-396c-45fd-ad2e-65212184547e admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:24.445244 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1999f607-396c-45fd-ad2e-65212184547e admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:24.445519 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1999f607-396c-45fd-ad2e-65212184547e admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:24.446206 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1999f607-396c-45fd-ad2e-65212184547e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:24.448116 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1999f607-396c-45fd-ad2e-65212184547e admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:24.548790 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1359/2698] 10.222.0.86 () {60 vars in 1143 bytes} [Tue Jun 7 14:50:24 2022] POST /identity/v3/users => generated 291 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:50:24.553436 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8574d9-6056-478a-aab6-9c4e049b70b4 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:24.558911 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:50:24.564562 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8574d9-6056-478a-aab6-9c4e049b70b4 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:24.569923 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59df232-104f-424c-b084-1b4fe1ce3623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:24.570652 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59df232-104f-424c-b084-1b4fe1ce3623 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:24.570936 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59df232-104f-424c-b084-1b4fe1ce3623 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:24.571214 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59df232-104f-424c-b084-1b4fe1ce3623 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:24.571983 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59df232-104f-424c-b084-1b4fe1ce3623 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:24.573649 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59df232-104f-424c-b084-1b4fe1ce3623 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:24.587484 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1340/2699] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:50:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:50:24.589098 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1999f607-396c-45fd-ad2e-65212184547e admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:24.599655 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1999f607-396c-45fd-ad2e-65212184547e admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:24.604854 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789654b2-1888-4289-b6cf-ba524a6b7037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:24.605744 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789654b2-1888-4289-b6cf-ba524a6b7037 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:24.606028 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789654b2-1888-4289-b6cf-ba524a6b7037 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:24.606305 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789654b2-1888-4289-b6cf-ba524a6b7037 admin admin] PATH_INFO: `/v3/projects/bcea9fb340fe44ddbea5ecd70d376a2b/users/ea3f449e9b8d44ba81f5164dd6d0a9ef/roles/e3bf6239f5bf477b965704b086786f11` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:24.623049 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789654b2-1888-4289-b6cf-ba524a6b7037 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcea9fb340fe44ddbea5ecd70d376a2b, user_id=ea3f449e9b8d44ba81f5164dd6d0a9ef, role_id=e3bf6239f5bf477b965704b086786f11)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:24.625652 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789654b2-1888-4289-b6cf-ba524a6b7037 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:24.720187 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1360/2700] 10.222.0.86 () {60 vars in 1482 bytes} [Tue Jun 7 14:50:24 2022] PUT /identity/v3/projects/bcea9fb340fe44ddbea5ecd70d376a2b/users/ea3f449e9b8d44ba81f5164dd6d0a9ef/roles/e3bf6239f5bf477b965704b086786f11 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:50:24.724745 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59df232-104f-424c-b084-1b4fe1ce3623 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:24.734581 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59df232-104f-424c-b084-1b4fe1ce3623 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:24.793240 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f90144-3a4f-4dd3-9817-447e4115082a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:24.793918 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f90144-3a4f-4dd3-9817-447e4115082a admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:24.794206 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f90144-3a4f-4dd3-9817-447e4115082a admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:24.794490 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f90144-3a4f-4dd3-9817-447e4115082a admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:24.795225 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f90144-3a4f-4dd3-9817-447e4115082a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:24.796857 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f90144-3a4f-4dd3-9817-447e4115082a admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:24.808531 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1341/2701] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:50:24 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:50:24.812892 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789654b2-1888-4289-b6cf-ba524a6b7037 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:24.825098 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789654b2-1888-4289-b6cf-ba524a6b7037 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:24.829740 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a105f7c4-082d-4535-ba3c-ffe7343027e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:24.830611 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a105f7c4-082d-4535-ba3c-ffe7343027e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:24.830890 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a105f7c4-082d-4535-ba3c-ffe7343027e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:24.831162 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a105f7c4-082d-4535-ba3c-ffe7343027e7 admin admin] PATH_INFO: `/v3/projects/bcea9fb340fe44ddbea5ecd70d376a2b/users/ea3f449e9b8d44ba81f5164dd6d0a9ef/roles/e3bf6239f5bf477b965704b086786f11` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:24.833203 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a105f7c4-082d-4535-ba3c-ffe7343027e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcea9fb340fe44ddbea5ecd70d376a2b, user_id=ea3f449e9b8d44ba81f5164dd6d0a9ef, role_id=e3bf6239f5bf477b965704b086786f11)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:24.835809 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a105f7c4-082d-4535-ba3c-ffe7343027e7 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:24.846452 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1361/2702] 10.222.0.86 () {60 vars in 1482 bytes} [Tue Jun 7 14:50:24 2022] PUT /identity/v3/projects/bcea9fb340fe44ddbea5ecd70d376a2b/users/ea3f449e9b8d44ba81f5164dd6d0a9ef/roles/e3bf6239f5bf477b965704b086786f11 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:50:24.858259 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0af24c2-dd30-4b26-84ed-c3ca7e354d6f None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:24.858560 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0af24c2-dd30-4b26-84ed-c3ca7e354d6f None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:24.858842 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0af24c2-dd30-4b26-84ed-c3ca7e354d6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:24.887091 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-e0af24c2-dd30-4b26-84ed-c3ca7e354d6f None None] MFA Rules not processed for user `ea3f449e9b8d44ba81f5164dd6d0a9ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:50:24.888460 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-e0af24c2-dd30-4b26-84ed-c3ca7e354d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:24.901472 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a105f7c4-082d-4535-ba3c-ffe7343027e7 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:24.904027 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-a105f7c4-082d-4535-ba3c-ffe7343027e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:24.934358 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:50:24.961603 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1342/2703] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:50:24 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:50:24.972284 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0af24c2-dd30-4b26-84ed-c3ca7e354d6f None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:24.974262 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-e0af24c2-dd30-4b26-84ed-c3ca7e354d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:24.975582 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a105f7c4-082d-4535-ba3c-ffe7343027e7 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:24.980409 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b86d2e4-80bb-4a14-9b06-b7874ea53df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:24.981313 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b86d2e4-80bb-4a14-9b06-b7874ea53df7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:24.981600 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b86d2e4-80bb-4a14-9b06-b7874ea53df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:24.981881 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b86d2e4-80bb-4a14-9b06-b7874ea53df7 admin admin] PATH_INFO: `/v3/users/289dff8a4efb4c73a78a069cec846756` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:24.983107 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b86d2e4-80bb-4a14-9b06-b7874ea53df7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=289dff8a4efb4c73a78a069cec846756)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:24.985035 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b86d2e4-80bb-4a14-9b06-b7874ea53df7 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:25.032398 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0af24c2-dd30-4b26-84ed-c3ca7e354d6f None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:25.036630 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1f8cf8-9177-4b4e-8c83-20c7eb893be1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af5a95620a4b43538abfe09eed4bf115', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:25.037272 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1f8cf8-9177-4b4e-8c83-20c7eb893be1 service cinder] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:25.037594 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1f8cf8-9177-4b4e-8c83-20c7eb893be1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:25.037866 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1f8cf8-9177-4b4e-8c83-20c7eb893be1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:25.047198 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1f8cf8-9177-4b4e-8c83-20c7eb893be1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:25.048729 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1f8cf8-9177-4b4e-8c83-20c7eb893be1 service cinder] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:25.058625 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1343/2704] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:50:24 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 14:50:25.191887 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-5b86d2e4-80bb-4a14-9b06-b7874ea53df7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '289dff8a4efb4c73a78a069cec846756'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:25.192546 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-5b86d2e4-80bb-4a14-9b06-b7874ea53df7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '289dff8a4efb4c73a78a069cec846756'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:25.205411 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-5b86d2e4-80bb-4a14-9b06-b7874ea53df7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '289dff8a4efb4c73a78a069cec846756'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:25.217596 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-5b86d2e4-80bb-4a14-9b06-b7874ea53df7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '289dff8a4efb4c73a78a069cec846756'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:25.218299 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-5b86d2e4-80bb-4a14-9b06-b7874ea53df7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '289dff8a4efb4c73a78a069cec846756'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:25.297859 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1362/2705] 10.222.0.86 () {58 vars in 1223 bytes} [Tue Jun 7 14:50:24 2022] DELETE /identity/v3/users/289dff8a4efb4c73a78a069cec846756 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 14:50:25.302905 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5df3b7c-6cd0-42f4-9edd-e2274ffdf865 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:25.303354 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5df3b7c-6cd0-42f4-9edd-e2274ffdf865 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:25.303546 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5df3b7c-6cd0-42f4-9edd-e2274ffdf865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:25.322799 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-d5df3b7c-6cd0-42f4-9edd-e2274ffdf865 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:50:25.323731 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-d5df3b7c-6cd0-42f4-9edd-e2274ffdf865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:25.335376 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:50:25.383511 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1344/2706] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:50:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:50:25.393249 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b86d2e4-80bb-4a14-9b06-b7874ea53df7 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:25.401206 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-5b86d2e4-80bb-4a14-9b06-b7874ea53df7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:25.453260 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b86d2e4-80bb-4a14-9b06-b7874ea53df7 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:25.456884 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c4ad3b-7f7b-4a1e-8094-38b46158fed0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dda603ec5517460a83c333db2af804d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:25.458115 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c4ad3b-7f7b-4a1e-8094-38b46158fed0 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:25.458396 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c4ad3b-7f7b-4a1e-8094-38b46158fed0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:25.458669 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c4ad3b-7f7b-4a1e-8094-38b46158fed0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:25.467564 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c4ad3b-7f7b-4a1e-8094-38b46158fed0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:25.469024 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c4ad3b-7f7b-4a1e-8094-38b46158fed0 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:25.478340 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1363/2707] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:50:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:50:25.877045 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5df3b7c-6cd0-42f4-9edd-e2274ffdf865 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:25.878499 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-d5df3b7c-6cd0-42f4-9edd-e2274ffdf865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:25.891336 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5df3b7c-6cd0-42f4-9edd-e2274ffdf865 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:25.904371 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bc336c-7a66-48e8-af24-f354f8dc81fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:25.904371 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bc336c-7a66-48e8-af24-f354f8dc81fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:25.904371 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bc336c-7a66-48e8-af24-f354f8dc81fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:25.905056 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bc336c-7a66-48e8-af24-f354f8dc81fe admin admin] PATH_INFO: `/v3/projects/885c62283f0349e099e8121d22399335` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:25.906169 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bc336c-7a66-48e8-af24-f354f8dc81fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=885c62283f0349e099e8121d22399335)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:25.908120 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bc336c-7a66-48e8-af24-f354f8dc81fe admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:26.014014 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-f6bc336c-7a66-48e8-af24-f354f8dc81fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '885c62283f0349e099e8121d22399335', 'request_id': 'req-f6bc336c-7a66-48e8-af24-f354f8dc81fe'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:26.020387 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-f6bc336c-7a66-48e8-af24-f354f8dc81fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '885c62283f0349e099e8121d22399335', 'request_id': 'req-f6bc336c-7a66-48e8-af24-f354f8dc81fe'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:26.078748 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-f6bc336c-7a66-48e8-af24-f354f8dc81fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '885c62283f0349e099e8121d22399335', 'request_id': 'req-f6bc336c-7a66-48e8-af24-f354f8dc81fe'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:26.106065 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-f6bc336c-7a66-48e8-af24-f354f8dc81fe admin admin] The token cache is being invalidate because project 885c62283f0349e099e8121d22399335 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:50:26.113312 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-f6bc336c-7a66-48e8-af24-f354f8dc81fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:26.113312 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-f6bc336c-7a66-48e8-af24-f354f8dc81fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:26.113312 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1345/2708] 10.222.0.86 () {58 vars in 1232 bytes} [Tue Jun 7 14:50:25 2022] DELETE /identity/v3/projects/885c62283f0349e099e8121d22399335 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:50:26.115317 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c4ad3b-7f7b-4a1e-8094-38b46158fed0 service neutron] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:26.130795 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c4ad3b-7f7b-4a1e-8094-38b46158fed0 service neutron] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:26.181376 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:50:26.194892 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3059b528-4871-460e-aa4d-3d4f66a33093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:26.195809 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3059b528-4871-460e-aa4d-3d4f66a33093 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:26.196155 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3059b528-4871-460e-aa4d-3d4f66a33093 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:26.196451 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3059b528-4871-460e-aa4d-3d4f66a33093 admin admin] PATH_INFO: `/v3/users/a248a6ea58f348ee85b80ed408fa05dc` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:26.197748 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3059b528-4871-460e-aa4d-3d4f66a33093 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a248a6ea58f348ee85b80ed408fa05dc)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:26.199937 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3059b528-4871-460e-aa4d-3d4f66a33093 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:26.436873 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-3059b528-4871-460e-aa4d-3d4f66a33093 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a248a6ea58f348ee85b80ed408fa05dc'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:26.437527 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-3059b528-4871-460e-aa4d-3d4f66a33093 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a248a6ea58f348ee85b80ed408fa05dc'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:26.445097 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-3059b528-4871-460e-aa4d-3d4f66a33093 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a248a6ea58f348ee85b80ed408fa05dc'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:26.456786 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-3059b528-4871-460e-aa4d-3d4f66a33093 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a248a6ea58f348ee85b80ed408fa05dc'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:26.458157 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-3059b528-4871-460e-aa4d-3d4f66a33093 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a248a6ea58f348ee85b80ed408fa05dc'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:26.537407 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1364/2709] 10.222.0.86 () {58 vars in 1223 bytes} [Tue Jun 7 14:50:26 2022] DELETE /identity/v3/users/a248a6ea58f348ee85b80ed408fa05dc => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:50:27.053285 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bc336c-7a66-48e8-af24-f354f8dc81fe admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:27.054829 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-f6bc336c-7a66-48e8-af24-f354f8dc81fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:27.068385 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bc336c-7a66-48e8-af24-f354f8dc81fe admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:27.130420 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed573e42-3e3d-41ad-9699-77f6bfe61d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:27.131286 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed573e42-3e3d-41ad-9699-77f6bfe61d7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:27.131574 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed573e42-3e3d-41ad-9699-77f6bfe61d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:27.131890 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed573e42-3e3d-41ad-9699-77f6bfe61d7f admin admin] PATH_INFO: `/v3/projects/5b395961c464453785c864543e037af8` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:27.133345 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed573e42-3e3d-41ad-9699-77f6bfe61d7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b395961c464453785c864543e037af8)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:27.135262 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed573e42-3e3d-41ad-9699-77f6bfe61d7f admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:27.173949 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3059b528-4871-460e-aa4d-3d4f66a33093 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:27.175914 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-3059b528-4871-460e-aa4d-3d4f66a33093 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:27.195138 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3059b528-4871-460e-aa4d-3d4f66a33093 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:27.200510 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c6cffb-86ca-418b-989c-503cd0bcef9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:27.201719 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c6cffb-86ca-418b-989c-503cd0bcef9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:27.202163 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c6cffb-86ca-418b-989c-503cd0bcef9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:27.202608 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c6cffb-86ca-418b-989c-503cd0bcef9b admin admin] PATH_INFO: `/v3/users/935918cbf7c648d0892557ead6c43fd0` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:27.203862 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c6cffb-86ca-418b-989c-503cd0bcef9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=935918cbf7c648d0892557ead6c43fd0)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:27.205791 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c6cffb-86ca-418b-989c-503cd0bcef9b admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:27.317471 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:50:27.320917 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-ed573e42-3e3d-41ad-9699-77f6bfe61d7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b395961c464453785c864543e037af8', 'request_id': 'req-ed573e42-3e3d-41ad-9699-77f6bfe61d7f'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:27.327032 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-ed573e42-3e3d-41ad-9699-77f6bfe61d7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b395961c464453785c864543e037af8', 'request_id': 'req-ed573e42-3e3d-41ad-9699-77f6bfe61d7f'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:27.434546 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-ed573e42-3e3d-41ad-9699-77f6bfe61d7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b395961c464453785c864543e037af8', 'request_id': 'req-ed573e42-3e3d-41ad-9699-77f6bfe61d7f'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:27.445627 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-ed573e42-3e3d-41ad-9699-77f6bfe61d7f admin admin] The token cache is being invalidate because project 5b395961c464453785c864543e037af8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:50:27.446123 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-ed573e42-3e3d-41ad-9699-77f6bfe61d7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:27.446965 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-ed573e42-3e3d-41ad-9699-77f6bfe61d7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:27.448781 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1346/2710] 10.222.0.86 () {58 vars in 1232 bytes} [Tue Jun 7 14:50:27 2022] DELETE /identity/v3/projects/5b395961c464453785c864543e037af8 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:50:27.453293 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d9c36d-f9a5-4cb7-bb62-f77ba80556d4 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:27.453586 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d9c36d-f9a5-4cb7-bb62-f77ba80556d4 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:27.453874 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d9c36d-f9a5-4cb7-bb62-f77ba80556d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:27.473579 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-42d9c36d-f9a5-4cb7-bb62-f77ba80556d4 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:50:27.474820 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-42d9c36d-f9a5-4cb7-bb62-f77ba80556d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:27.520766 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-f4c6cffb-86ca-418b-989c-503cd0bcef9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '935918cbf7c648d0892557ead6c43fd0'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:27.522078 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-f4c6cffb-86ca-418b-989c-503cd0bcef9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '935918cbf7c648d0892557ead6c43fd0'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:27.529760 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-f4c6cffb-86ca-418b-989c-503cd0bcef9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '935918cbf7c648d0892557ead6c43fd0'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:27.539148 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1347/2711] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:50:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 14:50:27.546895 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6fef9b-db32-46a7-8c5f-3707bd22e59f None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:27.547185 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6fef9b-db32-46a7-8c5f-3707bd22e59f None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:27.547487 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6fef9b-db32-46a7-8c5f-3707bd22e59f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:27.555534 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-f4c6cffb-86ca-418b-989c-503cd0bcef9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '935918cbf7c648d0892557ead6c43fd0'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:27.556323 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-f4c6cffb-86ca-418b-989c-503cd0bcef9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '935918cbf7c648d0892557ead6c43fd0'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:27.570269 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-0e6fef9b-db32-46a7-8c5f-3707bd22e59f None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:50:27.571547 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-0e6fef9b-db32-46a7-8c5f-3707bd22e59f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:27.579860 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1348/2712] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:50:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 14:50:27.587582 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6fef9b-db32-46a7-8c5f-3707bd22e59f None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:27.597302 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6fef9b-db32-46a7-8c5f-3707bd22e59f None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:27.602339 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe0473a-de71-4bbc-9e73-6a466e556315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:27.602995 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe0473a-de71-4bbc-9e73-6a466e556315 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:27.603287 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe0473a-de71-4bbc-9e73-6a466e556315 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:27.603564 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe0473a-de71-4bbc-9e73-6a466e556315 admin admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:27.604359 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe0473a-de71-4bbc-9e73-6a466e556315 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:50:27.604967 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe0473a-de71-4bbc-9e73-6a466e556315 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:27.606730 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe0473a-de71-4bbc-9e73-6a466e556315 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:27.622121 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1349/2713] 10.222.0.86 () {58 vars in 1152 bytes} [Tue Jun 7 14:50:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:50:27.623038 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe0473a-de71-4bbc-9e73-6a466e556315 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:27.633745 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe0473a-de71-4bbc-9e73-6a466e556315 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:27.638945 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34b7aa5-d03f-455e-ac14-bd468543f9f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:27.639618 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34b7aa5-d03f-455e-ac14-bd468543f9f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:27.639939 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34b7aa5-d03f-455e-ac14-bd468543f9f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:27.640213 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34b7aa5-d03f-455e-ac14-bd468543f9f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:27.640903 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34b7aa5-d03f-455e-ac14-bd468543f9f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:27.642758 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34b7aa5-d03f-455e-ac14-bd468543f9f3 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:27.686411 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1365/2714] 10.222.0.86 () {58 vars in 1223 bytes} [Tue Jun 7 14:50:27 2022] DELETE /identity/v3/users/935918cbf7c648d0892557ead6c43fd0 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 14:50:27.690938 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02bcc8e-a0c1-4bbd-9144-0b0f376395f6 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:27.691291 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02bcc8e-a0c1-4bbd-9144-0b0f376395f6 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:27.692119 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02bcc8e-a0c1-4bbd-9144-0b0f376395f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:27.711504 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-b02bcc8e-a0c1-4bbd-9144-0b0f376395f6 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:50:27.712753 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-b02bcc8e-a0c1-4bbd-9144-0b0f376395f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:27.745842 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:50:27.767253 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1350/2715] 10.222.0.86 () {60 vars in 1152 bytes} [Tue Jun 7 14:50:27 2022] POST /identity/v3/projects => generated 381 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 14:50:27.772210 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34b7aa5-d03f-455e-ac14-bd468543f9f3 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:27.773265 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1366/2716] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:50:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:50:27.782671 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02bcc8e-a0c1-4bbd-9144-0b0f376395f6 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:27.784147 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-b02bcc8e-a0c1-4bbd-9144-0b0f376395f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:27.834403 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34b7aa5-d03f-455e-ac14-bd468543f9f3 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:27.840878 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02bcc8e-a0c1-4bbd-9144-0b0f376395f6 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:27.841680 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df52e52-3b69-47f1-bb84-73c7986eca59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:27.842355 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df52e52-3b69-47f1-bb84-73c7986eca59 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:27.842663 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df52e52-3b69-47f1-bb84-73c7986eca59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:27.842940 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df52e52-3b69-47f1-bb84-73c7986eca59 admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:27.843645 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df52e52-3b69-47f1-bb84-73c7986eca59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:27.845631 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df52e52-3b69-47f1-bb84-73c7986eca59 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:27.893487 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167f7dba-5d05-47f0-b926-79aa43190a30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dda603ec5517460a83c333db2af804d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:27.894374 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167f7dba-5d05-47f0-b926-79aa43190a30 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:27.895333 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167f7dba-5d05-47f0-b926-79aa43190a30 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:27.895629 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167f7dba-5d05-47f0-b926-79aa43190a30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:27.904776 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167f7dba-5d05-47f0-b926-79aa43190a30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:27.906195 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167f7dba-5d05-47f0-b926-79aa43190a30 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:27.916638 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1367/2717] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:50:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 14:50:27.977860 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1351/2718] 10.222.0.86 () {60 vars in 1143 bytes} [Tue Jun 7 14:50:27 2022] POST /identity/v3/users => generated 291 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 14:50:27.982097 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167f7dba-5d05-47f0-b926-79aa43190a30 service neutron] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:27.992639 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167f7dba-5d05-47f0-b926-79aa43190a30 service neutron] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:27.997602 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5d94c6-652e-46e3-9441-05544b3acbdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:27.998165 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5d94c6-652e-46e3-9441-05544b3acbdc admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:27.998479 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5d94c6-652e-46e3-9441-05544b3acbdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:27.998755 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5d94c6-652e-46e3-9441-05544b3acbdc admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:27.999482 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5d94c6-652e-46e3-9441-05544b3acbdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:28.001096 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5d94c6-652e-46e3-9441-05544b3acbdc admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:28.012994 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1368/2719] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:50:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:50:28.016704 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df52e52-3b69-47f1-bb84-73c7986eca59 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:28.027560 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df52e52-3b69-47f1-bb84-73c7986eca59 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:28.032368 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f72d9ad-abb7-4fcc-94d4-880d52df6691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:28.033037 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f72d9ad-abb7-4fcc-94d4-880d52df6691 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:28.033325 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f72d9ad-abb7-4fcc-94d4-880d52df6691 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:28.033611 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f72d9ad-abb7-4fcc-94d4-880d52df6691 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:28.034378 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f72d9ad-abb7-4fcc-94d4-880d52df6691 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:28.036036 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f72d9ad-abb7-4fcc-94d4-880d52df6691 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:28.049448 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1352/2720] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:50:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:50:28.050652 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5d94c6-652e-46e3-9441-05544b3acbdc admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:28.060877 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5d94c6-652e-46e3-9441-05544b3acbdc admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:28.065427 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0389ccd-ed3b-4dfb-a7fa-a67f5bfcd88e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:28.069178 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0389ccd-ed3b-4dfb-a7fa-a67f5bfcd88e admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:28.069178 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0389ccd-ed3b-4dfb-a7fa-a67f5bfcd88e admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:28.069178 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0389ccd-ed3b-4dfb-a7fa-a67f5bfcd88e admin admin] PATH_INFO: `/v3/projects/0bf320f5dcf5446596b7a3afc98abe17/users/a2b796f744fc41e3aa3641961c210d3b/roles/c17acc2a8bb348f59ba7edd22fcf0c47` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:28.081985 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0389ccd-ed3b-4dfb-a7fa-a67f5bfcd88e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bf320f5dcf5446596b7a3afc98abe17, user_id=a2b796f744fc41e3aa3641961c210d3b, role_id=c17acc2a8bb348f59ba7edd22fcf0c47)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:28.084850 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0389ccd-ed3b-4dfb-a7fa-a67f5bfcd88e admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:28.179668 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1369/2721] 10.222.0.86 () {60 vars in 1482 bytes} [Tue Jun 7 14:50:28 2022] PUT /identity/v3/projects/0bf320f5dcf5446596b7a3afc98abe17/users/a2b796f744fc41e3aa3641961c210d3b/roles/c17acc2a8bb348f59ba7edd22fcf0c47 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:50:28.190241 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f89726e-700d-4fee-a6a6-3bfd1aaa5ede None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:28.191046 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f89726e-700d-4fee-a6a6-3bfd1aaa5ede None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:28.191046 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f89726e-700d-4fee-a6a6-3bfd1aaa5ede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:28.214340 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:50:28.245628 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-9f89726e-700d-4fee-a6a6-3bfd1aaa5ede None None] MFA Rules not processed for user `a2b796f744fc41e3aa3641961c210d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:50:28.247207 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-9f89726e-700d-4fee-a6a6-3bfd1aaa5ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:28.317407 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1353/2722] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:50:28 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 14:50:28.321844 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0389ccd-ed3b-4dfb-a7fa-a67f5bfcd88e admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:28.387700 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0389ccd-ed3b-4dfb-a7fa-a67f5bfcd88e admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:28.388549 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f89726e-700d-4fee-a6a6-3bfd1aaa5ede None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:28.390245 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-9f89726e-700d-4fee-a6a6-3bfd1aaa5ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:28.392517 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e16c72-ceac-46f5-8852-ad0ef668bc25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:28.393192 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e16c72-ceac-46f5-8852-ad0ef668bc25 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:28.393480 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e16c72-ceac-46f5-8852-ad0ef668bc25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:28.393759 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e16c72-ceac-46f5-8852-ad0ef668bc25 admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:28.394507 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e16c72-ceac-46f5-8852-ad0ef668bc25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:28.396614 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e16c72-ceac-46f5-8852-ad0ef668bc25 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:28.405022 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f89726e-700d-4fee-a6a6-3bfd1aaa5ede None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:28.410006 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f6dc9b-06f5-4e2f-9af0-902b800c3c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:28.411645 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f6dc9b-06f5-4e2f-9af0-902b800c3c35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:28.411998 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f6dc9b-06f5-4e2f-9af0-902b800c3c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:28.412467 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f6dc9b-06f5-4e2f-9af0-902b800c3c35 admin admin] PATH_INFO: `/v3/users/6f0dc76295794c0bbae67a43ecc3f961` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:28.413757 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f6dc9b-06f5-4e2f-9af0-902b800c3c35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f0dc76295794c0bbae67a43ecc3f961)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:28.415692 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f6dc9b-06f5-4e2f-9af0-902b800c3c35 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:28.489360 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1370/2723] 10.222.0.86 () {60 vars in 1152 bytes} [Tue Jun 7 14:50:28 2022] POST /identity/v3/projects => generated 381 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:50:28.491163 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e16c72-ceac-46f5-8852-ad0ef668bc25 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:28.560414 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e16c72-ceac-46f5-8852-ad0ef668bc25 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:28.566040 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f41ae1e-ed97-4e9b-95d0-aebe4ec9f563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:28.566877 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f41ae1e-ed97-4e9b-95d0-aebe4ec9f563 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:28.567228 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f41ae1e-ed97-4e9b-95d0-aebe4ec9f563 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:28.567589 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f41ae1e-ed97-4e9b-95d0-aebe4ec9f563 admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:28.568407 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f41ae1e-ed97-4e9b-95d0-aebe4ec9f563 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:28.570491 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f41ae1e-ed97-4e9b-95d0-aebe4ec9f563 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:28.660111 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-23f6dc9b-06f5-4e2f-9af0-902b800c3c35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f0dc76295794c0bbae67a43ecc3f961'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:28.666811 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-23f6dc9b-06f5-4e2f-9af0-902b800c3c35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f0dc76295794c0bbae67a43ecc3f961'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:28.667539 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-23f6dc9b-06f5-4e2f-9af0-902b800c3c35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f0dc76295794c0bbae67a43ecc3f961'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:28.679604 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-23f6dc9b-06f5-4e2f-9af0-902b800c3c35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f0dc76295794c0bbae67a43ecc3f961'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:28.680269 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-23f6dc9b-06f5-4e2f-9af0-902b800c3c35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f0dc76295794c0bbae67a43ecc3f961'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:28.691559 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1371/2724] 10.222.0.86 () {60 vars in 1143 bytes} [Tue Jun 7 14:50:28 2022] POST /identity/v3/users => generated 297 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:50:28.696054 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f41ae1e-ed97-4e9b-95d0-aebe4ec9f563 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:28.697592 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-1f41ae1e-ed97-4e9b-95d0-aebe4ec9f563 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:28.709320 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f41ae1e-ed97-4e9b-95d0-aebe4ec9f563 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:28.714139 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6943734-e007-4a1c-83ec-0d2527baaf9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:28.714778 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6943734-e007-4a1c-83ec-0d2527baaf9e admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:28.715066 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6943734-e007-4a1c-83ec-0d2527baaf9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:28.715346 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6943734-e007-4a1c-83ec-0d2527baaf9e admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:28.716244 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6943734-e007-4a1c-83ec-0d2527baaf9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:28.717849 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6943734-e007-4a1c-83ec-0d2527baaf9e admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:28.727780 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1372/2725] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:50:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 07 14:50:28.731541 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6943734-e007-4a1c-83ec-0d2527baaf9e admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:28.741489 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6943734-e007-4a1c-83ec-0d2527baaf9e admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:28.746064 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e9d418-a81e-41da-bc84-3c823197671f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:28.746938 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e9d418-a81e-41da-bc84-3c823197671f admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:28.747225 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e9d418-a81e-41da-bc84-3c823197671f admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:28.747503 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e9d418-a81e-41da-bc84-3c823197671f admin admin] PATH_INFO: `/v3/projects/89da0e35354943aea39d71e0d8dd4453/users/2cc8f13eed4840adb384db5b311a3c60/roles/e3bf6239f5bf477b965704b086786f11` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:28.761146 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:50:28.763833 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e9d418-a81e-41da-bc84-3c823197671f admin admin] RBAC: Authorizing `identity:create_grant(project_id=89da0e35354943aea39d71e0d8dd4453, user_id=2cc8f13eed4840adb384db5b311a3c60, role_id=e3bf6239f5bf477b965704b086786f11)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:28.766588 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e9d418-a81e-41da-bc84-3c823197671f admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:28.798137 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1354/2726] 10.222.0.86 () {58 vars in 1223 bytes} [Tue Jun 7 14:50:28 2022] DELETE /identity/v3/users/6f0dc76295794c0bbae67a43ecc3f961 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:50:28.798137 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f6dc9b-06f5-4e2f-9af0-902b800c3c35 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:28.798470 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-23f6dc9b-06f5-4e2f-9af0-902b800c3c35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:28.861043 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f6dc9b-06f5-4e2f-9af0-902b800c3c35 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:28.866156 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf946500-cbb9-4cd3-80a1-11bcf0926b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:28.867004 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf946500-cbb9-4cd3-80a1-11bcf0926b8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:28.867312 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf946500-cbb9-4cd3-80a1-11bcf0926b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:28.867590 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf946500-cbb9-4cd3-80a1-11bcf0926b8a admin admin] PATH_INFO: `/v3/projects/03d1267074a44a64abba6d9ffd2f6677` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:28.868801 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf946500-cbb9-4cd3-80a1-11bcf0926b8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=03d1267074a44a64abba6d9ffd2f6677)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:28.870687 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf946500-cbb9-4cd3-80a1-11bcf0926b8a admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:28.887240 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1373/2727] 10.222.0.86 () {60 vars in 1482 bytes} [Tue Jun 7 14:50:28 2022] PUT /identity/v3/projects/89da0e35354943aea39d71e0d8dd4453/users/2cc8f13eed4840adb384db5b311a3c60/roles/e3bf6239f5bf477b965704b086786f11 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 14:50:28.889690 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95642201-dc95-43eb-b1ea-5ed20e72e0a4 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:28.889690 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95642201-dc95-43eb-b1ea-5ed20e72e0a4 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:28.889690 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95642201-dc95-43eb-b1ea-5ed20e72e0a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:28.905176 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-95642201-dc95-43eb-b1ea-5ed20e72e0a4 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:50:28.906381 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-95642201-dc95-43eb-b1ea-5ed20e72e0a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:28.962320 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1374/2728] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:50:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:50:28.963079 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95642201-dc95-43eb-b1ea-5ed20e72e0a4 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:28.971874 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95642201-dc95-43eb-b1ea-5ed20e72e0a4 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:28.976523 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ad8863-1323-43dd-a659-3680d42e1b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:28.977167 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ad8863-1323-43dd-a659-3680d42e1b50 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:28.977451 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ad8863-1323-43dd-a659-3680d42e1b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:28.983268 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ad8863-1323-43dd-a659-3680d42e1b50 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:28.983268 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ad8863-1323-43dd-a659-3680d42e1b50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:28.983268 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ad8863-1323-43dd-a659-3680d42e1b50 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:28.990116 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1375/2729] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:50:28 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:50:28.990881 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ad8863-1323-43dd-a659-3680d42e1b50 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:28.992457 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-26ad8863-1323-43dd-a659-3680d42e1b50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:29.022769 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-cf946500-cbb9-4cd3-80a1-11bcf0926b8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03d1267074a44a64abba6d9ffd2f6677', 'request_id': 'req-cf946500-cbb9-4cd3-80a1-11bcf0926b8a'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:29.029049 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-cf946500-cbb9-4cd3-80a1-11bcf0926b8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03d1267074a44a64abba6d9ffd2f6677', 'request_id': 'req-cf946500-cbb9-4cd3-80a1-11bcf0926b8a'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:29.050398 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ad8863-1323-43dd-a659-3680d42e1b50 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:29.096782 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50902d4-0485-43af-80ec-22325738f192 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dda603ec5517460a83c333db2af804d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:29.097422 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50902d4-0485-43af-80ec-22325738f192 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:29.097714 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50902d4-0485-43af-80ec-22325738f192 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:29.097999 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50902d4-0485-43af-80ec-22325738f192 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:29.113033 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-cf946500-cbb9-4cd3-80a1-11bcf0926b8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03d1267074a44a64abba6d9ffd2f6677', 'request_id': 'req-cf946500-cbb9-4cd3-80a1-11bcf0926b8a'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:29.124124 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-cf946500-cbb9-4cd3-80a1-11bcf0926b8a admin admin] The token cache is being invalidate because project 03d1267074a44a64abba6d9ffd2f6677 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:50:29.124487 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-cf946500-cbb9-4cd3-80a1-11bcf0926b8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:29.125280 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-cf946500-cbb9-4cd3-80a1-11bcf0926b8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:29.127006 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1355/2730] 10.222.0.86 () {58 vars in 1232 bytes} [Tue Jun 7 14:50:28 2022] DELETE /identity/v3/projects/03d1267074a44a64abba6d9ffd2f6677 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:50:29.127961 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf946500-cbb9-4cd3-80a1-11bcf0926b8a admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:29.130036 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-cf946500-cbb9-4cd3-80a1-11bcf0926b8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:29.153695 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:50:29.162844 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50902d4-0485-43af-80ec-22325738f192 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:29.164501 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50902d4-0485-43af-80ec-22325738f192 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:29.175566 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1376/2731] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:50:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:50:29.217565 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf946500-cbb9-4cd3-80a1-11bcf0926b8a admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:29.227212 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852202ca-d2fd-45b3-9da7-e3cd9d6ac946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:29.228478 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852202ca-d2fd-45b3-9da7-e3cd9d6ac946 admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:29.228774 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852202ca-d2fd-45b3-9da7-e3cd9d6ac946 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:29.229052 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852202ca-d2fd-45b3-9da7-e3cd9d6ac946 admin admin] PATH_INFO: `/v3/projects/89da0e35354943aea39d71e0d8dd4453/users/2cc8f13eed4840adb384db5b311a3c60/roles/e3bf6239f5bf477b965704b086786f11` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:29.231370 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852202ca-d2fd-45b3-9da7-e3cd9d6ac946 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89da0e35354943aea39d71e0d8dd4453, user_id=2cc8f13eed4840adb384db5b311a3c60, role_id=e3bf6239f5bf477b965704b086786f11)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:29.234144 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852202ca-d2fd-45b3-9da7-e3cd9d6ac946 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:29.246814 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1356/2732] 10.222.0.86 () {60 vars in 1482 bytes} [Tue Jun 7 14:50:29 2022] PUT /identity/v3/projects/89da0e35354943aea39d71e0d8dd4453/users/2cc8f13eed4840adb384db5b311a3c60/roles/e3bf6239f5bf477b965704b086786f11 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:50:29.259468 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72ac0c4-e24a-4dec-a04c-030a331a7527 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:29.259781 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72ac0c4-e24a-4dec-a04c-030a331a7527 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:29.260153 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72ac0c4-e24a-4dec-a04c-030a331a7527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:29.291608 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-f72ac0c4-e24a-4dec-a04c-030a331a7527 None None] MFA Rules not processed for user `2cc8f13eed4840adb384db5b311a3c60`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:50:29.292913 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-f72ac0c4-e24a-4dec-a04c-030a331a7527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:29.313106 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:50:29.367993 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1377/2733] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:50:29 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:50:29.380887 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852202ca-d2fd-45b3-9da7-e3cd9d6ac946 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:29.382648 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-852202ca-d2fd-45b3-9da7-e3cd9d6ac946 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:29.443057 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852202ca-d2fd-45b3-9da7-e3cd9d6ac946 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:29.447480 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ce3648-5cdc-40e3-98e5-ff353a37afc8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af5a95620a4b43538abfe09eed4bf115', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:29.448389 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ce3648-5cdc-40e3-98e5-ff353a37afc8 service cinder] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:29.448678 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ce3648-5cdc-40e3-98e5-ff353a37afc8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:29.449428 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ce3648-5cdc-40e3-98e5-ff353a37afc8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:29.459352 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ce3648-5cdc-40e3-98e5-ff353a37afc8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:29.460858 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ce3648-5cdc-40e3-98e5-ff353a37afc8 service cinder] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:29.470514 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1357/2734] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:50:29 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:50:29.767735 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72ac0c4-e24a-4dec-a04c-030a331a7527 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:29.771335 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-f72ac0c4-e24a-4dec-a04c-030a331a7527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:29.813060 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:50:29.859914 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72ac0c4-e24a-4dec-a04c-030a331a7527 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:29.865061 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7155b3-abb1-48f5-8b73-ee11c224efa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:29.865925 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7155b3-abb1-48f5-8b73-ee11c224efa2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:29.866208 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7155b3-abb1-48f5-8b73-ee11c224efa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:29.866485 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7155b3-abb1-48f5-8b73-ee11c224efa2 admin admin] PATH_INFO: `/v3/projects/0b2c950c32da4576aa487a42579918e5` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:29.867680 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7155b3-abb1-48f5-8b73-ee11c224efa2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b2c950c32da4576aa487a42579918e5)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:29.869587 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7155b3-abb1-48f5-8b73-ee11c224efa2 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:29.983353 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-0e7155b3-abb1-48f5-8b73-ee11c224efa2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b2c950c32da4576aa487a42579918e5', 'request_id': 'req-0e7155b3-abb1-48f5-8b73-ee11c224efa2'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:29.990073 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-0e7155b3-abb1-48f5-8b73-ee11c224efa2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b2c950c32da4576aa487a42579918e5', 'request_id': 'req-0e7155b3-abb1-48f5-8b73-ee11c224efa2'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:30.049229 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ce3648-5cdc-40e3-98e5-ff353a37afc8 service cinder] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:30.060533 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ce3648-5cdc-40e3-98e5-ff353a37afc8 service cinder] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:30.091605 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:50:30.095559 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-0e7155b3-abb1-48f5-8b73-ee11c224efa2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b2c950c32da4576aa487a42579918e5', 'request_id': 'req-0e7155b3-abb1-48f5-8b73-ee11c224efa2'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:30.107096 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-0e7155b3-abb1-48f5-8b73-ee11c224efa2 admin admin] The token cache is being invalidate because project 0b2c950c32da4576aa487a42579918e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:50:30.107383 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-0e7155b3-abb1-48f5-8b73-ee11c224efa2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:30.108034 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-0e7155b3-abb1-48f5-8b73-ee11c224efa2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:30.109603 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1378/2735] 10.222.0.86 () {58 vars in 1232 bytes} [Tue Jun 7 14:50:29 2022] DELETE /identity/v3/projects/0b2c950c32da4576aa487a42579918e5 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:50:30.114196 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7155b3-abb1-48f5-8b73-ee11c224efa2 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:30.115558 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-0e7155b3-abb1-48f5-8b73-ee11c224efa2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:30.116362 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ef312a-ab17-45cc-9071-28f116b455dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:30.117413 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef312a-ab17-45cc-9071-28f116b455dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:30.117691 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef312a-ab17-45cc-9071-28f116b455dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:30.117968 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef312a-ab17-45cc-9071-28f116b455dd admin admin] PATH_INFO: `/v3/users/a2b796f744fc41e3aa3641961c210d3b` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:30.119233 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ef312a-ab17-45cc-9071-28f116b455dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2b796f744fc41e3aa3641961c210d3b)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:30.121227 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ef312a-ab17-45cc-9071-28f116b455dd admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:30.127882 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7155b3-abb1-48f5-8b73-ee11c224efa2 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:30.132486 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0fb0eb-403a-45f9-9de8-1dff56f85dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:30.133598 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0fb0eb-403a-45f9-9de8-1dff56f85dcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:30.133882 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0fb0eb-403a-45f9-9de8-1dff56f85dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:30.134157 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0fb0eb-403a-45f9-9de8-1dff56f85dcd admin admin] PATH_INFO: `/v3/users/ea3f449e9b8d44ba81f5164dd6d0a9ef` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:30.135346 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0fb0eb-403a-45f9-9de8-1dff56f85dcd admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea3f449e9b8d44ba81f5164dd6d0a9ef)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:30.137330 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0fb0eb-403a-45f9-9de8-1dff56f85dcd admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:30.357461 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-71ef312a-ab17-45cc-9071-28f116b455dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2b796f744fc41e3aa3641961c210d3b'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:30.364850 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-71ef312a-ab17-45cc-9071-28f116b455dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2b796f744fc41e3aa3641961c210d3b'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:30.365717 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-71ef312a-ab17-45cc-9071-28f116b455dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2b796f744fc41e3aa3641961c210d3b'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:30.374340 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-1e0fb0eb-403a-45f9-9de8-1dff56f85dcd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea3f449e9b8d44ba81f5164dd6d0a9ef'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:30.374977 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-1e0fb0eb-403a-45f9-9de8-1dff56f85dcd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea3f449e9b8d44ba81f5164dd6d0a9ef'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:30.377622 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-71ef312a-ab17-45cc-9071-28f116b455dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2b796f744fc41e3aa3641961c210d3b'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:30.378367 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-71ef312a-ab17-45cc-9071-28f116b455dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2b796f744fc41e3aa3641961c210d3b'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:30.381759 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-1e0fb0eb-403a-45f9-9de8-1dff56f85dcd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea3f449e9b8d44ba81f5164dd6d0a9ef'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:30.393519 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-1e0fb0eb-403a-45f9-9de8-1dff56f85dcd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea3f449e9b8d44ba81f5164dd6d0a9ef'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:30.394159 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-1e0fb0eb-403a-45f9-9de8-1dff56f85dcd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea3f449e9b8d44ba81f5164dd6d0a9ef'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:30.485457 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1358/2736] 10.222.0.86 () {58 vars in 1223 bytes} [Tue Jun 7 14:50:30 2022] DELETE /identity/v3/users/a2b796f744fc41e3aa3641961c210d3b => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 14:50:30.489907 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72e7115-f9b6-4564-a62f-212f0730eb6e None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:30.490199 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72e7115-f9b6-4564-a62f-212f0730eb6e None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:30.490477 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72e7115-f9b6-4564-a62f-212f0730eb6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:30.506567 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-e72e7115-f9b6-4564-a62f-212f0730eb6e None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:50:30.508109 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-e72e7115-f9b6-4564-a62f-212f0730eb6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:30.565880 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1359/2737] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:50:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 14:50:30.575610 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72e7115-f9b6-4564-a62f-212f0730eb6e None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:30.577055 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-e72e7115-f9b6-4564-a62f-212f0730eb6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:30.605844 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1379/2738] 10.222.0.86 () {58 vars in 1223 bytes} [Tue Jun 7 14:50:30 2022] DELETE /identity/v3/users/ea3f449e9b8d44ba81f5164dd6d0a9ef => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 14:50:30.635994 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72e7115-f9b6-4564-a62f-212f0730eb6e None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:30.643903 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:50:30.685418 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7490f8a0-4472-488b-bea9-4ec0c0bb6daa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dda603ec5517460a83c333db2af804d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:30.686071 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7490f8a0-4472-488b-bea9-4ec0c0bb6daa service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:30.686351 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7490f8a0-4472-488b-bea9-4ec0c0bb6daa service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:30.686624 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7490f8a0-4472-488b-bea9-4ec0c0bb6daa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:30.746185 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7490f8a0-4472-488b-bea9-4ec0c0bb6daa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:30.747616 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7490f8a0-4472-488b-bea9-4ec0c0bb6daa service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:30.757442 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1360/2739] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:50:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 14:50:31.079189 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0fb0eb-403a-45f9-9de8-1dff56f85dcd admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:31.080744 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-1e0fb0eb-403a-45f9-9de8-1dff56f85dcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:31.094296 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0fb0eb-403a-45f9-9de8-1dff56f85dcd admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:31.099201 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957ebd97-d504-4a02-a28a-36d9e755111d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:31.100045 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957ebd97-d504-4a02-a28a-36d9e755111d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:31.100332 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957ebd97-d504-4a02-a28a-36d9e755111d admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:31.100619 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957ebd97-d504-4a02-a28a-36d9e755111d admin admin] PATH_INFO: `/v3/projects/bcea9fb340fe44ddbea5ecd70d376a2b` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:31.102043 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957ebd97-d504-4a02-a28a-36d9e755111d admin admin] RBAC: Authorizing `identity:delete_project(project_id=bcea9fb340fe44ddbea5ecd70d376a2b)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:31.104017 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957ebd97-d504-4a02-a28a-36d9e755111d admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:31.126994 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:50:31.184829 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7490f8a0-4472-488b-bea9-4ec0c0bb6daa service neutron] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:31.186344 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-7490f8a0-4472-488b-bea9-4ec0c0bb6daa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:31.200718 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7490f8a0-4472-488b-bea9-4ec0c0bb6daa service neutron] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:31.206022 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ab07ce-cea6-410f-b7d8-0528258223ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:31.206825 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ab07ce-cea6-410f-b7d8-0528258223ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:31.207207 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ab07ce-cea6-410f-b7d8-0528258223ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:31.207485 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ab07ce-cea6-410f-b7d8-0528258223ad admin admin] PATH_INFO: `/v3/projects/0bf320f5dcf5446596b7a3afc98abe17` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:31.208881 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ab07ce-cea6-410f-b7d8-0528258223ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=0bf320f5dcf5446596b7a3afc98abe17)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:31.211115 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ab07ce-cea6-410f-b7d8-0528258223ad admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:31.223032 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-957ebd97-d504-4a02-a28a-36d9e755111d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bcea9fb340fe44ddbea5ecd70d376a2b', 'request_id': 'req-957ebd97-d504-4a02-a28a-36d9e755111d'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:31.229366 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-957ebd97-d504-4a02-a28a-36d9e755111d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bcea9fb340fe44ddbea5ecd70d376a2b', 'request_id': 'req-957ebd97-d504-4a02-a28a-36d9e755111d'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:31.307033 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-957ebd97-d504-4a02-a28a-36d9e755111d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bcea9fb340fe44ddbea5ecd70d376a2b', 'request_id': 'req-957ebd97-d504-4a02-a28a-36d9e755111d'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:31.318839 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-957ebd97-d504-4a02-a28a-36d9e755111d admin admin] The token cache is being invalidate because project bcea9fb340fe44ddbea5ecd70d376a2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:50:31.319128 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-957ebd97-d504-4a02-a28a-36d9e755111d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:31.319750 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-957ebd97-d504-4a02-a28a-36d9e755111d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:31.321333 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1380/2740] 10.222.0.86 () {58 vars in 1232 bytes} [Tue Jun 7 14:50:31 2022] DELETE /identity/v3/projects/bcea9fb340fe44ddbea5ecd70d376a2b => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:50:31.325942 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a19ef18-1dad-4559-8174-c8dc6f90e6ab None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:31.328388 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a19ef18-1dad-4559-8174-c8dc6f90e6ab None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:31.328388 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a19ef18-1dad-4559-8174-c8dc6f90e6ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:31.332944 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-c3ab07ce-cea6-410f-b7d8-0528258223ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0bf320f5dcf5446596b7a3afc98abe17', 'request_id': 'req-c3ab07ce-cea6-410f-b7d8-0528258223ad'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:31.339215 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-c3ab07ce-cea6-410f-b7d8-0528258223ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0bf320f5dcf5446596b7a3afc98abe17', 'request_id': 'req-c3ab07ce-cea6-410f-b7d8-0528258223ad'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:31.344963 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-9a19ef18-1dad-4559-8174-c8dc6f90e6ab None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:50:31.346170 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-9a19ef18-1dad-4559-8174-c8dc6f90e6ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:31.402898 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1381/2741] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:50:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 14:50:31.411060 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbdbb0d-ab13-4b49-a476-9568f482a3d8 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:31.411547 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbdbb0d-ab13-4b49-a476-9568f482a3d8 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:31.411863 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbdbb0d-ab13-4b49-a476-9568f482a3d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:31.411990 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-c3ab07ce-cea6-410f-b7d8-0528258223ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0bf320f5dcf5446596b7a3afc98abe17', 'request_id': 'req-c3ab07ce-cea6-410f-b7d8-0528258223ad'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:31.423158 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-c3ab07ce-cea6-410f-b7d8-0528258223ad admin admin] The token cache is being invalidate because project 0bf320f5dcf5446596b7a3afc98abe17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:50:31.423428 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-c3ab07ce-cea6-410f-b7d8-0528258223ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:31.424076 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-c3ab07ce-cea6-410f-b7d8-0528258223ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:31.425615 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1361/2742] 10.222.0.86 () {58 vars in 1232 bytes} [Tue Jun 7 14:50:31 2022] DELETE /identity/v3/projects/0bf320f5dcf5446596b7a3afc98abe17 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 14:50:31.430075 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ab07ce-cea6-410f-b7d8-0528258223ad admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:31.431492 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-c3ab07ce-cea6-410f-b7d8-0528258223ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:31.432638 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-6dbdbb0d-ab13-4b49-a476-9568f482a3d8 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:50:31.433804 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-6dbdbb0d-ab13-4b49-a476-9568f482a3d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:31.441835 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1382/2743] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:50:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 14:50:31.444482 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ab07ce-cea6-410f-b7d8-0528258223ad admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:31.446208 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbdbb0d-ab13-4b49-a476-9568f482a3d8 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:31.449435 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8388369b-92a9-45f1-b8e5-fc417c8d04fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:31.450383 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8388369b-92a9-45f1-b8e5-fc417c8d04fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:31.450729 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8388369b-92a9-45f1-b8e5-fc417c8d04fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:31.451007 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8388369b-92a9-45f1-b8e5-fc417c8d04fc admin admin] PATH_INFO: `/v3/users/2cc8f13eed4840adb384db5b311a3c60` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:31.452232 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8388369b-92a9-45f1-b8e5-fc417c8d04fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=2cc8f13eed4840adb384db5b311a3c60)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:31.454155 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8388369b-92a9-45f1-b8e5-fc417c8d04fc admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:31.455136 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbdbb0d-ab13-4b49-a476-9568f482a3d8 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:31.460173 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4876f3d-6495-47dd-9c86-ff7c07dc36ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:31.464250 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4876f3d-6495-47dd-9c86-ff7c07dc36ab admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:31.464250 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4876f3d-6495-47dd-9c86-ff7c07dc36ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:31.464250 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4876f3d-6495-47dd-9c86-ff7c07dc36ab admin admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:31.464250 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4876f3d-6495-47dd-9c86-ff7c07dc36ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:50:31.464250 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4876f3d-6495-47dd-9c86-ff7c07dc36ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:31.464250 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4876f3d-6495-47dd-9c86-ff7c07dc36ab admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:31.476401 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1383/2744] 10.222.0.86 () {58 vars in 1152 bytes} [Tue Jun 7 14:50:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:50:31.480866 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4876f3d-6495-47dd-9c86-ff7c07dc36ab admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:31.491027 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4876f3d-6495-47dd-9c86-ff7c07dc36ab admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:31.495827 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec72c83-f93c-47fd-8053-9b1c5682a71e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:31.496479 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec72c83-f93c-47fd-8053-9b1c5682a71e admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:31.496763 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec72c83-f93c-47fd-8053-9b1c5682a71e admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:31.497069 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec72c83-f93c-47fd-8053-9b1c5682a71e admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:31.497784 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec72c83-f93c-47fd-8053-9b1c5682a71e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:31.499700 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec72c83-f93c-47fd-8053-9b1c5682a71e admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:31.635000 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1384/2745] 10.222.0.86 () {60 vars in 1152 bytes} [Tue Jun 7 14:50:31 2022] POST /identity/v3/projects => generated 383 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 14:50:31.639025 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec72c83-f93c-47fd-8053-9b1c5682a71e admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:31.665460 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:50:31.670965 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-8388369b-92a9-45f1-b8e5-fc417c8d04fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2cc8f13eed4840adb384db5b311a3c60'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:31.678173 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-8388369b-92a9-45f1-b8e5-fc417c8d04fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2cc8f13eed4840adb384db5b311a3c60'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:31.678869 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-8388369b-92a9-45f1-b8e5-fc417c8d04fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2cc8f13eed4840adb384db5b311a3c60'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:31.691227 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-8388369b-92a9-45f1-b8e5-fc417c8d04fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2cc8f13eed4840adb384db5b311a3c60'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:31.691920 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-8388369b-92a9-45f1-b8e5-fc417c8d04fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2cc8f13eed4840adb384db5b311a3c60'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:31.700192 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec72c83-f93c-47fd-8053-9b1c5682a71e admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:31.704782 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d34dbf2-799f-4de7-a2e7-fa67a7d129dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:31.705439 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d34dbf2-799f-4de7-a2e7-fa67a7d129dd admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:31.705722 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d34dbf2-799f-4de7-a2e7-fa67a7d129dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:31.705999 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d34dbf2-799f-4de7-a2e7-fa67a7d129dd admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:31.706674 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d34dbf2-799f-4de7-a2e7-fa67a7d129dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:31.709146 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d34dbf2-799f-4de7-a2e7-fa67a7d129dd admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:31.718392 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:50:31.828376 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1362/2746] 10.222.0.86 () {58 vars in 1223 bytes} [Tue Jun 7 14:50:31 2022] DELETE /identity/v3/users/2cc8f13eed4840adb384db5b311a3c60 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 14:50:31.842042 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1385/2747] 10.222.0.86 () {60 vars in 1143 bytes} [Tue Jun 7 14:50:31 2022] POST /identity/v3/users => generated 292 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 14:50:31.847661 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8388369b-92a9-45f1-b8e5-fc417c8d04fc admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:31.849629 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-8388369b-92a9-45f1-b8e5-fc417c8d04fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:31.914351 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8388369b-92a9-45f1-b8e5-fc417c8d04fc admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:31.919097 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbde9404-c84a-4f12-838e-7c3980a42e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:31.919732 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbde9404-c84a-4f12-838e-7c3980a42e9d admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:31.920047 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbde9404-c84a-4f12-838e-7c3980a42e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:31.920324 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbde9404-c84a-4f12-838e-7c3980a42e9d admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:31.921076 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbde9404-c84a-4f12-838e-7c3980a42e9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:31.922685 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbde9404-c84a-4f12-838e-7c3980a42e9d admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:31.932584 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1363/2748] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:50:31 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:50:31.936689 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d34dbf2-799f-4de7-a2e7-fa67a7d129dd admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:31.946565 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d34dbf2-799f-4de7-a2e7-fa67a7d129dd admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:31.951074 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367eea4c-07a5-44bf-8515-804d652bf234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:31.951721 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367eea4c-07a5-44bf-8515-804d652bf234 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:31.952031 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367eea4c-07a5-44bf-8515-804d652bf234 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:31.952304 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367eea4c-07a5-44bf-8515-804d652bf234 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:31.953121 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367eea4c-07a5-44bf-8515-804d652bf234 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:31.954679 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367eea4c-07a5-44bf-8515-804d652bf234 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:31.964810 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1386/2749] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:50:31 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:50:31.972865 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbde9404-c84a-4f12-838e-7c3980a42e9d admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:31.983268 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbde9404-c84a-4f12-838e-7c3980a42e9d admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:31.987932 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58036d24-c961-45b8-abb0-46a4d0f3de57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:31.988803 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58036d24-c961-45b8-abb0-46a4d0f3de57 admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:31.989090 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58036d24-c961-45b8-abb0-46a4d0f3de57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:31.989368 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58036d24-c961-45b8-abb0-46a4d0f3de57 admin admin] PATH_INFO: `/v3/projects/3c411d21a63f42a380f9430895c135a5/users/c31ea394d5054d72a1edeb71bf9480f8/roles/c17acc2a8bb348f59ba7edd22fcf0c47` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:32.003671 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58036d24-c961-45b8-abb0-46a4d0f3de57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c411d21a63f42a380f9430895c135a5, user_id=c31ea394d5054d72a1edeb71bf9480f8, role_id=c17acc2a8bb348f59ba7edd22fcf0c47)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:32.006331 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58036d24-c961-45b8-abb0-46a4d0f3de57 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:32.149390 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1364/2750] 10.222.0.86 () {60 vars in 1482 bytes} [Tue Jun 7 14:50:31 2022] PUT /identity/v3/projects/3c411d21a63f42a380f9430895c135a5/users/c31ea394d5054d72a1edeb71bf9480f8/roles/c17acc2a8bb348f59ba7edd22fcf0c47 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:50:32.159587 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59295559-ca59-4a75-9897-bf569c022119 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:32.160134 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59295559-ca59-4a75-9897-bf569c022119 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:32.160362 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59295559-ca59-4a75-9897-bf569c022119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:32.192074 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-59295559-ca59-4a75-9897-bf569c022119 None None] MFA Rules not processed for user `c31ea394d5054d72a1edeb71bf9480f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:50:32.193195 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-59295559-ca59-4a75-9897-bf569c022119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:32.263175 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58036d24-c961-45b8-abb0-46a4d0f3de57 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:32.266390 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-58036d24-c961-45b8-abb0-46a4d0f3de57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:32.268747 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1387/2751] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:50:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:50:32.272644 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59295559-ca59-4a75-9897-bf569c022119 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:32.351703 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59295559-ca59-4a75-9897-bf569c022119 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:32.354255 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58036d24-c961-45b8-abb0-46a4d0f3de57 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:32.356816 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db64d3b-84ed-4ae7-949d-9c0c0e8cfe46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:32.357484 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db64d3b-84ed-4ae7-949d-9c0c0e8cfe46 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:32.357872 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db64d3b-84ed-4ae7-949d-9c0c0e8cfe46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:32.358222 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db64d3b-84ed-4ae7-949d-9c0c0e8cfe46 admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:32.358922 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db64d3b-84ed-4ae7-949d-9c0c0e8cfe46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:32.359568 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66987cb4-7819-4bbf-b38e-9e22074433e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:32.360534 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66987cb4-7819-4bbf-b38e-9e22074433e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:32.360817 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66987cb4-7819-4bbf-b38e-9e22074433e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:32.361096 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66987cb4-7819-4bbf-b38e-9e22074433e7 admin admin] PATH_INFO: `/v3/projects/89da0e35354943aea39d71e0d8dd4453` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:32.361210 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db64d3b-84ed-4ae7-949d-9c0c0e8cfe46 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:32.362276 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66987cb4-7819-4bbf-b38e-9e22074433e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89da0e35354943aea39d71e0d8dd4453)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:32.364248 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66987cb4-7819-4bbf-b38e-9e22074433e7 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:32.465014 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1388/2752] 10.222.0.86 () {60 vars in 1152 bytes} [Tue Jun 7 14:50:32 2022] POST /identity/v3/projects => generated 383 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 14:50:32.468936 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db64d3b-84ed-4ae7-949d-9c0c0e8cfe46 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:32.484948 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:50:32.497500 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-66987cb4-7819-4bbf-b38e-9e22074433e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89da0e35354943aea39d71e0d8dd4453', 'request_id': 'req-66987cb4-7819-4bbf-b38e-9e22074433e7'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:32.503750 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-66987cb4-7819-4bbf-b38e-9e22074433e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89da0e35354943aea39d71e0d8dd4453', 'request_id': 'req-66987cb4-7819-4bbf-b38e-9e22074433e7'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:32.530812 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db64d3b-84ed-4ae7-949d-9c0c0e8cfe46 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:32.534399 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:50:32.586063 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ae0a2e-318a-4b1c-8e9a-39c7dc8c46ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:32.586794 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae0a2e-318a-4b1c-8e9a-39c7dc8c46ba admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:32.587051 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae0a2e-318a-4b1c-8e9a-39c7dc8c46ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:32.587329 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae0a2e-318a-4b1c-8e9a-39c7dc8c46ba admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:32.588049 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ae0a2e-318a-4b1c-8e9a-39c7dc8c46ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:32.590009 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ae0a2e-318a-4b1c-8e9a-39c7dc8c46ba admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:32.628591 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-66987cb4-7819-4bbf-b38e-9e22074433e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89da0e35354943aea39d71e0d8dd4453', 'request_id': 'req-66987cb4-7819-4bbf-b38e-9e22074433e7'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:32.639884 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-66987cb4-7819-4bbf-b38e-9e22074433e7 admin admin] The token cache is being invalidate because project 89da0e35354943aea39d71e0d8dd4453 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:50:32.640172 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-66987cb4-7819-4bbf-b38e-9e22074433e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:32.640841 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-66987cb4-7819-4bbf-b38e-9e22074433e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:32.642434 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1365/2753] 10.222.0.86 () {58 vars in 1232 bytes} [Tue Jun 7 14:50:32 2022] DELETE /identity/v3/projects/89da0e35354943aea39d71e0d8dd4453 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:50:32.648235 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc64647-2b3b-4f41-8081-a2735cf3b68f None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:32.648524 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc64647-2b3b-4f41-8081-a2735cf3b68f None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:32.648805 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc64647-2b3b-4f41-8081-a2735cf3b68f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:32.666722 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-bdc64647-2b3b-4f41-8081-a2735cf3b68f None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:50:32.667962 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-bdc64647-2b3b-4f41-8081-a2735cf3b68f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:32.675698 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1366/2754] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:50:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 14:50:32.685027 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863081cc-755e-4759-a1b1-922f19b5555c None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:32.685316 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863081cc-755e-4759-a1b1-922f19b5555c None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:32.685601 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863081cc-755e-4759-a1b1-922f19b5555c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:32.702494 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-863081cc-755e-4759-a1b1-922f19b5555c None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:50:32.703649 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-863081cc-755e-4759-a1b1-922f19b5555c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:32.711905 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1367/2755] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:50:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 14:50:32.715728 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863081cc-755e-4759-a1b1-922f19b5555c None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:32.724751 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863081cc-755e-4759-a1b1-922f19b5555c None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:32.729292 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d0374a-6009-4d8d-b069-3c49f69bafd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:32.729893 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d0374a-6009-4d8d-b069-3c49f69bafd8 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:32.730292 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d0374a-6009-4d8d-b069-3c49f69bafd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:32.730576 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d0374a-6009-4d8d-b069-3c49f69bafd8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:32.731293 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d0374a-6009-4d8d-b069-3c49f69bafd8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:50:32.731603 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d0374a-6009-4d8d-b069-3c49f69bafd8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:32.733206 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d0374a-6009-4d8d-b069-3c49f69bafd8 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:32.738865 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1389/2756] 10.222.0.86 () {60 vars in 1143 bytes} [Tue Jun 7 14:50:32 2022] POST /identity/v3/users => generated 298 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 14:50:32.747872 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ae0a2e-318a-4b1c-8e9a-39c7dc8c46ba admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:32.748023 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1368/2757] 10.222.0.86 () {58 vars in 1152 bytes} [Tue Jun 7 14:50:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:50:32.748166 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-77ae0a2e-318a-4b1c-8e9a-39c7dc8c46ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:32.749239 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d0374a-6009-4d8d-b069-3c49f69bafd8 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:32.758478 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ae0a2e-318a-4b1c-8e9a-39c7dc8c46ba admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:32.759050 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d0374a-6009-4d8d-b069-3c49f69bafd8 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:32.763121 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb82ca4-49db-494b-83ae-9546b2413d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:32.763797 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb82ca4-49db-494b-83ae-9546b2413d03 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:32.764019 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2c795e-cd22-41ae-b078-a0c1c7c0d1ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:32.764209 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb82ca4-49db-494b-83ae-9546b2413d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:32.764346 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb82ca4-49db-494b-83ae-9546b2413d03 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:32.764706 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2c795e-cd22-41ae-b078-a0c1c7c0d1ca admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:32.764980 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2c795e-cd22-41ae-b078-a0c1c7c0d1ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:32.765089 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb82ca4-49db-494b-83ae-9546b2413d03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:32.765706 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2c795e-cd22-41ae-b078-a0c1c7c0d1ca admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:32.766629 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb82ca4-49db-494b-83ae-9546b2413d03 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:32.766750 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2c795e-cd22-41ae-b078-a0c1c7c0d1ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:32.769197 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2c795e-cd22-41ae-b078-a0c1c7c0d1ca admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:32.780379 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1390/2758] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:50:32 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 07 14:50:32.781333 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb82ca4-49db-494b-83ae-9546b2413d03 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:32.791423 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb82ca4-49db-494b-83ae-9546b2413d03 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:32.804966 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e66e556-cdfc-4e32-9852-0fe623f7fc9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:32.804966 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e66e556-cdfc-4e32-9852-0fe623f7fc9e admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:32.804966 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e66e556-cdfc-4e32-9852-0fe623f7fc9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:32.804966 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e66e556-cdfc-4e32-9852-0fe623f7fc9e admin admin] PATH_INFO: `/v3/projects/377f6d15dd9946feaf178fa42afdb11d/users/929854f300aa4489a48c2bc64370c7c2/roles/e3bf6239f5bf477b965704b086786f11` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:32.811590 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e66e556-cdfc-4e32-9852-0fe623f7fc9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=377f6d15dd9946feaf178fa42afdb11d, user_id=929854f300aa4489a48c2bc64370c7c2, role_id=e3bf6239f5bf477b965704b086786f11)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:32.814250 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e66e556-cdfc-4e32-9852-0fe623f7fc9e admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:32.915395 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1369/2759] 10.222.0.86 () {60 vars in 1152 bytes} [Tue Jun 7 14:50:32 2022] POST /identity/v3/projects => generated 377 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 14:50:32.919389 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2c795e-cd22-41ae-b078-a0c1c7c0d1ca admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:32.931452 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1391/2760] 10.222.0.86 () {60 vars in 1482 bytes} [Tue Jun 7 14:50:32 2022] PUT /identity/v3/projects/377f6d15dd9946feaf178fa42afdb11d/users/929854f300aa4489a48c2bc64370c7c2/roles/e3bf6239f5bf477b965704b086786f11 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:50:32.935156 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e66e556-cdfc-4e32-9852-0fe623f7fc9e admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:32.982359 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2c795e-cd22-41ae-b078-a0c1c7c0d1ca admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:32.996050 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e66e556-cdfc-4e32-9852-0fe623f7fc9e admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:33.000784 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e18d680-4f49-4b15-9086-cce26a5f4d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:33.001450 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e18d680-4f49-4b15-9086-cce26a5f4d68 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:33.001743 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e18d680-4f49-4b15-9086-cce26a5f4d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:33.002019 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e18d680-4f49-4b15-9086-cce26a5f4d68 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:33.002745 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e18d680-4f49-4b15-9086-cce26a5f4d68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:33.004861 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e18d680-4f49-4b15-9086-cce26a5f4d68 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:33.015134 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1392/2761] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:50:32 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 07 14:50:33.019261 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e18d680-4f49-4b15-9086-cce26a5f4d68 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:33.029588 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e18d680-4f49-4b15-9086-cce26a5f4d68 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:33.034514 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0d9746-c6ac-40f7-8240-79647a9f39f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:33.035533 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0d9746-c6ac-40f7-8240-79647a9f39f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:33.035851 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0d9746-c6ac-40f7-8240-79647a9f39f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:33.036135 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0d9746-c6ac-40f7-8240-79647a9f39f1 admin admin] PATH_INFO: `/v3/projects/377f6d15dd9946feaf178fa42afdb11d/users/929854f300aa4489a48c2bc64370c7c2/roles/e3bf6239f5bf477b965704b086786f11` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:33.038152 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0d9746-c6ac-40f7-8240-79647a9f39f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=377f6d15dd9946feaf178fa42afdb11d, user_id=929854f300aa4489a48c2bc64370c7c2, role_id=e3bf6239f5bf477b965704b086786f11)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:33.040105 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4a8a05-63a4-4f7f-ac75-1818dc5e2df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:33.040774 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4a8a05-63a4-4f7f-ac75-1818dc5e2df8 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:33.041034 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0d9746-c6ac-40f7-8240-79647a9f39f1 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:33.041146 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4a8a05-63a4-4f7f-ac75-1818dc5e2df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:33.041324 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4a8a05-63a4-4f7f-ac75-1818dc5e2df8 admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:33.042014 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4a8a05-63a4-4f7f-ac75-1818dc5e2df8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:33.043924 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4a8a05-63a4-4f7f-ac75-1818dc5e2df8 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:33.051539 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1393/2762] 10.222.0.86 () {60 vars in 1482 bytes} [Tue Jun 7 14:50:33 2022] PUT /identity/v3/projects/377f6d15dd9946feaf178fa42afdb11d/users/929854f300aa4489a48c2bc64370c7c2/roles/e3bf6239f5bf477b965704b086786f11 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:50:33.062464 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d135258-104f-453e-add7-6d6a7919cd4f None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:33.062782 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d135258-104f-453e-add7-6d6a7919cd4f None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:33.063068 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d135258-104f-453e-add7-6d6a7919cd4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:33.088993 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-6d135258-104f-453e-add7-6d6a7919cd4f None None] MFA Rules not processed for user `929854f300aa4489a48c2bc64370c7c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:50:33.090225 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-6d135258-104f-453e-add7-6d6a7919cd4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:33.122929 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:50:33.157455 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1394/2763] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:50:33 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 14:50:33.167227 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1370/2764] 10.222.0.86 () {60 vars in 1143 bytes} [Tue Jun 7 14:50:32 2022] POST /identity/v3/users => generated 289 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 14:50:33.169822 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d135258-104f-453e-add7-6d6a7919cd4f None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:33.171207 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-6d135258-104f-453e-add7-6d6a7919cd4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:33.173843 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4a8a05-63a4-4f7f-ac75-1818dc5e2df8 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:33.184020 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4a8a05-63a4-4f7f-ac75-1818dc5e2df8 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:33.187979 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:50:33.228404 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d135258-104f-453e-add7-6d6a7919cd4f None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:33.233007 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186752a2-64c5-4c7e-a10e-d5e1e8eda245 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af5a95620a4b43538abfe09eed4bf115', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:33.233603 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186752a2-64c5-4c7e-a10e-d5e1e8eda245 service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:33.233891 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186752a2-64c5-4c7e-a10e-d5e1e8eda245 service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:33.234172 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186752a2-64c5-4c7e-a10e-d5e1e8eda245 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:33.241881 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea7cabf-1e57-471b-bec2-c90860c01510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:33.242708 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea7cabf-1e57-471b-bec2-c90860c01510 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:33.242989 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea7cabf-1e57-471b-bec2-c90860c01510 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:33.243263 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea7cabf-1e57-471b-bec2-c90860c01510 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:33.243458 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186752a2-64c5-4c7e-a10e-d5e1e8eda245 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:33.244024 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea7cabf-1e57-471b-bec2-c90860c01510 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:33.244920 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186752a2-64c5-4c7e-a10e-d5e1e8eda245 service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:33.245601 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea7cabf-1e57-471b-bec2-c90860c01510 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:33.254195 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1395/2765] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:50:33 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:50:33.255624 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1371/2766] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:50:33 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:50:33.259706 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186752a2-64c5-4c7e-a10e-d5e1e8eda245 service cinder] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:33.271170 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186752a2-64c5-4c7e-a10e-d5e1e8eda245 service cinder] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:33.275701 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bebc3db-b758-4ac5-aa02-1cfb8195ed01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:33.276378 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bebc3db-b758-4ac5-aa02-1cfb8195ed01 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:33.276666 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bebc3db-b758-4ac5-aa02-1cfb8195ed01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:33.276955 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bebc3db-b758-4ac5-aa02-1cfb8195ed01 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:33.277654 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bebc3db-b758-4ac5-aa02-1cfb8195ed01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:33.279225 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bebc3db-b758-4ac5-aa02-1cfb8195ed01 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:33.289681 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1396/2767] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:50:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:50:33.293967 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea7cabf-1e57-471b-bec2-c90860c01510 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:33.304737 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea7cabf-1e57-471b-bec2-c90860c01510 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:33.309397 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086e3b76-e24e-4bf7-9a8a-e22224dd8fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:33.310269 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086e3b76-e24e-4bf7-9a8a-e22224dd8fc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:33.310556 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086e3b76-e24e-4bf7-9a8a-e22224dd8fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:33.310839 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086e3b76-e24e-4bf7-9a8a-e22224dd8fc1 admin admin] PATH_INFO: `/v3/projects/93c025f874c540b3bb6f3943388ae62b/users/69e6774f6eaa41589def436a381f1132/roles/c17acc2a8bb348f59ba7edd22fcf0c47` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:33.326341 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086e3b76-e24e-4bf7-9a8a-e22224dd8fc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93c025f874c540b3bb6f3943388ae62b, user_id=69e6774f6eaa41589def436a381f1132, role_id=c17acc2a8bb348f59ba7edd22fcf0c47)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:33.329010 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086e3b76-e24e-4bf7-9a8a-e22224dd8fc1 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:33.551538 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bebc3db-b758-4ac5-aa02-1cfb8195ed01 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:33.562070 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bebc3db-b758-4ac5-aa02-1cfb8195ed01 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:33.565932 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d2f283-9b48-4a54-a9d7-fa1a75d3ae05 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af5a95620a4b43538abfe09eed4bf115', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:33.566574 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d2f283-9b48-4a54-a9d7-fa1a75d3ae05 service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:33.566866 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d2f283-9b48-4a54-a9d7-fa1a75d3ae05 service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:33.567145 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d2f283-9b48-4a54-a9d7-fa1a75d3ae05 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:33.569007 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-80d2f283-9b48-4a54-a9d7-fa1a75d3ae05 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:33.572400 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1372/2768] 10.222.0.86 () {60 vars in 1482 bytes} [Tue Jun 7 14:50:33 2022] PUT /identity/v3/projects/93c025f874c540b3bb6f3943388ae62b/users/69e6774f6eaa41589def436a381f1132/roles/c17acc2a8bb348f59ba7edd22fcf0c47 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:50:33.582684 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9535d420-db74-4266-82f4-6ecca50a04bd None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:33.583067 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9535d420-db74-4266-82f4-6ecca50a04bd None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:33.583283 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9535d420-db74-4266-82f4-6ecca50a04bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:33.609454 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-9535d420-db74-4266-82f4-6ecca50a04bd None None] MFA Rules not processed for user `69e6774f6eaa41589def436a381f1132`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:50:33.610660 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-9535d420-db74-4266-82f4-6ecca50a04bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:33.633846 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d2f283-9b48-4a54-a9d7-fa1a75d3ae05 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:33.635748 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d2f283-9b48-4a54-a9d7-fa1a75d3ae05 service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:33.645351 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1397/2769] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:50:33 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 14:50:33.678157 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1373/2770] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:50:33 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 14:50:33.684105 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d2f283-9b48-4a54-a9d7-fa1a75d3ae05 service cinder] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:33.695123 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d2f283-9b48-4a54-a9d7-fa1a75d3ae05 service cinder] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:33.751138 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62d88ba-1770-4e31-836a-31f01cc9085d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:33.751817 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62d88ba-1770-4e31-836a-31f01cc9085d admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:33.752105 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62d88ba-1770-4e31-836a-31f01cc9085d admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:33.752424 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62d88ba-1770-4e31-836a-31f01cc9085d admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:33.753085 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62d88ba-1770-4e31-836a-31f01cc9085d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:33.755040 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62d88ba-1770-4e31-836a-31f01cc9085d admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:33.758417 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:50:33.870966 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1398/2771] 10.222.0.86 () {60 vars in 1152 bytes} [Tue Jun 7 14:50:33 2022] POST /identity/v3/projects => generated 375 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:50:33.880476 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9535d420-db74-4266-82f4-6ecca50a04bd None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:33.891587 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9535d420-db74-4266-82f4-6ecca50a04bd None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:33.949100 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4576f9-65c0-44b6-ba78-b6d6392215f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:33.949768 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4576f9-65c0-44b6-ba78-b6d6392215f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:33.950057 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4576f9-65c0-44b6-ba78-b6d6392215f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:33.950356 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4576f9-65c0-44b6-ba78-b6d6392215f1 admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:33.951028 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4576f9-65c0-44b6-ba78-b6d6392215f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:33.952986 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4576f9-65c0-44b6-ba78-b6d6392215f1 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:34.063257 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:50:34.069957 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1374/2772] 10.222.0.86 () {60 vars in 1143 bytes} [Tue Jun 7 14:50:33 2022] POST /identity/v3/users => generated 288 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:50:34.075517 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62d88ba-1770-4e31-836a-31f01cc9085d admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:34.086363 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62d88ba-1770-4e31-836a-31f01cc9085d admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:34.091386 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22a4b0b-ea71-4add-b5e8-999e84e7ba06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:34.092090 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22a4b0b-ea71-4add-b5e8-999e84e7ba06 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:34.092377 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22a4b0b-ea71-4add-b5e8-999e84e7ba06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:34.092650 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22a4b0b-ea71-4add-b5e8-999e84e7ba06 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:34.093377 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22a4b0b-ea71-4add-b5e8-999e84e7ba06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:34.094950 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22a4b0b-ea71-4add-b5e8-999e84e7ba06 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:34.106288 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1399/2773] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:50:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:50:34.118710 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4576f9-65c0-44b6-ba78-b6d6392215f1 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:34.129279 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4576f9-65c0-44b6-ba78-b6d6392215f1 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:34.134225 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06443e33-6baf-4797-af24-48ead591ad7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:34.134900 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06443e33-6baf-4797-af24-48ead591ad7f admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:34.135398 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06443e33-6baf-4797-af24-48ead591ad7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:34.135922 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06443e33-6baf-4797-af24-48ead591ad7f admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:34.137084 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06443e33-6baf-4797-af24-48ead591ad7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:34.138752 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06443e33-6baf-4797-af24-48ead591ad7f admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:34.149086 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1375/2774] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:50:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:50:34.153166 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22a4b0b-ea71-4add-b5e8-999e84e7ba06 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:34.163572 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22a4b0b-ea71-4add-b5e8-999e84e7ba06 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:34.168210 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e379cd-4549-4a3b-9e86-23540bc3ddc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:34.169082 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e379cd-4549-4a3b-9e86-23540bc3ddc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:34.169374 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e379cd-4549-4a3b-9e86-23540bc3ddc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:34.169653 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e379cd-4549-4a3b-9e86-23540bc3ddc4 admin admin] PATH_INFO: `/v3/projects/baeb896b9f394112b16c0b8160610eaa/users/d70e9becd0154a439ec8b70b166f9da8/roles/c17acc2a8bb348f59ba7edd22fcf0c47` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:34.185698 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e379cd-4549-4a3b-9e86-23540bc3ddc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=baeb896b9f394112b16c0b8160610eaa, user_id=d70e9becd0154a439ec8b70b166f9da8, role_id=c17acc2a8bb348f59ba7edd22fcf0c47)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:34.191455 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e379cd-4549-4a3b-9e86-23540bc3ddc4 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:34.192409 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06443e33-6baf-4797-af24-48ead591ad7f admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:34.202378 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06443e33-6baf-4797-af24-48ead591ad7f admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:34.207558 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7960d31-7d54-494d-b14e-6218c5af5f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:34.208507 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7960d31-7d54-494d-b14e-6218c5af5f29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:34.208785 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7960d31-7d54-494d-b14e-6218c5af5f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:34.209055 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7960d31-7d54-494d-b14e-6218c5af5f29 admin admin] PATH_INFO: `/v3/users/c31ea394d5054d72a1edeb71bf9480f8` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:34.210243 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7960d31-7d54-494d-b14e-6218c5af5f29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c31ea394d5054d72a1edeb71bf9480f8)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:34.212171 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7960d31-7d54-494d-b14e-6218c5af5f29 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:34.306774 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1400/2775] 10.222.0.86 () {60 vars in 1482 bytes} [Tue Jun 7 14:50:34 2022] PUT /identity/v3/projects/baeb896b9f394112b16c0b8160610eaa/users/d70e9becd0154a439ec8b70b166f9da8/roles/c17acc2a8bb348f59ba7edd22fcf0c47 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:50:34.372561 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2160f7-cd68-4cf6-906f-a04c468dee3e None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:34.372767 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-b7960d31-7d54-494d-b14e-6218c5af5f29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c31ea394d5054d72a1edeb71bf9480f8'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:34.372911 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2160f7-cd68-4cf6-906f-a04c468dee3e None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:34.373028 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2160f7-cd68-4cf6-906f-a04c468dee3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:34.381430 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-b7960d31-7d54-494d-b14e-6218c5af5f29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c31ea394d5054d72a1edeb71bf9480f8'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:34.382144 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-b7960d31-7d54-494d-b14e-6218c5af5f29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c31ea394d5054d72a1edeb71bf9480f8'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:34.395295 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-b7960d31-7d54-494d-b14e-6218c5af5f29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c31ea394d5054d72a1edeb71bf9480f8'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:34.396019 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-b7960d31-7d54-494d-b14e-6218c5af5f29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c31ea394d5054d72a1edeb71bf9480f8'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:34.400361 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-fc2160f7-cd68-4cf6-906f-a04c468dee3e None None] MFA Rules not processed for user `d70e9becd0154a439ec8b70b166f9da8`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:50:34.401580 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-fc2160f7-cd68-4cf6-906f-a04c468dee3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:34.463968 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1401/2776] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:50:34 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 14:50:34.468586 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2160f7-cd68-4cf6-906f-a04c468dee3e None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:34.469955 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-fc2160f7-cd68-4cf6-906f-a04c468dee3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:34.472856 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1376/2777] 10.222.0.86 () {58 vars in 1223 bytes} [Tue Jun 7 14:50:34 2022] DELETE /identity/v3/users/c31ea394d5054d72a1edeb71bf9480f8 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:50:34.477708 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f2e6f9-a56d-457c-80d8-363aa1b0e337 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:34.478034 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f2e6f9-a56d-457c-80d8-363aa1b0e337 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:34.478314 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f2e6f9-a56d-457c-80d8-363aa1b0e337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:34.494790 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-60f2e6f9-a56d-457c-80d8-363aa1b0e337 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:50:34.496248 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-60f2e6f9-a56d-457c-80d8-363aa1b0e337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:34.535531 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2160f7-cd68-4cf6-906f-a04c468dee3e None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:34.556802 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1377/2778] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:50:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 14:50:34.566897 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f2e6f9-a56d-457c-80d8-363aa1b0e337 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:34.568425 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-60f2e6f9-a56d-457c-80d8-363aa1b0e337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:34.579252 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:50:34.592450 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8a519d-a7b3-4873-81a3-d27aa81e29ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:34.593108 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8a519d-a7b3-4873-81a3-d27aa81e29ab admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:34.593390 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8a519d-a7b3-4873-81a3-d27aa81e29ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:34.593664 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8a519d-a7b3-4873-81a3-d27aa81e29ab admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:34.594351 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8a519d-a7b3-4873-81a3-d27aa81e29ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:34.596366 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8a519d-a7b3-4873-81a3-d27aa81e29ab admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:34.623826 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f2e6f9-a56d-457c-80d8-363aa1b0e337 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:34.627405 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f18472d-0478-487b-82c6-4689399bf8f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dda603ec5517460a83c333db2af804d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:34.628085 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f18472d-0478-487b-82c6-4689399bf8f3 service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:34.628370 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f18472d-0478-487b-82c6-4689399bf8f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:34.628648 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f18472d-0478-487b-82c6-4689399bf8f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:34.638548 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f18472d-0478-487b-82c6-4689399bf8f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:34.640014 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f18472d-0478-487b-82c6-4689399bf8f3 service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:34.650180 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1378/2779] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:50:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 14:50:34.717617 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1402/2780] 10.222.0.86 () {60 vars in 1152 bytes} [Tue Jun 7 14:50:34 2022] POST /identity/v3/projects => generated 377 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 14:50:34.718820 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f18472d-0478-487b-82c6-4689399bf8f3 service neutron] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:34.723859 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:50:34.729093 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f18472d-0478-487b-82c6-4689399bf8f3 service neutron] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:34.784547 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db7d4f5-0626-4ee6-bb05-c150d64a4615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:34.785237 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db7d4f5-0626-4ee6-bb05-c150d64a4615 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:34.785523 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db7d4f5-0626-4ee6-bb05-c150d64a4615 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:34.786163 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db7d4f5-0626-4ee6-bb05-c150d64a4615 admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:34.787092 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db7d4f5-0626-4ee6-bb05-c150d64a4615 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:34.789177 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db7d4f5-0626-4ee6-bb05-c150d64a4615 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:34.912186 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1379/2781] 10.222.0.86 () {60 vars in 1143 bytes} [Tue Jun 7 14:50:34 2022] POST /identity/v3/users => generated 295 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:50:34.913481 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8a519d-a7b3-4873-81a3-d27aa81e29ab admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:34.923919 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8a519d-a7b3-4873-81a3-d27aa81e29ab admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:34.929513 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a11aef-a4bb-487b-9aff-27a8b4fff6f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:34.930340 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a11aef-a4bb-487b-9aff-27a8b4fff6f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:34.930668 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a11aef-a4bb-487b-9aff-27a8b4fff6f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:34.930945 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a11aef-a4bb-487b-9aff-27a8b4fff6f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:34.931676 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a11aef-a4bb-487b-9aff-27a8b4fff6f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:34.933277 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a11aef-a4bb-487b-9aff-27a8b4fff6f3 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:34.944682 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1403/2782] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:50:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:50:34.949264 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db7d4f5-0626-4ee6-bb05-c150d64a4615 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:34.960014 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db7d4f5-0626-4ee6-bb05-c150d64a4615 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:34.964853 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3129d4a-b08c-487b-a070-b99886c45405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:34.965803 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3129d4a-b08c-487b-a070-b99886c45405 admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:34.966118 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3129d4a-b08c-487b-a070-b99886c45405 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:34.966364 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3129d4a-b08c-487b-a070-b99886c45405 admin admin] PATH_INFO: `/v3/projects/4e6b7ed0690f41adba9f13aabe1047d1/users/d3b2330c65e7400c93083de5b54ba655/roles/e3bf6239f5bf477b965704b086786f11` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:34.981346 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3129d4a-b08c-487b-a070-b99886c45405 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e6b7ed0690f41adba9f13aabe1047d1, user_id=d3b2330c65e7400c93083de5b54ba655, role_id=e3bf6239f5bf477b965704b086786f11)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:34.984037 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3129d4a-b08c-487b-a070-b99886c45405 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:35.116056 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a11aef-a4bb-487b-9aff-27a8b4fff6f3 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:35.119288 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-a9a11aef-a4bb-487b-9aff-27a8b4fff6f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:35.134506 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a11aef-a4bb-487b-9aff-27a8b4fff6f3 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:35.142893 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3b16cf-af80-4438-be25-28a7418660cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:35.143730 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3b16cf-af80-4438-be25-28a7418660cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:35.144045 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3b16cf-af80-4438-be25-28a7418660cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:35.146492 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3b16cf-af80-4438-be25-28a7418660cc admin admin] PATH_INFO: `/v3/projects/3c411d21a63f42a380f9430895c135a5` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:35.146492 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3b16cf-af80-4438-be25-28a7418660cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c411d21a63f42a380f9430895c135a5)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:35.147442 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3b16cf-af80-4438-be25-28a7418660cc admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:35.150497 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1380/2783] 10.222.0.86 () {60 vars in 1482 bytes} [Tue Jun 7 14:50:34 2022] PUT /identity/v3/projects/4e6b7ed0690f41adba9f13aabe1047d1/users/d3b2330c65e7400c93083de5b54ba655/roles/e3bf6239f5bf477b965704b086786f11 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:50:35.154513 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3129d4a-b08c-487b-a070-b99886c45405 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:35.217733 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3129d4a-b08c-487b-a070-b99886c45405 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:35.222483 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd07acf-03d2-4881-826b-8372a03f7ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:35.223663 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd07acf-03d2-4881-826b-8372a03f7ec1 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:35.228484 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd07acf-03d2-4881-826b-8372a03f7ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:35.228484 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd07acf-03d2-4881-826b-8372a03f7ec1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:35.228484 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd07acf-03d2-4881-826b-8372a03f7ec1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:35.228484 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd07acf-03d2-4881-826b-8372a03f7ec1 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:35.236956 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1381/2784] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:50:35 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 07 14:50:35.241602 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd07acf-03d2-4881-826b-8372a03f7ec1 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:35.250936 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd07acf-03d2-4881-826b-8372a03f7ec1 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:35.263516 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-dd3b16cf-af80-4438-be25-28a7418660cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c411d21a63f42a380f9430895c135a5', 'request_id': 'req-dd3b16cf-af80-4438-be25-28a7418660cc'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:35.269749 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-dd3b16cf-af80-4438-be25-28a7418660cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c411d21a63f42a380f9430895c135a5', 'request_id': 'req-dd3b16cf-af80-4438-be25-28a7418660cc'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:35.308159 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dd4edf-7f1c-4d5b-ac71-e80d467cdec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:35.309048 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dd4edf-7f1c-4d5b-ac71-e80d467cdec4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:35.309337 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dd4edf-7f1c-4d5b-ac71-e80d467cdec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:35.309619 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dd4edf-7f1c-4d5b-ac71-e80d467cdec4 admin admin] PATH_INFO: `/v3/projects/4e6b7ed0690f41adba9f13aabe1047d1/users/d3b2330c65e7400c93083de5b54ba655/roles/e3bf6239f5bf477b965704b086786f11` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:35.311694 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dd4edf-7f1c-4d5b-ac71-e80d467cdec4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e6b7ed0690f41adba9f13aabe1047d1, user_id=d3b2330c65e7400c93083de5b54ba655, role_id=e3bf6239f5bf477b965704b086786f11)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:35.314329 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dd4edf-7f1c-4d5b-ac71-e80d467cdec4 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:35.319825 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:50:35.325789 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1382/2785] 10.222.0.86 () {60 vars in 1482 bytes} [Tue Jun 7 14:50:35 2022] PUT /identity/v3/projects/4e6b7ed0690f41adba9f13aabe1047d1/users/d3b2330c65e7400c93083de5b54ba655/roles/e3bf6239f5bf477b965704b086786f11 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 14:50:35.334834 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9980a72f-c0ef-40ee-bd66-2c2e405a5302 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:35.335127 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9980a72f-c0ef-40ee-bd66-2c2e405a5302 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:35.335425 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9980a72f-c0ef-40ee-bd66-2c2e405a5302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:35.342507 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-dd3b16cf-af80-4438-be25-28a7418660cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c411d21a63f42a380f9430895c135a5', 'request_id': 'req-dd3b16cf-af80-4438-be25-28a7418660cc'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:35.356346 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-dd3b16cf-af80-4438-be25-28a7418660cc admin admin] The token cache is being invalidate because project 3c411d21a63f42a380f9430895c135a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:50:35.356673 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-dd3b16cf-af80-4438-be25-28a7418660cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:35.357356 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-dd3b16cf-af80-4438-be25-28a7418660cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:35.358919 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1404/2786] 10.222.0.86 () {58 vars in 1232 bytes} [Tue Jun 7 14:50:35 2022] DELETE /identity/v3/projects/3c411d21a63f42a380f9430895c135a5 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 14:50:35.361397 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-9980a72f-c0ef-40ee-bd66-2c2e405a5302 None None] MFA Rules not processed for user `d3b2330c65e7400c93083de5b54ba655`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:50:35.365955 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-9980a72f-c0ef-40ee-bd66-2c2e405a5302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:35.369295 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3b16cf-af80-4438-be25-28a7418660cc admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:35.370661 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-dd3b16cf-af80-4438-be25-28a7418660cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:35.383442 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3b16cf-af80-4438-be25-28a7418660cc admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:35.431875 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1383/2787] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:50:35 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 14:50:35.443573 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9980a72f-c0ef-40ee-bd66-2c2e405a5302 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:35.444863 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4e19bb-d378-4762-b267-ec7603c1eef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:35.445644 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-9980a72f-c0ef-40ee-bd66-2c2e405a5302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:35.445812 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4e19bb-d378-4762-b267-ec7603c1eef2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:35.446051 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4e19bb-d378-4762-b267-ec7603c1eef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:35.446331 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4e19bb-d378-4762-b267-ec7603c1eef2 admin admin] PATH_INFO: `/v3/users/929854f300aa4489a48c2bc64370c7c2` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:35.447560 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4e19bb-d378-4762-b267-ec7603c1eef2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=929854f300aa4489a48c2bc64370c7c2)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:35.449513 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4e19bb-d378-4762-b267-ec7603c1eef2 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:35.501835 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9980a72f-c0ef-40ee-bd66-2c2e405a5302 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:35.506179 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296d8893-416f-44bc-aa9f-bff9bd0520b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af5a95620a4b43538abfe09eed4bf115', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:35.506821 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296d8893-416f-44bc-aa9f-bff9bd0520b4 service cinder] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:35.507115 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296d8893-416f-44bc-aa9f-bff9bd0520b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:35.507395 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296d8893-416f-44bc-aa9f-bff9bd0520b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:35.509503 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-296d8893-416f-44bc-aa9f-bff9bd0520b4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:35.567721 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296d8893-416f-44bc-aa9f-bff9bd0520b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:35.569174 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296d8893-416f-44bc-aa9f-bff9bd0520b4 service cinder] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:35.577984 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1384/2788] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:50:35 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 14:50:35.789851 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=84,keystone:INSERT=2,keystone:DELETE=14 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:50:35.793021 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-ef4e19bb-d378-4762-b267-ec7603c1eef2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '929854f300aa4489a48c2bc64370c7c2'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:35.793021 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-ef4e19bb-d378-4762-b267-ec7603c1eef2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '929854f300aa4489a48c2bc64370c7c2'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:35.799109 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-ef4e19bb-d378-4762-b267-ec7603c1eef2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '929854f300aa4489a48c2bc64370c7c2'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:35.811400 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-ef4e19bb-d378-4762-b267-ec7603c1eef2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '929854f300aa4489a48c2bc64370c7c2'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:35.812174 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-ef4e19bb-d378-4762-b267-ec7603c1eef2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '929854f300aa4489a48c2bc64370c7c2'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:35.908126 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1405/2789] 10.222.0.86 () {58 vars in 1223 bytes} [Tue Jun 7 14:50:35 2022] DELETE /identity/v3/users/929854f300aa4489a48c2bc64370c7c2 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 14:50:36.376166 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296d8893-416f-44bc-aa9f-bff9bd0520b4 service cinder] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:36.405056 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296d8893-416f-44bc-aa9f-bff9bd0520b4 service cinder] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:36.442565 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:50:36.465951 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fc2d7a-09a1-44d0-870d-646cb97bcec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:36.466668 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fc2d7a-09a1-44d0-870d-646cb97bcec3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:36.466951 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fc2d7a-09a1-44d0-870d-646cb97bcec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:36.467227 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fc2d7a-09a1-44d0-870d-646cb97bcec3 admin admin] PATH_INFO: `/v3/projects/377f6d15dd9946feaf178fa42afdb11d` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:36.468561 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fc2d7a-09a1-44d0-870d-646cb97bcec3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=377f6d15dd9946feaf178fa42afdb11d)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:36.470470 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fc2d7a-09a1-44d0-870d-646cb97bcec3 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:36.611662 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-86fc2d7a-09a1-44d0-870d-646cb97bcec3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '377f6d15dd9946feaf178fa42afdb11d', 'request_id': 'req-86fc2d7a-09a1-44d0-870d-646cb97bcec3'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:36.618401 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-86fc2d7a-09a1-44d0-870d-646cb97bcec3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '377f6d15dd9946feaf178fa42afdb11d', 'request_id': 'req-86fc2d7a-09a1-44d0-870d-646cb97bcec3'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:36.685349 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-86fc2d7a-09a1-44d0-870d-646cb97bcec3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '377f6d15dd9946feaf178fa42afdb11d', 'request_id': 'req-86fc2d7a-09a1-44d0-870d-646cb97bcec3'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:36.696026 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-86fc2d7a-09a1-44d0-870d-646cb97bcec3 admin admin] The token cache is being invalidate because project 377f6d15dd9946feaf178fa42afdb11d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:50:36.696312 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-86fc2d7a-09a1-44d0-870d-646cb97bcec3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:36.696927 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-86fc2d7a-09a1-44d0-870d-646cb97bcec3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:36.698463 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1385/2790] 10.222.0.86 () {58 vars in 1232 bytes} [Tue Jun 7 14:50:36 2022] DELETE /identity/v3/projects/377f6d15dd9946feaf178fa42afdb11d => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:50:36.703277 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2f08aa-35a6-4db6-ac83-bc76090e5c93 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:36.703742 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2f08aa-35a6-4db6-ac83-bc76090e5c93 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:36.703884 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2f08aa-35a6-4db6-ac83-bc76090e5c93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:36.722306 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-4b2f08aa-35a6-4db6-ac83-bc76090e5c93 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:50:36.725285 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-4b2f08aa-35a6-4db6-ac83-bc76090e5c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:36.780102 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1406/2791] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:50:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:50:36.788299 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31a9742-71db-4f1d-abaa-e14c8c49f9be None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:36.788593 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31a9742-71db-4f1d-abaa-e14c8c49f9be None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:36.788872 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31a9742-71db-4f1d-abaa-e14c8c49f9be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:36.807512 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-e31a9742-71db-4f1d-abaa-e14c8c49f9be None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:50:36.808757 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-e31a9742-71db-4f1d-abaa-e14c8c49f9be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:36.817159 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1386/2792] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:50:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:50:36.821173 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2f08aa-35a6-4db6-ac83-bc76090e5c93 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:36.831180 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2f08aa-35a6-4db6-ac83-bc76090e5c93 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:36.836294 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e7540c-ddc5-46e7-b76f-eced0857c898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:36.836940 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e7540c-ddc5-46e7-b76f-eced0857c898 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:36.839817 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e7540c-ddc5-46e7-b76f-eced0857c898 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:36.839817 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e7540c-ddc5-46e7-b76f-eced0857c898 admin admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:36.839817 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e7540c-ddc5-46e7-b76f-eced0857c898 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:50:36.839817 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e7540c-ddc5-46e7-b76f-eced0857c898 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:36.840216 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e7540c-ddc5-46e7-b76f-eced0857c898 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:36.852368 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1407/2793] 10.222.0.86 () {58 vars in 1152 bytes} [Tue Jun 7 14:50:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:50:36.856651 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31a9742-71db-4f1d-abaa-e14c8c49f9be None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:36.866570 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31a9742-71db-4f1d-abaa-e14c8c49f9be None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:36.871994 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a1a881-c04f-49ab-94f0-e54856f43aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:36.872593 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a1a881-c04f-49ab-94f0-e54856f43aa1 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:36.872880 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a1a881-c04f-49ab-94f0-e54856f43aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:36.873158 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a1a881-c04f-49ab-94f0-e54856f43aa1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:36.873883 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a1a881-c04f-49ab-94f0-e54856f43aa1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:36.875802 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a1a881-c04f-49ab-94f0-e54856f43aa1 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:36.962002 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1387/2794] 10.222.0.86 () {60 vars in 1152 bytes} [Tue Jun 7 14:50:36 2022] POST /identity/v3/projects => generated 375 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:50:36.966275 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e7540c-ddc5-46e7-b76f-eced0857c898 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:36.976747 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e7540c-ddc5-46e7-b76f-eced0857c898 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:37.031064 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe46e844-af41-4439-806a-7dd457a2d6e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:37.031717 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe46e844-af41-4439-806a-7dd457a2d6e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:37.032033 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe46e844-af41-4439-806a-7dd457a2d6e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:37.032309 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe46e844-af41-4439-806a-7dd457a2d6e4 admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:37.033000 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe46e844-af41-4439-806a-7dd457a2d6e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:37.034880 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe46e844-af41-4439-806a-7dd457a2d6e4 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:37.142879 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1408/2795] 10.222.0.86 () {60 vars in 1143 bytes} [Tue Jun 7 14:50:36 2022] POST /identity/v3/users => generated 288 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:50:37.147224 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a1a881-c04f-49ab-94f0-e54856f43aa1 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:37.157625 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a1a881-c04f-49ab-94f0-e54856f43aa1 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:37.162996 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88349fcb-1a84-4890-8f45-ac33796536d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:37.163646 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88349fcb-1a84-4890-8f45-ac33796536d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:37.163966 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88349fcb-1a84-4890-8f45-ac33796536d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:37.164246 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88349fcb-1a84-4890-8f45-ac33796536d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:37.164978 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88349fcb-1a84-4890-8f45-ac33796536d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:37.166560 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88349fcb-1a84-4890-8f45-ac33796536d4 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:37.176863 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1388/2796] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:50:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:50:37.180685 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe46e844-af41-4439-806a-7dd457a2d6e4 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:37.190591 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe46e844-af41-4439-806a-7dd457a2d6e4 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:37.195170 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85e519f-32cc-4164-a4f3-607adac0f4e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:37.195845 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85e519f-32cc-4164-a4f3-607adac0f4e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:37.196128 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85e519f-32cc-4164-a4f3-607adac0f4e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:37.196402 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85e519f-32cc-4164-a4f3-607adac0f4e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:37.201798 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85e519f-32cc-4164-a4f3-607adac0f4e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:37.201798 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85e519f-32cc-4164-a4f3-607adac0f4e6 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:37.210836 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1409/2797] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:50:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:50:37.214849 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88349fcb-1a84-4890-8f45-ac33796536d4 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:37.225198 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88349fcb-1a84-4890-8f45-ac33796536d4 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:37.229703 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2871c2-6894-4e41-b6d7-3a81ec286ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:37.230581 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2871c2-6894-4e41-b6d7-3a81ec286ae3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:37.233171 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2871c2-6894-4e41-b6d7-3a81ec286ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:37.233171 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2871c2-6894-4e41-b6d7-3a81ec286ae3 admin admin] PATH_INFO: `/v3/projects/d221779518e44f2397e161e42747e127/users/0926d8dacfd548c8b64316d59cfae7fe/roles/c17acc2a8bb348f59ba7edd22fcf0c47` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:37.245791 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2871c2-6894-4e41-b6d7-3a81ec286ae3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d221779518e44f2397e161e42747e127, user_id=0926d8dacfd548c8b64316d59cfae7fe, role_id=c17acc2a8bb348f59ba7edd22fcf0c47)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:37.248504 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2871c2-6894-4e41-b6d7-3a81ec286ae3 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:37.324269 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1389/2798] 10.222.0.86 () {60 vars in 1482 bytes} [Tue Jun 7 14:50:37 2022] PUT /identity/v3/projects/d221779518e44f2397e161e42747e127/users/0926d8dacfd548c8b64316d59cfae7fe/roles/c17acc2a8bb348f59ba7edd22fcf0c47 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:50:37.334988 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8dfa18-80f7-43db-b92f-d6f0cf3f0ef9 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:37.335287 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8dfa18-80f7-43db-b92f-d6f0cf3f0ef9 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:37.335572 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8dfa18-80f7-43db-b92f-d6f0cf3f0ef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:37.361570 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-ae8dfa18-80f7-43db-b92f-d6f0cf3f0ef9 None None] MFA Rules not processed for user `0926d8dacfd548c8b64316d59cfae7fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:50:37.362810 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-ae8dfa18-80f7-43db-b92f-d6f0cf3f0ef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:37.380149 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:50:37.426120 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1410/2799] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:50:37 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:50:37.430835 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2871c2-6894-4e41-b6d7-3a81ec286ae3 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:37.504372 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2871c2-6894-4e41-b6d7-3a81ec286ae3 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:37.508879 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb0d5ed-2576-4975-b39a-df64103af1ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:37.509531 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb0d5ed-2576-4975-b39a-df64103af1ff admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:37.509812 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb0d5ed-2576-4975-b39a-df64103af1ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:37.510087 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb0d5ed-2576-4975-b39a-df64103af1ff admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:37.510784 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb0d5ed-2576-4975-b39a-df64103af1ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:37.512700 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb0d5ed-2576-4975-b39a-df64103af1ff admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:37.521670 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:50:37.619615 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1390/2800] 10.222.0.86 () {60 vars in 1152 bytes} [Tue Jun 7 14:50:37 2022] POST /identity/v3/projects => generated 373 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:50:37.622477 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8dfa18-80f7-43db-b92f-d6f0cf3f0ef9 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:37.633977 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8dfa18-80f7-43db-b92f-d6f0cf3f0ef9 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:37.689785 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f231164-d9b5-486e-becf-0039130e424c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:37.690458 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f231164-d9b5-486e-becf-0039130e424c admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:37.690742 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f231164-d9b5-486e-becf-0039130e424c admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:37.691018 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f231164-d9b5-486e-becf-0039130e424c admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:37.692418 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f231164-d9b5-486e-becf-0039130e424c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:37.694302 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f231164-d9b5-486e-becf-0039130e424c admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:37.758587 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb0d5ed-2576-4975-b39a-df64103af1ff admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:37.760298 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-2fb0d5ed-2576-4975-b39a-df64103af1ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:37.776057 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1411/2801] 10.222.0.86 () {60 vars in 1143 bytes} [Tue Jun 7 14:50:37 2022] POST /identity/v3/users => generated 293 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:50:37.779679 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f231164-d9b5-486e-becf-0039130e424c admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:37.789097 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f231164-d9b5-486e-becf-0039130e424c admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:37.793680 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870cfa95-9cbb-45b3-9846-8f392e1939db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:37.796375 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870cfa95-9cbb-45b3-9846-8f392e1939db admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:37.796375 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870cfa95-9cbb-45b3-9846-8f392e1939db admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:37.796375 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870cfa95-9cbb-45b3-9846-8f392e1939db admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:37.796375 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870cfa95-9cbb-45b3-9846-8f392e1939db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:37.797168 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870cfa95-9cbb-45b3-9846-8f392e1939db admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:37.808624 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1412/2802] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:50:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 07 14:50:37.812561 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870cfa95-9cbb-45b3-9846-8f392e1939db admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:37.817644 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb0d5ed-2576-4975-b39a-df64103af1ff admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:37.821314 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769126cb-6ff1-4b0b-a870-48152a06b0b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af5a95620a4b43538abfe09eed4bf115', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:37.821997 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769126cb-6ff1-4b0b-a870-48152a06b0b2 service cinder] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:37.822278 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769126cb-6ff1-4b0b-a870-48152a06b0b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:37.822500 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870cfa95-9cbb-45b3-9846-8f392e1939db admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:37.822642 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769126cb-6ff1-4b0b-a870-48152a06b0b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:37.824384 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-769126cb-6ff1-4b0b-a870-48152a06b0b2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:37.827143 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c14fa9-5631-464e-b48f-baa41a47a6cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:37.828031 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c14fa9-5631-464e-b48f-baa41a47a6cd admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:37.828319 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c14fa9-5631-464e-b48f-baa41a47a6cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:37.828601 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c14fa9-5631-464e-b48f-baa41a47a6cd admin admin] PATH_INFO: `/v3/projects/1e3e84da3d7b4b68b92efba64e0f4029/users/93cda181fa9d4d9587012d785bf49427/roles/e3bf6239f5bf477b965704b086786f11` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:37.842842 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c14fa9-5631-464e-b48f-baa41a47a6cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e3e84da3d7b4b68b92efba64e0f4029, user_id=93cda181fa9d4d9587012d785bf49427, role_id=e3bf6239f5bf477b965704b086786f11)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:37.846077 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c14fa9-5631-464e-b48f-baa41a47a6cd admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:37.882391 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769126cb-6ff1-4b0b-a870-48152a06b0b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:37.884172 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769126cb-6ff1-4b0b-a870-48152a06b0b2 service cinder] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:37.893034 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1391/2803] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:50:37 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 14:50:37.937061 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1413/2804] 10.222.0.86 () {60 vars in 1482 bytes} [Tue Jun 7 14:50:37 2022] PUT /identity/v3/projects/1e3e84da3d7b4b68b92efba64e0f4029/users/93cda181fa9d4d9587012d785bf49427/roles/e3bf6239f5bf477b965704b086786f11 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 14:50:37.941030 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769126cb-6ff1-4b0b-a870-48152a06b0b2 service cinder] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:37.952330 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769126cb-6ff1-4b0b-a870-48152a06b0b2 service cinder] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:38.008809 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ce10ba-b3aa-4704-b272-7d3efdec7caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:38.009525 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ce10ba-b3aa-4704-b272-7d3efdec7caf admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:38.010011 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ce10ba-b3aa-4704-b272-7d3efdec7caf admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:38.010465 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ce10ba-b3aa-4704-b272-7d3efdec7caf admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:38.011263 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ce10ba-b3aa-4704-b272-7d3efdec7caf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:38.013326 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ce10ba-b3aa-4704-b272-7d3efdec7caf admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:38.022957 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1392/2805] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:50:37 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:50:38.027193 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c14fa9-5631-464e-b48f-baa41a47a6cd admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:38.037911 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c14fa9-5631-464e-b48f-baa41a47a6cd admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:38.042515 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3a3c9e-75d6-476d-9c0e-a7e778f81edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:38.043392 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3a3c9e-75d6-476d-9c0e-a7e778f81edf admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:38.043681 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3a3c9e-75d6-476d-9c0e-a7e778f81edf admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:38.043998 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3a3c9e-75d6-476d-9c0e-a7e778f81edf admin admin] PATH_INFO: `/v3/projects/1e3e84da3d7b4b68b92efba64e0f4029/users/93cda181fa9d4d9587012d785bf49427/roles/e3bf6239f5bf477b965704b086786f11` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:38.045985 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3a3c9e-75d6-476d-9c0e-a7e778f81edf admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e3e84da3d7b4b68b92efba64e0f4029, user_id=93cda181fa9d4d9587012d785bf49427, role_id=e3bf6239f5bf477b965704b086786f11)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:38.048665 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3a3c9e-75d6-476d-9c0e-a7e778f81edf admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:38.059558 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1414/2806] 10.222.0.86 () {60 vars in 1482 bytes} [Tue Jun 7 14:50:38 2022] PUT /identity/v3/projects/1e3e84da3d7b4b68b92efba64e0f4029/users/93cda181fa9d4d9587012d785bf49427/roles/e3bf6239f5bf477b965704b086786f11 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:50:38.070956 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273c533b-2650-4baf-ab16-9635198b1f2b None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:38.071243 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273c533b-2650-4baf-ab16-9635198b1f2b None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:38.071520 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273c533b-2650-4baf-ab16-9635198b1f2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:38.097467 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-273c533b-2650-4baf-ab16-9635198b1f2b None None] MFA Rules not processed for user `93cda181fa9d4d9587012d785bf49427`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:50:38.099230 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-273c533b-2650-4baf-ab16-9635198b1f2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:38.167514 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1393/2807] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:50:38 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:50:38.178907 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3a3c9e-75d6-476d-9c0e-a7e778f81edf admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:38.180663 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-6a3a3c9e-75d6-476d-9c0e-a7e778f81edf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:38.216070 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:50:38.237307 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3a3c9e-75d6-476d-9c0e-a7e778f81edf admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:38.241479 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305adc2f-888c-464c-8ba8-7cc29d960558 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af5a95620a4b43538abfe09eed4bf115', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:38.242266 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305adc2f-888c-464c-8ba8-7cc29d960558 service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:38.242557 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305adc2f-888c-464c-8ba8-7cc29d960558 service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:38.242838 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305adc2f-888c-464c-8ba8-7cc29d960558 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:38.255086 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:50:38.301365 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305adc2f-888c-464c-8ba8-7cc29d960558 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:38.302874 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305adc2f-888c-464c-8ba8-7cc29d960558 service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:38.311707 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1415/2808] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:50:38 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:50:39.232858 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273c533b-2650-4baf-ab16-9635198b1f2b None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:39.242999 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273c533b-2650-4baf-ab16-9635198b1f2b None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:39.246511 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3828837-9321-4fb1-ba05-ffd649583833 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af5a95620a4b43538abfe09eed4bf115', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:39.247137 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3828837-9321-4fb1-ba05-ffd649583833 service cinder] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:39.247429 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3828837-9321-4fb1-ba05-ffd649583833 service cinder] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:39.247700 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3828837-9321-4fb1-ba05-ffd649583833 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:39.249470 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-b3828837-9321-4fb1-ba05-ffd649583833 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:39.310998 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3828837-9321-4fb1-ba05-ffd649583833 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:39.312453 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3828837-9321-4fb1-ba05-ffd649583833 service cinder] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:39.322448 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1394/2809] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:50:39 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:50:41.369242 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305adc2f-888c-464c-8ba8-7cc29d960558 service cinder] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:41.432528 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305adc2f-888c-464c-8ba8-7cc29d960558 service cinder] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:41.437064 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7c6648-8c78-46e3-af63-084484533d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:41.437983 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7c6648-8c78-46e3-af63-084484533d29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:41.443621 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7c6648-8c78-46e3-af63-084484533d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:41.443621 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7c6648-8c78-46e3-af63-084484533d29 admin admin] PATH_INFO: `/v3/users/0926d8dacfd548c8b64316d59cfae7fe` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:41.443621 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7c6648-8c78-46e3-af63-084484533d29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0926d8dacfd548c8b64316d59cfae7fe)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:41.443621 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7c6648-8c78-46e3-af63-084484533d29 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:41.653080 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-be7c6648-8c78-46e3-af63-084484533d29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0926d8dacfd548c8b64316d59cfae7fe'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:41.653652 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-be7c6648-8c78-46e3-af63-084484533d29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0926d8dacfd548c8b64316d59cfae7fe'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:41.660455 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-be7c6648-8c78-46e3-af63-084484533d29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0926d8dacfd548c8b64316d59cfae7fe'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:41.672131 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-be7c6648-8c78-46e3-af63-084484533d29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0926d8dacfd548c8b64316d59cfae7fe'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:41.673429 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-be7c6648-8c78-46e3-af63-084484533d29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0926d8dacfd548c8b64316d59cfae7fe'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:41.742302 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1416/2810] 10.222.0.86 () {58 vars in 1223 bytes} [Tue Jun 7 14:50:41 2022] DELETE /identity/v3/users/0926d8dacfd548c8b64316d59cfae7fe => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:50:41.746951 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfa732b-f049-4486-a7e4-b224b816b01b None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:41.748055 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfa732b-f049-4486-a7e4-b224b816b01b None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:41.748055 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfa732b-f049-4486-a7e4-b224b816b01b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:41.765310 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-fcfa732b-f049-4486-a7e4-b224b816b01b None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:50:41.771832 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-fcfa732b-f049-4486-a7e4-b224b816b01b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:41.824519 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1395/2811] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:50:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:50:41.834134 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7c6648-8c78-46e3-af63-084484533d29 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:41.835512 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-be7c6648-8c78-46e3-af63-084484533d29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:41.870290 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:50:41.891905 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7c6648-8c78-46e3-af63-084484533d29 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:41.895587 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b91e94f-38f7-440f-a814-38a08d70ca2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dda603ec5517460a83c333db2af804d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:41.896271 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b91e94f-38f7-440f-a814-38a08d70ca2a service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:41.896546 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b91e94f-38f7-440f-a814-38a08d70ca2a service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:41.896825 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b91e94f-38f7-440f-a814-38a08d70ca2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:41.906354 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b91e94f-38f7-440f-a814-38a08d70ca2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:41.907737 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b91e94f-38f7-440f-a814-38a08d70ca2a service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:41.917697 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1417/2812] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:50:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:50:42.344498 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfa732b-f049-4486-a7e4-b224b816b01b None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:42.345935 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-fcfa732b-f049-4486-a7e4-b224b816b01b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:42.359554 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfa732b-f049-4486-a7e4-b224b816b01b None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:42.364449 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1862a93-3bf1-4672-9622-f3890ddd4c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:42.365428 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1862a93-3bf1-4672-9622-f3890ddd4c52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:42.365719 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1862a93-3bf1-4672-9622-f3890ddd4c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:42.366003 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1862a93-3bf1-4672-9622-f3890ddd4c52 admin admin] PATH_INFO: `/v3/projects/d221779518e44f2397e161e42747e127` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:42.367733 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1862a93-3bf1-4672-9622-f3890ddd4c52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d221779518e44f2397e161e42747e127)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:42.370059 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1862a93-3bf1-4672-9622-f3890ddd4c52 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:42.498236 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-c1862a93-3bf1-4672-9622-f3890ddd4c52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd221779518e44f2397e161e42747e127', 'request_id': 'req-c1862a93-3bf1-4672-9622-f3890ddd4c52'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:42.504451 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-c1862a93-3bf1-4672-9622-f3890ddd4c52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd221779518e44f2397e161e42747e127', 'request_id': 'req-c1862a93-3bf1-4672-9622-f3890ddd4c52'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:42.506367 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:50:42.651358 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-c1862a93-3bf1-4672-9622-f3890ddd4c52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd221779518e44f2397e161e42747e127', 'request_id': 'req-c1862a93-3bf1-4672-9622-f3890ddd4c52'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:42.662998 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-c1862a93-3bf1-4672-9622-f3890ddd4c52 admin admin] The token cache is being invalidate because project d221779518e44f2397e161e42747e127 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:50:42.663293 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-c1862a93-3bf1-4672-9622-f3890ddd4c52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:42.664007 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-c1862a93-3bf1-4672-9622-f3890ddd4c52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:42.665629 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1396/2813] 10.222.0.86 () {58 vars in 1232 bytes} [Tue Jun 7 14:50:42 2022] DELETE /identity/v3/projects/d221779518e44f2397e161e42747e127 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:50:42.669674 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b91e94f-38f7-440f-a814-38a08d70ca2a service neutron] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:42.679475 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b91e94f-38f7-440f-a814-38a08d70ca2a service neutron] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:42.738200 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8d8685-284d-4b25-afdf-0e210bcade31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:42.743262 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8d8685-284d-4b25-afdf-0e210bcade31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:42.743262 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8d8685-284d-4b25-afdf-0e210bcade31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:42.743262 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8d8685-284d-4b25-afdf-0e210bcade31 admin admin] PATH_INFO: `/v3/users/93cda181fa9d4d9587012d785bf49427` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:42.743262 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8d8685-284d-4b25-afdf-0e210bcade31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=93cda181fa9d4d9587012d785bf49427)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:42.743262 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8d8685-284d-4b25-afdf-0e210bcade31 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:42.991071 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-6f8d8685-284d-4b25-afdf-0e210bcade31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93cda181fa9d4d9587012d785bf49427'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:42.991729 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-6f8d8685-284d-4b25-afdf-0e210bcade31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93cda181fa9d4d9587012d785bf49427'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:43.003264 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-6f8d8685-284d-4b25-afdf-0e210bcade31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93cda181fa9d4d9587012d785bf49427'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:43.016001 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-6f8d8685-284d-4b25-afdf-0e210bcade31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93cda181fa9d4d9587012d785bf49427'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:43.016679 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-6f8d8685-284d-4b25-afdf-0e210bcade31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93cda181fa9d4d9587012d785bf49427'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:43.083251 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1418/2814] 10.222.0.86 () {58 vars in 1223 bytes} [Tue Jun 7 14:50:42 2022] DELETE /identity/v3/users/93cda181fa9d4d9587012d785bf49427 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:50:43.486949 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1862a93-3bf1-4672-9622-f3890ddd4c52 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:43.489304 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-c1862a93-3bf1-4672-9622-f3890ddd4c52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:43.502863 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1862a93-3bf1-4672-9622-f3890ddd4c52 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:43.563560 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59355fb0-1763-4020-af17-f1847977f873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:43.564518 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59355fb0-1763-4020-af17-f1847977f873 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:43.564810 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59355fb0-1763-4020-af17-f1847977f873 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:43.565086 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59355fb0-1763-4020-af17-f1847977f873 admin admin] PATH_INFO: `/v3/projects/1e3e84da3d7b4b68b92efba64e0f4029` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:43.566279 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59355fb0-1763-4020-af17-f1847977f873 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e3e84da3d7b4b68b92efba64e0f4029)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:43.568274 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59355fb0-1763-4020-af17-f1847977f873 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:43.794229 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-59355fb0-1763-4020-af17-f1847977f873 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e3e84da3d7b4b68b92efba64e0f4029', 'request_id': 'req-59355fb0-1763-4020-af17-f1847977f873'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:43.800409 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-59355fb0-1763-4020-af17-f1847977f873 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e3e84da3d7b4b68b92efba64e0f4029', 'request_id': 'req-59355fb0-1763-4020-af17-f1847977f873'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:43.879214 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-59355fb0-1763-4020-af17-f1847977f873 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e3e84da3d7b4b68b92efba64e0f4029', 'request_id': 'req-59355fb0-1763-4020-af17-f1847977f873'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:43.890042 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-59355fb0-1763-4020-af17-f1847977f873 admin admin] The token cache is being invalidate because project 1e3e84da3d7b4b68b92efba64e0f4029 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:50:43.890323 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-59355fb0-1763-4020-af17-f1847977f873 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:43.890936 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-59355fb0-1763-4020-af17-f1847977f873 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:43.892492 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1397/2815] 10.222.0.86 () {58 vars in 1232 bytes} [Tue Jun 7 14:50:43 2022] DELETE /identity/v3/projects/1e3e84da3d7b4b68b92efba64e0f4029 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:50:43.899579 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628c30ad-5dc5-4af7-8c10-bc9912fdaf6e None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:43.900100 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628c30ad-5dc5-4af7-8c10-bc9912fdaf6e None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:43.900219 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628c30ad-5dc5-4af7-8c10-bc9912fdaf6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:43.918639 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-628c30ad-5dc5-4af7-8c10-bc9912fdaf6e None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:50:43.919901 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-628c30ad-5dc5-4af7-8c10-bc9912fdaf6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:43.965422 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:50:43.976509 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1419/2816] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:50:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:50:43.984135 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7287f9d8-462f-4e4a-82ff-2319eb8aa2b8 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:43.984424 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7287f9d8-462f-4e4a-82ff-2319eb8aa2b8 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:43.984699 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7287f9d8-462f-4e4a-82ff-2319eb8aa2b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:44.003051 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-7287f9d8-462f-4e4a-82ff-2319eb8aa2b8 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:50:44.004309 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-7287f9d8-462f-4e4a-82ff-2319eb8aa2b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:44.012510 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1398/2817] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:50:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:50:44.016869 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628c30ad-5dc5-4af7-8c10-bc9912fdaf6e None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:44.027564 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628c30ad-5dc5-4af7-8c10-bc9912fdaf6e None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:44.032641 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b8f347-4a48-4631-b0ff-a92acdd6a066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:44.033771 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b8f347-4a48-4631-b0ff-a92acdd6a066 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:44.034060 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b8f347-4a48-4631-b0ff-a92acdd6a066 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:44.034337 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b8f347-4a48-4631-b0ff-a92acdd6a066 admin admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:44.035586 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b8f347-4a48-4631-b0ff-a92acdd6a066 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:50:44.035936 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b8f347-4a48-4631-b0ff-a92acdd6a066 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:44.037517 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b8f347-4a48-4631-b0ff-a92acdd6a066 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:44.053501 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1420/2818] 10.222.0.86 () {58 vars in 1152 bytes} [Tue Jun 7 14:50:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:50:44.054504 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7287f9d8-462f-4e4a-82ff-2319eb8aa2b8 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:44.065250 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7287f9d8-462f-4e4a-82ff-2319eb8aa2b8 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:44.070105 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33830f08-e609-4ff5-8d5c-5d12ac52487a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:44.070926 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33830f08-e609-4ff5-8d5c-5d12ac52487a admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:44.071215 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33830f08-e609-4ff5-8d5c-5d12ac52487a admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:44.071502 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33830f08-e609-4ff5-8d5c-5d12ac52487a admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:44.072312 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33830f08-e609-4ff5-8d5c-5d12ac52487a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:44.074177 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33830f08-e609-4ff5-8d5c-5d12ac52487a admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:44.074440 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b8f347-4a48-4631-b0ff-a92acdd6a066 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:44.076180 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-65b8f347-4a48-4631-b0ff-a92acdd6a066 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:44.090188 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b8f347-4a48-4631-b0ff-a92acdd6a066 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:44.094772 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc84c2a3-5568-4cd3-ae38-ae2820ffe629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:44.095627 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc84c2a3-5568-4cd3-ae38-ae2820ffe629 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:44.095946 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc84c2a3-5568-4cd3-ae38-ae2820ffe629 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:44.101186 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc84c2a3-5568-4cd3-ae38-ae2820ffe629 admin admin] PATH_INFO: `/v3/users/69e6774f6eaa41589def436a381f1132` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:44.101186 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc84c2a3-5568-4cd3-ae38-ae2820ffe629 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69e6774f6eaa41589def436a381f1132)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:44.101186 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc84c2a3-5568-4cd3-ae38-ae2820ffe629 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:44.161816 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1399/2819] 10.222.0.86 () {60 vars in 1152 bytes} [Tue Jun 7 14:50:44 2022] POST /identity/v3/projects => generated 371 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:50:44.166051 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33830f08-e609-4ff5-8d5c-5d12ac52487a admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:44.214125 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:INSERT=3,keystone:DELETE=10,keystone:SELECT=87 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:50:44.230684 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33830f08-e609-4ff5-8d5c-5d12ac52487a admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:44.235495 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429b505d-981b-4aa7-b8b3-fad6746c04c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:44.236203 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429b505d-981b-4aa7-b8b3-fad6746c04c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:44.236494 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429b505d-981b-4aa7-b8b3-fad6746c04c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:44.237794 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429b505d-981b-4aa7-b8b3-fad6746c04c9 admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:44.237794 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429b505d-981b-4aa7-b8b3-fad6746c04c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:44.239455 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429b505d-981b-4aa7-b8b3-fad6746c04c9 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:44.271388 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-dc84c2a3-5568-4cd3-ae38-ae2820ffe629 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69e6774f6eaa41589def436a381f1132'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:44.272110 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-dc84c2a3-5568-4cd3-ae38-ae2820ffe629 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69e6774f6eaa41589def436a381f1132'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:44.279319 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-dc84c2a3-5568-4cd3-ae38-ae2820ffe629 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69e6774f6eaa41589def436a381f1132'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:44.291546 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-dc84c2a3-5568-4cd3-ae38-ae2820ffe629 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69e6774f6eaa41589def436a381f1132'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:44.295372 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-dc84c2a3-5568-4cd3-ae38-ae2820ffe629 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69e6774f6eaa41589def436a381f1132'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:44.359822 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1400/2820] 10.222.0.86 () {60 vars in 1143 bytes} [Tue Jun 7 14:50:44 2022] POST /identity/v3/users => generated 286 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 14:50:44.363672 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429b505d-981b-4aa7-b8b3-fad6746c04c9 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:44.365304 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-429b505d-981b-4aa7-b8b3-fad6746c04c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:44.376828 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429b505d-981b-4aa7-b8b3-fad6746c04c9 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:44.381440 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81087cd-bff9-44f5-a405-404a53e9b7b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:44.382277 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81087cd-bff9-44f5-a405-404a53e9b7b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:44.383102 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81087cd-bff9-44f5-a405-404a53e9b7b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:44.383889 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81087cd-bff9-44f5-a405-404a53e9b7b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:44.384581 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81087cd-bff9-44f5-a405-404a53e9b7b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:44.386272 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81087cd-bff9-44f5-a405-404a53e9b7b8 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:44.389143 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1421/2821] 10.222.0.86 () {58 vars in 1223 bytes} [Tue Jun 7 14:50:44 2022] DELETE /identity/v3/users/69e6774f6eaa41589def436a381f1132 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 14:50:44.396562 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ab29ff-5e1a-4998-85b4-e8249d0b6911 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:44.396854 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ab29ff-5e1a-4998-85b4-e8249d0b6911 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:44.397130 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ab29ff-5e1a-4998-85b4-e8249d0b6911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:44.397379 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1401/2822] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:50:44 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 07 14:50:44.401176 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81087cd-bff9-44f5-a405-404a53e9b7b8 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:44.411912 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81087cd-bff9-44f5-a405-404a53e9b7b8 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:44.419816 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-36ab29ff-5e1a-4998-85b4-e8249d0b6911 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:50:44.421812 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-36ab29ff-5e1a-4998-85b4-e8249d0b6911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:44.470907 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1c78ce-f0e2-438c-bb8f-e88f4fee9549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:44.471569 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1c78ce-f0e2-438c-bb8f-e88f4fee9549 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:44.471880 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1c78ce-f0e2-438c-bb8f-e88f4fee9549 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:44.472163 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1c78ce-f0e2-438c-bb8f-e88f4fee9549 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:44.472926 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1c78ce-f0e2-438c-bb8f-e88f4fee9549 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:44.474494 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1c78ce-f0e2-438c-bb8f-e88f4fee9549 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:44.480598 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1422/2823] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:50:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 14:50:44.484760 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1402/2824] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:50:44 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 07 14:50:44.488603 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ab29ff-5e1a-4998-85b4-e8249d0b6911 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:44.490359 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1c78ce-f0e2-438c-bb8f-e88f4fee9549 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:44.492062 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-3d1c78ce-f0e2-438c-bb8f-e88f4fee9549 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:44.498439 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ab29ff-5e1a-4998-85b4-e8249d0b6911 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:44.503315 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0c3340-5e55-4828-a65e-381a796c87e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:44.505046 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0c3340-5e55-4828-a65e-381a796c87e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:44.505335 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0c3340-5e55-4828-a65e-381a796c87e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:44.505615 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0c3340-5e55-4828-a65e-381a796c87e6 admin admin] PATH_INFO: `/v3/projects/094d37c9569b4fa59a777a9e55bb1824/users/c0f8e619568545a3a33dfcb02a872dec/roles/c17acc2a8bb348f59ba7edd22fcf0c47` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:44.521705 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0c3340-5e55-4828-a65e-381a796c87e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=094d37c9569b4fa59a777a9e55bb1824, user_id=c0f8e619568545a3a33dfcb02a872dec, role_id=c17acc2a8bb348f59ba7edd22fcf0c47)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:44.524461 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0c3340-5e55-4828-a65e-381a796c87e6 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:44.550058 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1c78ce-f0e2-438c-bb8f-e88f4fee9549 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:44.553787 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516808fa-c74d-4687-9348-32a8cb520989 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dda603ec5517460a83c333db2af804d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:44.554428 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516808fa-c74d-4687-9348-32a8cb520989 service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:44.554727 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516808fa-c74d-4687-9348-32a8cb520989 service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:44.555092 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516808fa-c74d-4687-9348-32a8cb520989 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:44.564139 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516808fa-c74d-4687-9348-32a8cb520989 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:44.565586 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516808fa-c74d-4687-9348-32a8cb520989 service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:44.575511 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1403/2825] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:50:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 14:50:44.605668 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1423/2826] 10.222.0.86 () {60 vars in 1482 bytes} [Tue Jun 7 14:50:44 2022] PUT /identity/v3/projects/094d37c9569b4fa59a777a9e55bb1824/users/c0f8e619568545a3a33dfcb02a872dec/roles/c17acc2a8bb348f59ba7edd22fcf0c47 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:50:44.610692 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f142abbb-9e45-4661-be9f-c6f5397f112e None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:44.610991 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f142abbb-9e45-4661-be9f-c6f5397f112e None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:44.611277 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f142abbb-9e45-4661-be9f-c6f5397f112e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:44.629321 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-f142abbb-9e45-4661-be9f-c6f5397f112e None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:50:44.630540 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-f142abbb-9e45-4661-be9f-c6f5397f112e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:44.689869 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1404/2827] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:50:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:50:44.700390 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0c3340-5e55-4828-a65e-381a796c87e6 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:44.702113 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-5d0c3340-5e55-4828-a65e-381a796c87e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:44.736439 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:50:44.760477 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0c3340-5e55-4828-a65e-381a796c87e6 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:44.764383 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be350b8b-ca3d-46da-b6fc-23e7b70dd6d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dda603ec5517460a83c333db2af804d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:44.765026 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be350b8b-ca3d-46da-b6fc-23e7b70dd6d4 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:44.765315 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be350b8b-ca3d-46da-b6fc-23e7b70dd6d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:44.765595 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be350b8b-ca3d-46da-b6fc-23e7b70dd6d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:44.776200 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be350b8b-ca3d-46da-b6fc-23e7b70dd6d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:44.777654 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be350b8b-ca3d-46da-b6fc-23e7b70dd6d4 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:44.787918 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1424/2828] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:50:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:50:44.966946 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f142abbb-9e45-4661-be9f-c6f5397f112e None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:44.968801 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-f142abbb-9e45-4661-be9f-c6f5397f112e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:44.979478 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:50:44.986186 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f142abbb-9e45-4661-be9f-c6f5397f112e None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:44.992494 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb9eb91-bc25-4a06-8241-34b84804a9a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:44.993452 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb9eb91-bc25-4a06-8241-34b84804a9a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:44.993741 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb9eb91-bc25-4a06-8241-34b84804a9a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:44.994171 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb9eb91-bc25-4a06-8241-34b84804a9a9 admin admin] PATH_INFO: `/v3/projects/93c025f874c540b3bb6f3943388ae62b` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:44.995550 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb9eb91-bc25-4a06-8241-34b84804a9a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=93c025f874c540b3bb6f3943388ae62b)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:44.997508 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb9eb91-bc25-4a06-8241-34b84804a9a9 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:45.122408 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-0cb9eb91-bc25-4a06-8241-34b84804a9a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93c025f874c540b3bb6f3943388ae62b', 'request_id': 'req-0cb9eb91-bc25-4a06-8241-34b84804a9a9'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:45.129449 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-0cb9eb91-bc25-4a06-8241-34b84804a9a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93c025f874c540b3bb6f3943388ae62b', 'request_id': 'req-0cb9eb91-bc25-4a06-8241-34b84804a9a9'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:45.251110 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-0cb9eb91-bc25-4a06-8241-34b84804a9a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93c025f874c540b3bb6f3943388ae62b', 'request_id': 'req-0cb9eb91-bc25-4a06-8241-34b84804a9a9'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:45.262627 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-0cb9eb91-bc25-4a06-8241-34b84804a9a9 admin admin] The token cache is being invalidate because project 93c025f874c540b3bb6f3943388ae62b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:50:45.262916 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-0cb9eb91-bc25-4a06-8241-34b84804a9a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:45.263557 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-0cb9eb91-bc25-4a06-8241-34b84804a9a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:45.265125 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1405/2829] 10.222.0.86 () {58 vars in 1232 bytes} [Tue Jun 7 14:50:44 2022] DELETE /identity/v3/projects/93c025f874c540b3bb6f3943388ae62b => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:50:45.269343 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be350b8b-ca3d-46da-b6fc-23e7b70dd6d4 service neutron] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:45.279152 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be350b8b-ca3d-46da-b6fc-23e7b70dd6d4 service neutron] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:45.339179 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42b8ebc-010b-43c0-963e-37ce1ef25ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:45.340239 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42b8ebc-010b-43c0-963e-37ce1ef25ede admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:45.340534 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42b8ebc-010b-43c0-963e-37ce1ef25ede admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:45.340782 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42b8ebc-010b-43c0-963e-37ce1ef25ede admin admin] PATH_INFO: `/v3/users/d70e9becd0154a439ec8b70b166f9da8` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:45.342760 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42b8ebc-010b-43c0-963e-37ce1ef25ede admin admin] RBAC: Authorizing `identity:delete_user(user_id=d70e9becd0154a439ec8b70b166f9da8)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:45.344883 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42b8ebc-010b-43c0-963e-37ce1ef25ede admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:45.585663 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-c42b8ebc-010b-43c0-963e-37ce1ef25ede admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd70e9becd0154a439ec8b70b166f9da8'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:45.586325 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-c42b8ebc-010b-43c0-963e-37ce1ef25ede admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd70e9becd0154a439ec8b70b166f9da8'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:45.593846 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-c42b8ebc-010b-43c0-963e-37ce1ef25ede admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd70e9becd0154a439ec8b70b166f9da8'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:45.606743 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-c42b8ebc-010b-43c0-963e-37ce1ef25ede admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd70e9becd0154a439ec8b70b166f9da8'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:45.607461 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-c42b8ebc-010b-43c0-963e-37ce1ef25ede admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd70e9becd0154a439ec8b70b166f9da8'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:45.742632 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1425/2830] 10.222.0.86 () {58 vars in 1223 bytes} [Tue Jun 7 14:50:45 2022] DELETE /identity/v3/users/d70e9becd0154a439ec8b70b166f9da8 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:50:46.252430 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb9eb91-bc25-4a06-8241-34b84804a9a9 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:46.254600 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-0cb9eb91-bc25-4a06-8241-34b84804a9a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:46.270321 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb9eb91-bc25-4a06-8241-34b84804a9a9 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:46.330286 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a6c97b-1964-4648-9f49-2e0566521c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:46.331165 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a6c97b-1964-4648-9f49-2e0566521c38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:46.331481 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a6c97b-1964-4648-9f49-2e0566521c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:46.331820 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a6c97b-1964-4648-9f49-2e0566521c38 admin admin] PATH_INFO: `/v3/projects/baeb896b9f394112b16c0b8160610eaa` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:46.333046 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a6c97b-1964-4648-9f49-2e0566521c38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=baeb896b9f394112b16c0b8160610eaa)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:46.335004 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a6c97b-1964-4648-9f49-2e0566521c38 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:46.487084 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-86a6c97b-1964-4648-9f49-2e0566521c38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'baeb896b9f394112b16c0b8160610eaa', 'request_id': 'req-86a6c97b-1964-4648-9f49-2e0566521c38'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:46.494187 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-86a6c97b-1964-4648-9f49-2e0566521c38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'baeb896b9f394112b16c0b8160610eaa', 'request_id': 'req-86a6c97b-1964-4648-9f49-2e0566521c38'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:46.571285 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-86a6c97b-1964-4648-9f49-2e0566521c38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'baeb896b9f394112b16c0b8160610eaa', 'request_id': 'req-86a6c97b-1964-4648-9f49-2e0566521c38'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:46.583457 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-86a6c97b-1964-4648-9f49-2e0566521c38 admin admin] The token cache is being invalidate because project baeb896b9f394112b16c0b8160610eaa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:50:46.583746 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-86a6c97b-1964-4648-9f49-2e0566521c38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:46.584406 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-86a6c97b-1964-4648-9f49-2e0566521c38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:46.586269 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1406/2831] 10.222.0.86 () {58 vars in 1232 bytes} [Tue Jun 7 14:50:46 2022] DELETE /identity/v3/projects/baeb896b9f394112b16c0b8160610eaa => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:50:46.590095 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42b8ebc-010b-43c0-963e-37ce1ef25ede admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:46.591544 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-c42b8ebc-010b-43c0-963e-37ce1ef25ede admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:46.604576 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42b8ebc-010b-43c0-963e-37ce1ef25ede admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:46.655718 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:50:46.664866 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2cdde9-c1b7-49b7-afbb-415fa2da1cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:46.665814 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2cdde9-c1b7-49b7-afbb-415fa2da1cc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:46.666105 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2cdde9-c1b7-49b7-afbb-415fa2da1cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:46.666382 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2cdde9-c1b7-49b7-afbb-415fa2da1cc5 admin admin] PATH_INFO: `/v3/users/d3b2330c65e7400c93083de5b54ba655` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:46.667662 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2cdde9-c1b7-49b7-afbb-415fa2da1cc5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3b2330c65e7400c93083de5b54ba655)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:46.669702 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2cdde9-c1b7-49b7-afbb-415fa2da1cc5 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:46.921572 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-1a2cdde9-c1b7-49b7-afbb-415fa2da1cc5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3b2330c65e7400c93083de5b54ba655'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:46.922236 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-1a2cdde9-c1b7-49b7-afbb-415fa2da1cc5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3b2330c65e7400c93083de5b54ba655'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:46.929220 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-1a2cdde9-c1b7-49b7-afbb-415fa2da1cc5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3b2330c65e7400c93083de5b54ba655'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:46.941861 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-1a2cdde9-c1b7-49b7-afbb-415fa2da1cc5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3b2330c65e7400c93083de5b54ba655'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:46.944143 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-1a2cdde9-c1b7-49b7-afbb-415fa2da1cc5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3b2330c65e7400c93083de5b54ba655'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:47.050107 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1426/2832] 10.222.0.86 () {58 vars in 1223 bytes} [Tue Jun 7 14:50:46 2022] DELETE /identity/v3/users/d3b2330c65e7400c93083de5b54ba655 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:50:47.510125 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a6c97b-1964-4648-9f49-2e0566521c38 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:47.511780 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-86a6c97b-1964-4648-9f49-2e0566521c38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:47.526460 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a6c97b-1964-4648-9f49-2e0566521c38 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:47.543352 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:50:47.590359 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae366fcd-2b21-45f6-9ac6-e2e695bc95b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:47.591232 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae366fcd-2b21-45f6-9ac6-e2e695bc95b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:47.591619 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae366fcd-2b21-45f6-9ac6-e2e695bc95b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:47.591813 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae366fcd-2b21-45f6-9ac6-e2e695bc95b9 admin admin] PATH_INFO: `/v3/projects/4e6b7ed0690f41adba9f13aabe1047d1` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:47.593135 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae366fcd-2b21-45f6-9ac6-e2e695bc95b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e6b7ed0690f41adba9f13aabe1047d1)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:47.595067 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae366fcd-2b21-45f6-9ac6-e2e695bc95b9 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:47.710918 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-ae366fcd-2b21-45f6-9ac6-e2e695bc95b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e6b7ed0690f41adba9f13aabe1047d1', 'request_id': 'req-ae366fcd-2b21-45f6-9ac6-e2e695bc95b9'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:47.717928 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-ae366fcd-2b21-45f6-9ac6-e2e695bc95b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e6b7ed0690f41adba9f13aabe1047d1', 'request_id': 'req-ae366fcd-2b21-45f6-9ac6-e2e695bc95b9'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:47.792278 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-ae366fcd-2b21-45f6-9ac6-e2e695bc95b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e6b7ed0690f41adba9f13aabe1047d1', 'request_id': 'req-ae366fcd-2b21-45f6-9ac6-e2e695bc95b9'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:47.806111 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-ae366fcd-2b21-45f6-9ac6-e2e695bc95b9 admin admin] The token cache is being invalidate because project 4e6b7ed0690f41adba9f13aabe1047d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:50:47.806406 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-ae366fcd-2b21-45f6-9ac6-e2e695bc95b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:47.807133 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-ae366fcd-2b21-45f6-9ac6-e2e695bc95b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:47.809142 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1407/2833] 10.222.0.86 () {58 vars in 1232 bytes} [Tue Jun 7 14:50:47 2022] DELETE /identity/v3/projects/4e6b7ed0690f41adba9f13aabe1047d1 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:50:47.814712 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c31d8d-d684-4013-a9d9-4d7addb5160d None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:47.815241 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c31d8d-d684-4013-a9d9-4d7addb5160d None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:47.815439 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c31d8d-d684-4013-a9d9-4d7addb5160d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:47.838221 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-c5c31d8d-d684-4013-a9d9-4d7addb5160d None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:50:47.839491 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-c5c31d8d-d684-4013-a9d9-4d7addb5160d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:47.909251 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1427/2834] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:50:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:50:47.918569 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92740fca-49a0-49ec-b919-f1e41222f658 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:47.919523 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92740fca-49a0-49ec-b919-f1e41222f658 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:47.919523 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92740fca-49a0-49ec-b919-f1e41222f658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:47.941810 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-92740fca-49a0-49ec-b919-f1e41222f658 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:50:47.943705 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-92740fca-49a0-49ec-b919-f1e41222f658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:47.957690 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1408/2835] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:50:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:50:47.958923 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c31d8d-d684-4013-a9d9-4d7addb5160d None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:47.970326 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c31d8d-d684-4013-a9d9-4d7addb5160d None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:47.976285 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310e273b-d8a5-4da6-baea-bb7b8f70b4e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:47.980112 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310e273b-d8a5-4da6-baea-bb7b8f70b4e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:47.980112 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310e273b-d8a5-4da6-baea-bb7b8f70b4e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:47.980112 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310e273b-d8a5-4da6-baea-bb7b8f70b4e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:47.980112 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310e273b-d8a5-4da6-baea-bb7b8f70b4e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:50:47.980112 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310e273b-d8a5-4da6-baea-bb7b8f70b4e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:47.980654 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310e273b-d8a5-4da6-baea-bb7b8f70b4e4 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:47.995443 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1428/2836] 10.222.0.86 () {58 vars in 1152 bytes} [Tue Jun 7 14:50:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:50:47.996654 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92740fca-49a0-49ec-b919-f1e41222f658 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:48.005797 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92740fca-49a0-49ec-b919-f1e41222f658 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:48.010816 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355207dd-1c85-4c96-8de1-782d8f272fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:48.011470 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355207dd-1c85-4c96-8de1-782d8f272fc3 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:48.011772 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355207dd-1c85-4c96-8de1-782d8f272fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:48.012083 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355207dd-1c85-4c96-8de1-782d8f272fc3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:48.012793 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355207dd-1c85-4c96-8de1-782d8f272fc3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:48.014680 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355207dd-1c85-4c96-8de1-782d8f272fc3 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:48.138037 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1409/2837] 10.222.0.86 () {60 vars in 1152 bytes} [Tue Jun 7 14:50:47 2022] POST /identity/v3/projects => generated 373 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 14:50:48.139080 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310e273b-d8a5-4da6-baea-bb7b8f70b4e4 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:48.154574 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310e273b-d8a5-4da6-baea-bb7b8f70b4e4 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:48.223151 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc736db0-6637-4a48-83a5-52194dfcbada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:48.223864 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc736db0-6637-4a48-83a5-52194dfcbada admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:48.224151 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc736db0-6637-4a48-83a5-52194dfcbada admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:48.224425 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc736db0-6637-4a48-83a5-52194dfcbada admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:48.225232 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc736db0-6637-4a48-83a5-52194dfcbada admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:48.230811 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc736db0-6637-4a48-83a5-52194dfcbada admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:48.237828 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:50:48.348174 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1429/2838] 10.222.0.86 () {60 vars in 1143 bytes} [Tue Jun 7 14:50:48 2022] POST /identity/v3/users => generated 287 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:50:48.352136 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355207dd-1c85-4c96-8de1-782d8f272fc3 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:48.364346 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355207dd-1c85-4c96-8de1-782d8f272fc3 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:48.370097 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149c1911-3b19-4802-8c09-3fed18d463d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:48.370792 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149c1911-3b19-4802-8c09-3fed18d463d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:48.371073 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149c1911-3b19-4802-8c09-3fed18d463d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:48.371346 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149c1911-3b19-4802-8c09-3fed18d463d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:48.372412 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149c1911-3b19-4802-8c09-3fed18d463d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:48.374128 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149c1911-3b19-4802-8c09-3fed18d463d7 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:48.389134 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1410/2839] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:50:48 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:50:48.390376 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc736db0-6637-4a48-83a5-52194dfcbada admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:48.401125 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc736db0-6637-4a48-83a5-52194dfcbada admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:48.406727 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd49ae7-b7dd-4786-910f-5e1802ede607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:48.410939 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd49ae7-b7dd-4786-910f-5e1802ede607 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:48.410939 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd49ae7-b7dd-4786-910f-5e1802ede607 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:48.410939 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd49ae7-b7dd-4786-910f-5e1802ede607 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:48.410939 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd49ae7-b7dd-4786-910f-5e1802ede607 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:48.411436 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd49ae7-b7dd-4786-910f-5e1802ede607 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:48.428417 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1430/2840] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:50:48 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:50:48.430208 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149c1911-3b19-4802-8c09-3fed18d463d7 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:48.443830 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149c1911-3b19-4802-8c09-3fed18d463d7 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:48.449286 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466f4c14-8c2e-4878-adbc-c6b4d202bd6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:48.449917 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466f4c14-8c2e-4878-adbc-c6b4d202bd6f admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:48.450265 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466f4c14-8c2e-4878-adbc-c6b4d202bd6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:48.450980 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466f4c14-8c2e-4878-adbc-c6b4d202bd6f admin admin] PATH_INFO: `/v3/projects/c86265272311440cbb6684af739eb473/users/d20fa1ec307347e5b6cc505cc5467884/roles/c17acc2a8bb348f59ba7edd22fcf0c47` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:48.467679 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466f4c14-8c2e-4878-adbc-c6b4d202bd6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c86265272311440cbb6684af739eb473, user_id=d20fa1ec307347e5b6cc505cc5467884, role_id=c17acc2a8bb348f59ba7edd22fcf0c47)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:48.470557 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466f4c14-8c2e-4878-adbc-c6b4d202bd6f admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:48.559081 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1411/2841] 10.222.0.86 () {60 vars in 1482 bytes} [Tue Jun 7 14:50:48 2022] PUT /identity/v3/projects/c86265272311440cbb6684af739eb473/users/d20fa1ec307347e5b6cc505cc5467884/roles/c17acc2a8bb348f59ba7edd22fcf0c47 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:50:48.569899 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df249892-48d0-4ee5-aa25-f2c15e493d79 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:48.570183 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df249892-48d0-4ee5-aa25-f2c15e493d79 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:48.570951 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df249892-48d0-4ee5-aa25-f2c15e493d79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:48.601432 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-df249892-48d0-4ee5-aa25-f2c15e493d79 None None] MFA Rules not processed for user `d20fa1ec307347e5b6cc505cc5467884`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:50:48.603193 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-df249892-48d0-4ee5-aa25-f2c15e493d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:48.677671 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1431/2842] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:50:48 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 14:50:48.687659 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466f4c14-8c2e-4878-adbc-c6b4d202bd6f admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:48.689722 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-466f4c14-8c2e-4878-adbc-c6b4d202bd6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:48.750247 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:50:48.764510 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466f4c14-8c2e-4878-adbc-c6b4d202bd6f admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:48.770013 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afc4ad4-08f7-4477-a33b-941ff831c507 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af5a95620a4b43538abfe09eed4bf115', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:48.770575 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afc4ad4-08f7-4477-a33b-941ff831c507 service cinder] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:48.770791 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afc4ad4-08f7-4477-a33b-941ff831c507 service cinder] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:48.771173 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afc4ad4-08f7-4477-a33b-941ff831c507 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:48.781286 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afc4ad4-08f7-4477-a33b-941ff831c507 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:48.782724 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afc4ad4-08f7-4477-a33b-941ff831c507 service cinder] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:48.793189 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1412/2843] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:50:48 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:50:48.819719 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df249892-48d0-4ee5-aa25-f2c15e493d79 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:48.889127 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df249892-48d0-4ee5-aa25-f2c15e493d79 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:48.894620 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d57c40-0533-4fdd-bf92-fe20bd52eeac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:48.895582 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d57c40-0533-4fdd-bf92-fe20bd52eeac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:48.895968 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d57c40-0533-4fdd-bf92-fe20bd52eeac admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:48.896316 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d57c40-0533-4fdd-bf92-fe20bd52eeac admin admin] PATH_INFO: `/v3/users/d20fa1ec307347e5b6cc505cc5467884` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:48.897699 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d57c40-0533-4fdd-bf92-fe20bd52eeac admin admin] RBAC: Authorizing `identity:delete_user(user_id=d20fa1ec307347e5b6cc505cc5467884)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:48.899688 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d57c40-0533-4fdd-bf92-fe20bd52eeac admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:49.189050 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-88d57c40-0533-4fdd-bf92-fe20bd52eeac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd20fa1ec307347e5b6cc505cc5467884'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:49.189741 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-88d57c40-0533-4fdd-bf92-fe20bd52eeac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd20fa1ec307347e5b6cc505cc5467884'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:49.206892 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-88d57c40-0533-4fdd-bf92-fe20bd52eeac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd20fa1ec307347e5b6cc505cc5467884'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:49.219946 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:INSERT=3,keystone:SELECT=89,keystone:DELETE=8 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:50:49.224450 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-88d57c40-0533-4fdd-bf92-fe20bd52eeac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd20fa1ec307347e5b6cc505cc5467884'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:49.226441 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-88d57c40-0533-4fdd-bf92-fe20bd52eeac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd20fa1ec307347e5b6cc505cc5467884'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:49.317192 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1432/2844] 10.222.0.86 () {58 vars in 1223 bytes} [Tue Jun 7 14:50:48 2022] DELETE /identity/v3/users/d20fa1ec307347e5b6cc505cc5467884 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:50:49.321933 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2960dfe0-efe1-4ca9-9c44-519c37168efa None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:49.322908 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2960dfe0-efe1-4ca9-9c44-519c37168efa None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:49.323234 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2960dfe0-efe1-4ca9-9c44-519c37168efa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:49.344485 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-2960dfe0-efe1-4ca9-9c44-519c37168efa None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:50:49.346086 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-2960dfe0-efe1-4ca9-9c44-519c37168efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:49.413179 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1413/2845] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:50:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 14:50:49.423480 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d57c40-0533-4fdd-bf92-fe20bd52eeac admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:49.425063 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-88d57c40-0533-4fdd-bf92-fe20bd52eeac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:49.494110 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d57c40-0533-4fdd-bf92-fe20bd52eeac admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:49.498235 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc97dd9-5545-42cc-be5e-2b17f2dbbd9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dda603ec5517460a83c333db2af804d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:49.498968 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc97dd9-5545-42cc-be5e-2b17f2dbbd9e service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:49.499502 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc97dd9-5545-42cc-be5e-2b17f2dbbd9e service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:49.499838 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc97dd9-5545-42cc-be5e-2b17f2dbbd9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:49.511406 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc97dd9-5545-42cc-be5e-2b17f2dbbd9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:49.513080 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc97dd9-5545-42cc-be5e-2b17f2dbbd9e service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:49.522907 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1433/2846] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:50:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:50:50.081437 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2960dfe0-efe1-4ca9-9c44-519c37168efa None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:50.083748 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-2960dfe0-efe1-4ca9-9c44-519c37168efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:50.095985 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2960dfe0-efe1-4ca9-9c44-519c37168efa None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:50.100986 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef168b49-a027-45d9-ba86-e01935c49376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:50.102130 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef168b49-a027-45d9-ba86-e01935c49376 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:50.102514 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef168b49-a027-45d9-ba86-e01935c49376 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:50.102942 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef168b49-a027-45d9-ba86-e01935c49376 admin admin] PATH_INFO: `/v3/projects/c86265272311440cbb6684af739eb473` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:50.104325 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef168b49-a027-45d9-ba86-e01935c49376 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c86265272311440cbb6684af739eb473)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:50.106323 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef168b49-a027-45d9-ba86-e01935c49376 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:50.272725 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-ef168b49-a027-45d9-ba86-e01935c49376 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c86265272311440cbb6684af739eb473', 'request_id': 'req-ef168b49-a027-45d9-ba86-e01935c49376'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:50.285350 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-ef168b49-a027-45d9-ba86-e01935c49376 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c86265272311440cbb6684af739eb473', 'request_id': 'req-ef168b49-a027-45d9-ba86-e01935c49376'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:50.388447 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-ef168b49-a027-45d9-ba86-e01935c49376 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c86265272311440cbb6684af739eb473', 'request_id': 'req-ef168b49-a027-45d9-ba86-e01935c49376'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:50.402983 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-ef168b49-a027-45d9-ba86-e01935c49376 admin admin] The token cache is being invalidate because project c86265272311440cbb6684af739eb473 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:50:50.403575 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-ef168b49-a027-45d9-ba86-e01935c49376 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:50.404360 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-ef168b49-a027-45d9-ba86-e01935c49376 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:50:50.406173 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1414/2847] 10.222.0.86 () {58 vars in 1232 bytes} [Tue Jun 7 14:50:50 2022] DELETE /identity/v3/projects/c86265272311440cbb6684af739eb473 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:50:50.410971 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799f248e-fe49-49a7-99c1-1f6a4d760067 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:50.411494 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799f248e-fe49-49a7-99c1-1f6a4d760067 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:50.411793 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799f248e-fe49-49a7-99c1-1f6a4d760067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:50.432860 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-799f248e-fe49-49a7-99c1-1f6a4d760067 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:50:50.435144 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-799f248e-fe49-49a7-99c1-1f6a4d760067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:50.480815 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50656f53-1b09-4d94-8b0e-c10757f9b440 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:50.481302 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50656f53-1b09-4d94-8b0e-c10757f9b440 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:50.481647 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50656f53-1b09-4d94-8b0e-c10757f9b440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:50.523911 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1434/2848] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:50:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:50:50.528041 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-50656f53-1b09-4d94-8b0e-c10757f9b440 None None] MFA Rules not processed for user `c0f8e619568545a3a33dfcb02a872dec`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:50:50.528212 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f369b2fc-b1ab-42dc-8c55-1a0935611553 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:50.528384 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f369b2fc-b1ab-42dc-8c55-1a0935611553 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:50.528661 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f369b2fc-b1ab-42dc-8c55-1a0935611553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:50.529530 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-50656f53-1b09-4d94-8b0e-c10757f9b440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:50.548072 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-f369b2fc-b1ab-42dc-8c55-1a0935611553 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:50:50.549113 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-f369b2fc-b1ab-42dc-8c55-1a0935611553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:50.557776 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1435/2849] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:50:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 14:50:50.563249 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f369b2fc-b1ab-42dc-8c55-1a0935611553 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:50.574709 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f369b2fc-b1ab-42dc-8c55-1a0935611553 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:50.580857 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2102aa4-d29a-43ba-a9b2-31a8a78e7a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:50.582191 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2102aa4-d29a-43ba-a9b2-31a8a78e7a43 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:50.582563 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2102aa4-d29a-43ba-a9b2-31a8a78e7a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:50.582897 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2102aa4-d29a-43ba-a9b2-31a8a78e7a43 admin admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:50.583829 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2102aa4-d29a-43ba-a9b2-31a8a78e7a43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:50:50.584209 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2102aa4-d29a-43ba-a9b2-31a8a78e7a43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:50.585904 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2102aa4-d29a-43ba-a9b2-31a8a78e7a43 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:50.598729 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1436/2850] 10.222.0.86 () {58 vars in 1152 bytes} [Tue Jun 7 14:50:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:50:50.603035 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2102aa4-d29a-43ba-a9b2-31a8a78e7a43 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:50.613644 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2102aa4-d29a-43ba-a9b2-31a8a78e7a43 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:50.624314 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c474db56-6d44-4224-9bef-79e4ef7fb4e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:50.624995 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c474db56-6d44-4224-9bef-79e4ef7fb4e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:50.625289 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c474db56-6d44-4224-9bef-79e4ef7fb4e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:50.625565 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c474db56-6d44-4224-9bef-79e4ef7fb4e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:50.626502 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c474db56-6d44-4224-9bef-79e4ef7fb4e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:50.626661 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:50:50.629337 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c474db56-6d44-4224-9bef-79e4ef7fb4e4 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:50.631788 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1415/2851] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:50:50 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 14:50:50.638197 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50656f53-1b09-4d94-8b0e-c10757f9b440 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:50.639804 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-50656f53-1b09-4d94-8b0e-c10757f9b440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:50.654142 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50656f53-1b09-4d94-8b0e-c10757f9b440 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:50.659121 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5276ddb2-6126-4ee8-b73c-f9036e44a497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:50.659866 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5276ddb2-6126-4ee8-b73c-f9036e44a497 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:50.663806 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5276ddb2-6126-4ee8-b73c-f9036e44a497 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:50.663806 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5276ddb2-6126-4ee8-b73c-f9036e44a497 admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:50.663806 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5276ddb2-6126-4ee8-b73c-f9036e44a497 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:50.663806 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5276ddb2-6126-4ee8-b73c-f9036e44a497 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:50.740898 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1437/2852] 10.222.0.86 () {60 vars in 1152 bytes} [Tue Jun 7 14:50:50 2022] POST /identity/v3/projects => generated 381 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:50:50.744932 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c474db56-6d44-4224-9bef-79e4ef7fb4e4 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:50.772377 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1416/2853] 10.222.0.86 () {60 vars in 1152 bytes} [Tue Jun 7 14:50:50 2022] POST /identity/v3/projects => generated 369 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 14:50:50.773653 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5276ddb2-6126-4ee8-b73c-f9036e44a497 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:50.799353 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:DELETE=2,keystone:SELECT=96,keystone:INSERT=2 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:50:50.825235 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c474db56-6d44-4224-9bef-79e4ef7fb4e4 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:50.842423 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5276ddb2-6126-4ee8-b73c-f9036e44a497 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:50.848752 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c56c3f3-869b-4a62-a9b1-fb2054290492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:50.849683 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c56c3f3-869b-4a62-a9b1-fb2054290492 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:50.850304 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c56c3f3-869b-4a62-a9b1-fb2054290492 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:50.850577 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c56c3f3-869b-4a62-a9b1-fb2054290492 admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:50.851289 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c56c3f3-869b-4a62-a9b1-fb2054290492 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:50.853322 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c56c3f3-869b-4a62-a9b1-fb2054290492 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:50.887998 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d5efac-840d-44ee-9edb-b68b8974c9e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:50.888682 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d5efac-840d-44ee-9edb-b68b8974c9e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:50.888975 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d5efac-840d-44ee-9edb-b68b8974c9e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:50.889251 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d5efac-840d-44ee-9edb-b68b8974c9e2 admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:50.889960 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d5efac-840d-44ee-9edb-b68b8974c9e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:50.891901 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d5efac-840d-44ee-9edb-b68b8974c9e2 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:50.986073 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1417/2854] 10.222.0.86 () {60 vars in 1143 bytes} [Tue Jun 7 14:50:50 2022] POST /identity/v3/users => generated 291 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:50:50.987207 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c56c3f3-869b-4a62-a9b1-fb2054290492 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:50.997831 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c56c3f3-869b-4a62-a9b1-fb2054290492 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:51.009762 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fb3a13-acf8-4587-8a24-c8da2ee940c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:51.010123 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1438/2855] 10.222.0.86 () {60 vars in 1143 bytes} [Tue Jun 7 14:50:50 2022] POST /identity/v3/users => generated 291 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 14:50:51.010264 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fb3a13-acf8-4587-8a24-c8da2ee940c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:51.010264 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fb3a13-acf8-4587-8a24-c8da2ee940c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:51.010264 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fb3a13-acf8-4587-8a24-c8da2ee940c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:51.012075 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fb3a13-acf8-4587-8a24-c8da2ee940c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:51.012423 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d5efac-840d-44ee-9edb-b68b8974c9e2 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:51.013721 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fb3a13-acf8-4587-8a24-c8da2ee940c7 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:51.022229 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d5efac-840d-44ee-9edb-b68b8974c9e2 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:51.024621 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1418/2856] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:50:50 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:50:51.027369 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7ebadd-08b0-4617-82b0-ada8da48393d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:51.028148 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7ebadd-08b0-4617-82b0-ada8da48393d admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:51.028485 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7ebadd-08b0-4617-82b0-ada8da48393d admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:51.028770 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7ebadd-08b0-4617-82b0-ada8da48393d admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:51.028888 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fb3a13-acf8-4587-8a24-c8da2ee940c7 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:51.029534 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7ebadd-08b0-4617-82b0-ada8da48393d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:51.031156 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7ebadd-08b0-4617-82b0-ada8da48393d admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:51.039048 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fb3a13-acf8-4587-8a24-c8da2ee940c7 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:51.042996 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1439/2857] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:50:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:50:51.046857 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7ebadd-08b0-4617-82b0-ada8da48393d admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:51.047283 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e76183-e2d4-47c3-8ac5-079367cc69cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:51.048223 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e76183-e2d4-47c3-8ac5-079367cc69cd admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:51.048513 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e76183-e2d4-47c3-8ac5-079367cc69cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:51.049821 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e76183-e2d4-47c3-8ac5-079367cc69cd admin admin] PATH_INFO: `/v3/projects/a79bc60c2b48441cb65d297603ff37b6/users/44ea222fe037496db64aaa5050065eb1/roles/e3bf6239f5bf477b965704b086786f11` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:51.057817 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7ebadd-08b0-4617-82b0-ada8da48393d admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:51.063870 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6423e507-58fd-4c01-987e-1ad71ebba8a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:51.064554 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6423e507-58fd-4c01-987e-1ad71ebba8a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:51.064841 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6423e507-58fd-4c01-987e-1ad71ebba8a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:51.065118 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6423e507-58fd-4c01-987e-1ad71ebba8a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:51.066646 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6423e507-58fd-4c01-987e-1ad71ebba8a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:51.067673 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e76183-e2d4-47c3-8ac5-079367cc69cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=a79bc60c2b48441cb65d297603ff37b6, user_id=44ea222fe037496db64aaa5050065eb1, role_id=e3bf6239f5bf477b965704b086786f11)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:51.072649 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6423e507-58fd-4c01-987e-1ad71ebba8a1 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:51.072783 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e76183-e2d4-47c3-8ac5-079367cc69cd admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:51.084704 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1440/2858] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:50:51 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:50:51.085868 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6423e507-58fd-4c01-987e-1ad71ebba8a1 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:51.096320 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6423e507-58fd-4c01-987e-1ad71ebba8a1 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:51.101498 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b56d778-2c2c-4c8a-b5a1-ed0bf0fc0832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:51.101915 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b56d778-2c2c-4c8a-b5a1-ed0bf0fc0832 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:51.102196 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b56d778-2c2c-4c8a-b5a1-ed0bf0fc0832 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:51.102467 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b56d778-2c2c-4c8a-b5a1-ed0bf0fc0832 admin admin] PATH_INFO: `/v3/projects/5e0f4a797ae74b8a85e14ea8984dd0b9/users/fa7a4ce9cc594d4fba4aa933e5353c68/roles/c17acc2a8bb348f59ba7edd22fcf0c47` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:51.121452 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b56d778-2c2c-4c8a-b5a1-ed0bf0fc0832 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e0f4a797ae74b8a85e14ea8984dd0b9, user_id=fa7a4ce9cc594d4fba4aa933e5353c68, role_id=c17acc2a8bb348f59ba7edd22fcf0c47)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:51.124707 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b56d778-2c2c-4c8a-b5a1-ed0bf0fc0832 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:51.177950 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1419/2859] 10.222.0.86 () {60 vars in 1482 bytes} [Tue Jun 7 14:50:51 2022] PUT /identity/v3/projects/a79bc60c2b48441cb65d297603ff37b6/users/44ea222fe037496db64aaa5050065eb1/roles/e3bf6239f5bf477b965704b086786f11 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 14:50:51.181896 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e76183-e2d4-47c3-8ac5-079367cc69cd admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:51.263094 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1441/2860] 10.222.0.86 () {60 vars in 1482 bytes} [Tue Jun 7 14:50:51 2022] PUT /identity/v3/projects/5e0f4a797ae74b8a85e14ea8984dd0b9/users/fa7a4ce9cc594d4fba4aa933e5353c68/roles/c17acc2a8bb348f59ba7edd22fcf0c47 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:50:51.268574 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a08f71f-86b6-4cd9-8f37-6ea10780996d None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:51.269061 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a08f71f-86b6-4cd9-8f37-6ea10780996d None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:51.269546 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a08f71f-86b6-4cd9-8f37-6ea10780996d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:51.272578 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e76183-e2d4-47c3-8ac5-079367cc69cd admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:51.297662 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-6a08f71f-86b6-4cd9-8f37-6ea10780996d None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:50:51.298972 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-6a08f71f-86b6-4cd9-8f37-6ea10780996d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:51.347931 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c76d11c-2b98-4cb3-8160-411331551bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:51.348204 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c76d11c-2b98-4cb3-8160-411331551bc7 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:51.348411 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c76d11c-2b98-4cb3-8160-411331551bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:51.348691 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c76d11c-2b98-4cb3-8160-411331551bc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:51.349702 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c76d11c-2b98-4cb3-8160-411331551bc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:51.353022 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c76d11c-2b98-4cb3-8160-411331551bc7 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:51.364416 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1420/2861] 10.222.0.86 () {58 vars in 1121 bytes} [Tue Jun 7 14:50:51 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 07 14:50:51.368345 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c76d11c-2b98-4cb3-8160-411331551bc7 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:51.378657 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c76d11c-2b98-4cb3-8160-411331551bc7 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:51.383871 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf93809-aa81-496e-ace8-cdbf3bda317c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:51.384606 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1442/2862] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:50:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:50:51.384798 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf93809-aa81-496e-ace8-cdbf3bda317c admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:51.385062 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf93809-aa81-496e-ace8-cdbf3bda317c admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:51.385348 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf93809-aa81-496e-ace8-cdbf3bda317c admin admin] PATH_INFO: `/v3/projects/a79bc60c2b48441cb65d297603ff37b6/users/44ea222fe037496db64aaa5050065eb1/roles/e3bf6239f5bf477b965704b086786f11` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:51.387736 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf93809-aa81-496e-ace8-cdbf3bda317c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a79bc60c2b48441cb65d297603ff37b6, user_id=44ea222fe037496db64aaa5050065eb1, role_id=e3bf6239f5bf477b965704b086786f11)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:51.390431 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf93809-aa81-496e-ace8-cdbf3bda317c admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:51.395207 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a08f71f-86b6-4cd9-8f37-6ea10780996d None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:51.396786 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-6a08f71f-86b6-4cd9-8f37-6ea10780996d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:51.401842 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1421/2863] 10.222.0.86 () {60 vars in 1482 bytes} [Tue Jun 7 14:50:51 2022] PUT /identity/v3/projects/a79bc60c2b48441cb65d297603ff37b6/users/44ea222fe037496db64aaa5050065eb1/roles/e3bf6239f5bf477b965704b086786f11 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 14:50:51.454975 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a08f71f-86b6-4cd9-8f37-6ea10780996d None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:51.468955 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:50:51.506577 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da3f273-0652-4f88-a75d-2ddf1bf65ed6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dda603ec5517460a83c333db2af804d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:51.507576 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da3f273-0652-4f88-a75d-2ddf1bf65ed6 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:51.507925 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da3f273-0652-4f88-a75d-2ddf1bf65ed6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:51.508208 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da3f273-0652-4f88-a75d-2ddf1bf65ed6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:51.566126 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:50:51.585194 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da3f273-0652-4f88-a75d-2ddf1bf65ed6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:51.585194 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da3f273-0652-4f88-a75d-2ddf1bf65ed6 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:51.593928 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1443/2864] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:50:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:50:53.042450 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fdc1a5-88ef-4599-b0ae-b2483f037567 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:53.045906 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fdc1a5-88ef-4599-b0ae-b2483f037567 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:53.045906 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fdc1a5-88ef-4599-b0ae-b2483f037567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:53.080192 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-e3fdc1a5-88ef-4599-b0ae-b2483f037567 None None] MFA Rules not processed for user `fa7a4ce9cc594d4fba4aa933e5353c68`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:50:53.081487 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-e3fdc1a5-88ef-4599-b0ae-b2483f037567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:53.219908 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1422/2865] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:50:53 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:50:53.225048 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da3f273-0652-4f88-a75d-2ddf1bf65ed6 service neutron] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:53.226550 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-3da3f273-0652-4f88-a75d-2ddf1bf65ed6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:53.312815 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da3f273-0652-4f88-a75d-2ddf1bf65ed6 service neutron] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:53.318272 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d040b1e6-35cd-4c36-a884-8c3c02c6c36e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af5a95620a4b43538abfe09eed4bf115', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:53.318933 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d040b1e6-35cd-4c36-a884-8c3c02c6c36e service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:53.319216 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d040b1e6-35cd-4c36-a884-8c3c02c6c36e service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:53.319484 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d040b1e6-35cd-4c36-a884-8c3c02c6c36e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:53.328989 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d040b1e6-35cd-4c36-a884-8c3c02c6c36e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:53.330586 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d040b1e6-35cd-4c36-a884-8c3c02c6c36e service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:53.342004 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1444/2866] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:50:53 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:50:56.427546 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd263fe-e427-4b51-8949-0646a1fe2a5f None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:56.427957 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd263fe-e427-4b51-8949-0646a1fe2a5f None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:56.427957 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd263fe-e427-4b51-8949-0646a1fe2a5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:56.446858 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-6fd263fe-e427-4b51-8949-0646a1fe2a5f None None] MFA Rules not processed for user `fa7a4ce9cc594d4fba4aa933e5353c68`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:50:56.448117 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-6fd263fe-e427-4b51-8949-0646a1fe2a5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:56.463818 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1423/2867] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:50:56 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:50:56.512317 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d040b1e6-35cd-4c36-a884-8c3c02c6c36e service cinder] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:56.515044 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-d040b1e6-35cd-4c36-a884-8c3c02c6c36e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:56.595200 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:50:56.599722 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d040b1e6-35cd-4c36-a884-8c3c02c6c36e service cinder] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:56.603520 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73d4b9d-5ec1-4b06-9546-78712b494d4d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b910435e5585436996ba5b5aeb7184bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:56.604273 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73d4b9d-5ec1-4b06-9546-78712b494d4d service glance] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:56.604490 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73d4b9d-5ec1-4b06-9546-78712b494d4d service glance] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:56.612305 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73d4b9d-5ec1-4b06-9546-78712b494d4d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:56.612305 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-e73d4b9d-5ec1-4b06-9546-78712b494d4d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:56.690262 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73d4b9d-5ec1-4b06-9546-78712b494d4d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:56.692507 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73d4b9d-5ec1-4b06-9546-78712b494d4d service glance] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:56.706437 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1445/2868] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:50:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:50:57.637415 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd263fe-e427-4b51-8949-0646a1fe2a5f None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:57.657952 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd263fe-e427-4b51-8949-0646a1fe2a5f None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:57.658286 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43262ec8-7448-4868-b0d6-c20c3f7cfefe None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:57.658770 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43262ec8-7448-4868-b0d6-c20c3f7cfefe None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:57.658873 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43262ec8-7448-4868-b0d6-c20c3f7cfefe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:57.663649 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0167de5c-a9cc-42d7-8faf-e21f8629a97b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dda603ec5517460a83c333db2af804d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:57.664480 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0167de5c-a9cc-42d7-8faf-e21f8629a97b service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:57.664993 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0167de5c-a9cc-42d7-8faf-e21f8629a97b service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:57.665505 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0167de5c-a9cc-42d7-8faf-e21f8629a97b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:57.667419 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-0167de5c-a9cc-42d7-8faf-e21f8629a97b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:57.683174 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0167de5c-a9cc-42d7-8faf-e21f8629a97b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:57.685089 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0167de5c-a9cc-42d7-8faf-e21f8629a97b service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:57.689559 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-43262ec8-7448-4868-b0d6-c20c3f7cfefe None None] MFA Rules not processed for user `44ea222fe037496db64aaa5050065eb1`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:50:57.690207 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-43262ec8-7448-4868-b0d6-c20c3f7cfefe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:57.701471 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1424/2869] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:50:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:50:57.783957 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1446/2870] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:50:57 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:50:57.797467 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0167de5c-a9cc-42d7-8faf-e21f8629a97b service neutron] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:50:57.798869 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-0167de5c-a9cc-42d7-8faf-e21f8629a97b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:50:57.813101 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0167de5c-a9cc-42d7-8faf-e21f8629a97b service neutron] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:50:57.819356 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6b80c2-100c-459b-a584-4b618fa3d716 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99cfb70f54c45c8870369359da20378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:50:57.820044 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6b80c2-100c-459b-a584-4b618fa3d716 service nova] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:50:57.820330 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6b80c2-100c-459b-a584-4b618fa3d716 service nova] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:50:57.820609 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6b80c2-100c-459b-a584-4b618fa3d716 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:50:57.883226 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6b80c2-100c-459b-a584-4b618fa3d716 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:50:57.884824 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6b80c2-100c-459b-a584-4b618fa3d716 service nova] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:50:57.894682 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1425/2871] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:50:57 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:51:00.584210 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e756e6d-dc1a-4a2e-9c4d-ff0c6e08ea87 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:51:00.584701 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e756e6d-dc1a-4a2e-9c4d-ff0c6e08ea87 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:51:00.584800 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e756e6d-dc1a-4a2e-9c4d-ff0c6e08ea87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:51:00.603121 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-3e756e6d-dc1a-4a2e-9c4d-ff0c6e08ea87 None None] MFA Rules not processed for user `c0f8e619568545a3a33dfcb02a872dec`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:51:00.604372 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-3e756e6d-dc1a-4a2e-9c4d-ff0c6e08ea87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:51:00.611369 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1447/2872] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:51:00 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:51:05.477712 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6b80c2-100c-459b-a584-4b618fa3d716 service nova] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:51:05.491488 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6b80c2-100c-459b-a584-4b618fa3d716 service nova] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:51:05.495522 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf56250-384d-4505-a88e-c4cd68693f51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dda603ec5517460a83c333db2af804d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:51:05.496021 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf56250-384d-4505-a88e-c4cd68693f51 service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:51:05.496303 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf56250-384d-4505-a88e-c4cd68693f51 service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:51:05.496578 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf56250-384d-4505-a88e-c4cd68693f51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:51:05.498391 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-0cf56250-384d-4505-a88e-c4cd68693f51 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:51:05.509370 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf56250-384d-4505-a88e-c4cd68693f51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:51:05.510788 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf56250-384d-4505-a88e-c4cd68693f51 service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:51:05.520124 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1426/2873] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:51:05 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:51:10.597099 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=69 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:51:15.515388 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=92,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:51:19.532993 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e756e6d-dc1a-4a2e-9c4d-ff0c6e08ea87 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:51:19.534644 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-3e756e6d-dc1a-4a2e-9c4d-ff0c6e08ea87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:51:19.548191 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e756e6d-dc1a-4a2e-9c4d-ff0c6e08ea87 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:51:19.551923 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bd584e-e980-49f3-adf6-20e0407af722 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dda603ec5517460a83c333db2af804d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:51:19.552573 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bd584e-e980-49f3-adf6-20e0407af722 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:51:19.552860 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bd584e-e980-49f3-adf6-20e0407af722 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:51:19.553140 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bd584e-e980-49f3-adf6-20e0407af722 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:51:19.554916 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-45bd584e-e980-49f3-adf6-20e0407af722 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:51:19.564626 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bd584e-e980-49f3-adf6-20e0407af722 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:51:19.566073 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bd584e-e980-49f3-adf6-20e0407af722 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:51:19.574870 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1448/2874] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:51:19 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:51:20.349434 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf56250-384d-4505-a88e-c4cd68693f51 service neutron] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:51:20.350862 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-0cf56250-384d-4505-a88e-c4cd68693f51 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:51:20.423594 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf56250-384d-4505-a88e-c4cd68693f51 service neutron] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:51:20.429029 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449bb866-ae48-4475-859b-6b8fb2da112f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e042f9d4a9345bb947e6a30f64a59ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:51:20.429686 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449bb866-ae48-4475-859b-6b8fb2da112f service placement] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:51:20.429975 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449bb866-ae48-4475-859b-6b8fb2da112f service placement] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:51:20.430259 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449bb866-ae48-4475-859b-6b8fb2da112f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:51:20.432690 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-449bb866-ae48-4475-859b-6b8fb2da112f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:51:20.445301 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449bb866-ae48-4475-859b-6b8fb2da112f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:51:20.449365 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449bb866-ae48-4475-859b-6b8fb2da112f service placement] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:51:20.458052 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1427/2875] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:51:20 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:51:24.519437 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bd584e-e980-49f3-adf6-20e0407af722 service neutron] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:51:24.521147 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-45bd584e-e980-49f3-adf6-20e0407af722 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:51:24.542865 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bd584e-e980-49f3-adf6-20e0407af722 service neutron] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:51:24.549302 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c2a0f8-d88f-42fa-b8d7-0d6223728b7a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99cfb70f54c45c8870369359da20378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:51:24.550055 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c2a0f8-d88f-42fa-b8d7-0d6223728b7a service nova] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:51:24.550374 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c2a0f8-d88f-42fa-b8d7-0d6223728b7a service nova] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:51:24.550706 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c2a0f8-d88f-42fa-b8d7-0d6223728b7a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:51:24.553336 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-58c2a0f8-d88f-42fa-b8d7-0d6223728b7a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:51:24.568738 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c2a0f8-d88f-42fa-b8d7-0d6223728b7a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:51:24.570335 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c2a0f8-d88f-42fa-b8d7-0d6223728b7a service nova] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:51:24.582437 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1449/2876] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:51:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:51:30.452510 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=32 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:51:30.587564 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449bb866-ae48-4475-859b-6b8fb2da112f service placement] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:51:30.600094 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449bb866-ae48-4475-859b-6b8fb2da112f service placement] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:51:30.605605 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5fcec0-87e4-4ddf-8b3f-718426497515 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99cfb70f54c45c8870369359da20378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:51:30.606238 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5fcec0-87e4-4ddf-8b3f-718426497515 service nova] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:51:30.606526 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5fcec0-87e4-4ddf-8b3f-718426497515 service nova] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:51:30.606849 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5fcec0-87e4-4ddf-8b3f-718426497515 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:51:30.608696 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-fd5fcec0-87e4-4ddf-8b3f-718426497515 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:51:30.621463 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5fcec0-87e4-4ddf-8b3f-718426497515 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:51:30.623019 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5fcec0-87e4-4ddf-8b3f-718426497515 service nova] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:51:30.634597 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1428/2877] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:51:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:51:34.465021 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c2a0f8-d88f-42fa-b8d7-0d6223728b7a service nova] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:51:34.474297 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c2a0f8-d88f-42fa-b8d7-0d6223728b7a service nova] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:51:34.477964 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb026e1-5b48-48f1-82ac-35f5f6149de3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dda603ec5517460a83c333db2af804d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:51:34.479140 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb026e1-5b48-48f1-82ac-35f5f6149de3 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:51:34.479420 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb026e1-5b48-48f1-82ac-35f5f6149de3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:51:34.479692 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb026e1-5b48-48f1-82ac-35f5f6149de3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:51:34.488553 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb026e1-5b48-48f1-82ac-35f5f6149de3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:51:34.489956 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb026e1-5b48-48f1-82ac-35f5f6149de3 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:51:34.499248 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1450/2878] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:51:34 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:51:36.687454 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5fcec0-87e4-4ddf-8b3f-718426497515 service nova] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:51:36.700020 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5fcec0-87e4-4ddf-8b3f-718426497515 service nova] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:51:36.705642 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4cbb67-d463-4f38-9065-e3d044429349 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99cfb70f54c45c8870369359da20378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:51:36.706347 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4cbb67-d463-4f38-9065-e3d044429349 service nova] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:51:36.706563 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4cbb67-d463-4f38-9065-e3d044429349 service nova] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:51:36.706916 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4cbb67-d463-4f38-9065-e3d044429349 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:51:36.708712 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-cb4cbb67-d463-4f38-9065-e3d044429349 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:51:36.724223 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4cbb67-d463-4f38-9065-e3d044429349 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:51:36.725798 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4cbb67-d463-4f38-9065-e3d044429349 service nova] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:51:36.737381 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1429/2879] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:51:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:51:39.751225 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e78a34-bedb-4347-98d3-36138e8555d2 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:51:39.751848 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e78a34-bedb-4347-98d3-36138e8555d2 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:51:39.751848 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e78a34-bedb-4347-98d3-36138e8555d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:51:39.770667 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-88e78a34-bedb-4347-98d3-36138e8555d2 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:51:39.771921 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-88e78a34-bedb-4347-98d3-36138e8555d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:51:39.780378 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1451/2880] 10.222.0.15 () {58 vars in 1016 bytes} [Tue Jun 7 14:51:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:51:39.800473 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4cbb67-d463-4f38-9065-e3d044429349 service nova] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:51:39.812354 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4cbb67-d463-4f38-9065-e3d044429349 service nova] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:51:39.817750 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425b01d3-1b6c-48f5-8e22-bd539aaa4e43 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99cfb70f54c45c8870369359da20378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:51:39.818377 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425b01d3-1b6c-48f5-8e22-bd539aaa4e43 service nova] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:51:39.818660 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425b01d3-1b6c-48f5-8e22-bd539aaa4e43 service nova] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:51:39.818940 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425b01d3-1b6c-48f5-8e22-bd539aaa4e43 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:51:39.827528 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425b01d3-1b6c-48f5-8e22-bd539aaa4e43 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:51:39.829203 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425b01d3-1b6c-48f5-8e22-bd539aaa4e43 service nova] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:51:39.838705 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1430/2881] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:51:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:51:45.095743 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f165fa4-06c2-4772-9d1b-f49c5af781f7 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:51:45.096349 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f165fa4-06c2-4772-9d1b-f49c5af781f7 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:51:45.096349 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f165fa4-06c2-4772-9d1b-f49c5af781f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:51:45.102646 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=22 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:51:45.115257 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-2f165fa4-06c2-4772-9d1b-f49c5af781f7 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:51:45.116761 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-2f165fa4-06c2-4772-9d1b-f49c5af781f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:51:45.124501 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1452/2882] 10.222.0.15 () {58 vars in 1016 bytes} [Tue Jun 7 14:51:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:51:45.145253 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425b01d3-1b6c-48f5-8e22-bd539aaa4e43 service nova] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:51:45.156780 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425b01d3-1b6c-48f5-8e22-bd539aaa4e43 service nova] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:51:45.162291 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a03f08-d7a0-4f89-ba96-fd440f048b8f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99cfb70f54c45c8870369359da20378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:51:45.162906 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a03f08-d7a0-4f89-ba96-fd440f048b8f service nova] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:51:45.163193 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a03f08-d7a0-4f89-ba96-fd440f048b8f service nova] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:51:45.163469 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a03f08-d7a0-4f89-ba96-fd440f048b8f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:51:45.172394 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a03f08-d7a0-4f89-ba96-fd440f048b8f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:51:45.173955 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a03f08-d7a0-4f89-ba96-fd440f048b8f service nova] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:51:45.183319 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1431/2883] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:51:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:51:49.576543 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67ea29b-34fb-4342-a165-36a1a33726a4 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:51:49.577133 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67ea29b-34fb-4342-a165-36a1a33726a4 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:51:49.577133 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67ea29b-34fb-4342-a165-36a1a33726a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:51:49.595197 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-a67ea29b-34fb-4342-a165-36a1a33726a4 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:51:49.596401 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-a67ea29b-34fb-4342-a165-36a1a33726a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:51:49.604587 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1453/2884] 10.222.0.15 () {58 vars in 1016 bytes} [Tue Jun 7 14:51:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:51:49.625780 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a03f08-d7a0-4f89-ba96-fd440f048b8f service nova] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:51:49.637365 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a03f08-d7a0-4f89-ba96-fd440f048b8f service nova] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:51:49.643344 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6927db6f-ba27-4dc7-8225-38c2e98d0b4c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99cfb70f54c45c8870369359da20378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:51:49.644008 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6927db6f-ba27-4dc7-8225-38c2e98d0b4c service nova] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:51:49.644300 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6927db6f-ba27-4dc7-8225-38c2e98d0b4c service nova] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:51:49.644586 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6927db6f-ba27-4dc7-8225-38c2e98d0b4c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:51:49.652911 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6927db6f-ba27-4dc7-8225-38c2e98d0b4c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:51:49.654478 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6927db6f-ba27-4dc7-8225-38c2e98d0b4c service nova] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:51:49.664531 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1432/2885] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:51:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:51:53.429610 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e1873b-56cf-47e2-932e-185730ea7d31 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:51:53.430101 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e1873b-56cf-47e2-932e-185730ea7d31 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:51:53.430224 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e1873b-56cf-47e2-932e-185730ea7d31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:51:53.447815 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-c1e1873b-56cf-47e2-932e-185730ea7d31 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:51:53.449008 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-c1e1873b-56cf-47e2-932e-185730ea7d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:51:53.456715 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1454/2886] 10.222.0.15 () {58 vars in 1016 bytes} [Tue Jun 7 14:51:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:51:53.478290 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6927db6f-ba27-4dc7-8225-38c2e98d0b4c service nova] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:51:53.490022 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6927db6f-ba27-4dc7-8225-38c2e98d0b4c service nova] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:51:53.495489 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4d36e6-293e-4853-b8b5-8523afe9accb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99cfb70f54c45c8870369359da20378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:51:53.496156 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4d36e6-293e-4853-b8b5-8523afe9accb service nova] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:51:53.496441 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4d36e6-293e-4853-b8b5-8523afe9accb service nova] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:51:53.496716 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4d36e6-293e-4853-b8b5-8523afe9accb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:51:53.504862 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4d36e6-293e-4853-b8b5-8523afe9accb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:51:53.506677 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4d36e6-293e-4853-b8b5-8523afe9accb service nova] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:51:53.516011 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1433/2887] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:51:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:51:57.687000 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2e1989-d2b5-4a00-a10a-16c69e037070 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:51:57.687495 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2e1989-d2b5-4a00-a10a-16c69e037070 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:51:57.687600 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2e1989-d2b5-4a00-a10a-16c69e037070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:51:57.706331 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-4e2e1989-d2b5-4a00-a10a-16c69e037070 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:51:57.707526 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-4e2e1989-d2b5-4a00-a10a-16c69e037070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:51:57.715449 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1455/2888] 10.222.0.15 () {58 vars in 1016 bytes} [Tue Jun 7 14:51:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:51:57.737385 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4d36e6-293e-4853-b8b5-8523afe9accb service nova] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:51:57.748678 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4d36e6-293e-4853-b8b5-8523afe9accb service nova] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:51:57.754877 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b34fc2-d952-4e45-bb15-2abfa0bf5731 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99cfb70f54c45c8870369359da20378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:51:57.755708 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b34fc2-d952-4e45-bb15-2abfa0bf5731 service nova] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:51:57.756028 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b34fc2-d952-4e45-bb15-2abfa0bf5731 service nova] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:51:57.756311 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b34fc2-d952-4e45-bb15-2abfa0bf5731 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:51:57.764411 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b34fc2-d952-4e45-bb15-2abfa0bf5731 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:51:57.765970 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b34fc2-d952-4e45-bb15-2abfa0bf5731 service nova] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:51:57.776034 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1434/2889] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:51:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:52:01.965360 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eed574e-3281-472b-a4de-dfd9e0d3ad89 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:52:01.965884 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eed574e-3281-472b-a4de-dfd9e0d3ad89 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:52:01.965985 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eed574e-3281-472b-a4de-dfd9e0d3ad89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:52:01.983671 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-8eed574e-3281-472b-a4de-dfd9e0d3ad89 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:52:01.984877 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-8eed574e-3281-472b-a4de-dfd9e0d3ad89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:52:01.993167 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1456/2890] 10.222.0.15 () {58 vars in 1016 bytes} [Tue Jun 7 14:52:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:52:02.015125 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b34fc2-d952-4e45-bb15-2abfa0bf5731 service nova] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:52:02.020864 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=43 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:52:02.026949 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b34fc2-d952-4e45-bb15-2abfa0bf5731 service nova] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:52:02.032714 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f47faef-3bc8-4f5b-8fb8-fd34f73dd02b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99cfb70f54c45c8870369359da20378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:52:02.033340 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f47faef-3bc8-4f5b-8fb8-fd34f73dd02b service nova] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:52:02.033621 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f47faef-3bc8-4f5b-8fb8-fd34f73dd02b service nova] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:52:02.033901 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f47faef-3bc8-4f5b-8fb8-fd34f73dd02b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:52:02.041810 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f47faef-3bc8-4f5b-8fb8-fd34f73dd02b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:52:02.043382 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f47faef-3bc8-4f5b-8fb8-fd34f73dd02b service nova] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:52:02.053540 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1435/2891] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:52:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:52:11.978519 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=14 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:52:12.069925 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=5 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:52:20.151981 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b64e247-b889-477f-b312-4403b1bc5b3e None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:52:20.152468 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b64e247-b889-477f-b312-4403b1bc5b3e None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:52:20.152569 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b64e247-b889-477f-b312-4403b1bc5b3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:52:20.178869 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-2b64e247-b889-477f-b312-4403b1bc5b3e None None] MFA Rules not processed for user `fa7a4ce9cc594d4fba4aa933e5353c68`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:52:20.180082 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-2b64e247-b889-477f-b312-4403b1bc5b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:52:20.202741 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1457/2892] 10.222.0.86 () {58 vars in 957 bytes} [Tue Jun 7 14:52:20 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:52:30.200715 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=15 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:52:36.159617 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9117227-144d-4bf7-b92d-f1b356feb379 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:52:36.160192 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9117227-144d-4bf7-b92d-f1b356feb379 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:52:36.160192 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9117227-144d-4bf7-b92d-f1b356feb379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:52:36.217715 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-f9117227-144d-4bf7-b92d-f1b356feb379 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:52:36.218925 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-f9117227-144d-4bf7-b92d-f1b356feb379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:52:36.252696 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1436/2893] 10.222.0.15 () {58 vars in 1016 bytes} [Tue Jun 7 14:52:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:52:36.276601 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b64e247-b889-477f-b312-4403b1bc5b3e None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:52:36.296434 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b64e247-b889-477f-b312-4403b1bc5b3e None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:52:36.302128 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a05afb2-a72e-4b4a-ab87-5882ae2c389f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99cfb70f54c45c8870369359da20378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:52:36.302872 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a05afb2-a72e-4b4a-ab87-5882ae2c389f service nova] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:52:36.303158 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a05afb2-a72e-4b4a-ab87-5882ae2c389f service nova] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:52:36.303440 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a05afb2-a72e-4b4a-ab87-5882ae2c389f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:52:36.311594 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a05afb2-a72e-4b4a-ab87-5882ae2c389f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:52:36.313208 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a05afb2-a72e-4b4a-ab87-5882ae2c389f service nova] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:52:36.322451 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1458/2894] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:52:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:52:40.741076 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fd6974-378a-4015-a7de-d93d41ce22e9 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:52:40.741613 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fd6974-378a-4015-a7de-d93d41ce22e9 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:52:40.741613 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fd6974-378a-4015-a7de-d93d41ce22e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:52:40.761245 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-54fd6974-378a-4015-a7de-d93d41ce22e9 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:52:40.762452 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-54fd6974-378a-4015-a7de-d93d41ce22e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:52:40.770239 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1437/2895] 10.222.0.15 () {58 vars in 1016 bytes} [Tue Jun 7 14:52:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:52:40.790154 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a05afb2-a72e-4b4a-ab87-5882ae2c389f service nova] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:52:40.801890 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a05afb2-a72e-4b4a-ab87-5882ae2c389f service nova] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:52:40.808077 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f373b9a6-ad77-48ed-84e4-4328be9f7696 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99cfb70f54c45c8870369359da20378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:52:40.808710 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f373b9a6-ad77-48ed-84e4-4328be9f7696 service nova] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:52:40.808998 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f373b9a6-ad77-48ed-84e4-4328be9f7696 service nova] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:52:40.809277 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f373b9a6-ad77-48ed-84e4-4328be9f7696 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:52:40.817576 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f373b9a6-ad77-48ed-84e4-4328be9f7696 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:52:40.819153 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f373b9a6-ad77-48ed-84e4-4328be9f7696 service nova] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:52:40.828625 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1459/2896] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:52:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:52:44.613937 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46ff18e-3f40-4ad3-a0dc-82f87c37a520 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:52:44.614444 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46ff18e-3f40-4ad3-a0dc-82f87c37a520 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:52:44.614555 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46ff18e-3f40-4ad3-a0dc-82f87c37a520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:52:44.632229 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-b46ff18e-3f40-4ad3-a0dc-82f87c37a520 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:52:44.633400 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-b46ff18e-3f40-4ad3-a0dc-82f87c37a520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:52:44.641510 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1438/2897] 10.222.0.15 () {58 vars in 1016 bytes} [Tue Jun 7 14:52:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:52:44.663668 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f373b9a6-ad77-48ed-84e4-4328be9f7696 service nova] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:52:44.674676 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f373b9a6-ad77-48ed-84e4-4328be9f7696 service nova] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:52:44.680052 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d1cca1-d0a9-401a-b20e-f1ccf9f884f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99cfb70f54c45c8870369359da20378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:52:44.680677 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d1cca1-d0a9-401a-b20e-f1ccf9f884f5 service nova] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:52:44.680956 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d1cca1-d0a9-401a-b20e-f1ccf9f884f5 service nova] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:52:44.681227 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d1cca1-d0a9-401a-b20e-f1ccf9f884f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:52:44.689217 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d1cca1-d0a9-401a-b20e-f1ccf9f884f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:52:44.690758 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d1cca1-d0a9-401a-b20e-f1ccf9f884f5 service nova] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:52:44.700462 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1460/2898] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:52:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:52:49.001338 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e8313d-bc2e-4c2d-aa38-ab5c38a4f8c6 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:52:49.001835 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e8313d-bc2e-4c2d-aa38-ab5c38a4f8c6 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:52:49.001951 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e8313d-bc2e-4c2d-aa38-ab5c38a4f8c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:52:49.020718 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-90e8313d-bc2e-4c2d-aa38-ab5c38a4f8c6 None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:52:49.021990 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-90e8313d-bc2e-4c2d-aa38-ab5c38a4f8c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:52:49.031205 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1439/2899] 10.222.0.15 () {58 vars in 1016 bytes} [Tue Jun 7 14:52:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:52:49.055886 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d1cca1-d0a9-401a-b20e-f1ccf9f884f5 service nova] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:52:49.066900 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d1cca1-d0a9-401a-b20e-f1ccf9f884f5 service nova] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:52:49.072304 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4901e519-7b75-4ca3-aeb7-173e9751ee67 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99cfb70f54c45c8870369359da20378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:52:49.073417 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4901e519-7b75-4ca3-aeb7-173e9751ee67 service nova] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:52:49.073699 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4901e519-7b75-4ca3-aeb7-173e9751ee67 service nova] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:52:49.073975 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4901e519-7b75-4ca3-aeb7-173e9751ee67 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:52:49.082117 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4901e519-7b75-4ca3-aeb7-173e9751ee67 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:52:49.083672 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4901e519-7b75-4ca3-aeb7-173e9751ee67 service nova] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:52:49.093398 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1461/2900] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:52:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:52:53.250243 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9142f97b-7606-43ae-9903-e356486a1ada None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:52:53.250664 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9142f97b-7606-43ae-9903-e356486a1ada None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:52:53.250787 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9142f97b-7606-43ae-9903-e356486a1ada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:52:53.278442 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-9142f97b-7606-43ae-9903-e356486a1ada None None] MFA Rules not processed for user `5e52b7dc1f3e460b87cf6e04ac06baf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:52:53.279615 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-9142f97b-7606-43ae-9903-e356486a1ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:52:53.287283 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1440/2901] 10.222.0.15 () {58 vars in 1016 bytes} [Tue Jun 7 14:52:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:52:53.308771 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4901e519-7b75-4ca3-aeb7-173e9751ee67 service nova] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:52:53.319600 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4901e519-7b75-4ca3-aeb7-173e9751ee67 service nova] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:52:53.325618 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e15303d-231d-462a-ae17-ea6dcdf2bbf0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99cfb70f54c45c8870369359da20378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:52:53.326187 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e15303d-231d-462a-ae17-ea6dcdf2bbf0 service nova] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:52:53.326466 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e15303d-231d-462a-ae17-ea6dcdf2bbf0 service nova] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:52:53.326741 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e15303d-231d-462a-ae17-ea6dcdf2bbf0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:52:53.334698 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e15303d-231d-462a-ae17-ea6dcdf2bbf0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:52:53.336316 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e15303d-231d-462a-ae17-ea6dcdf2bbf0 service nova] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:52:53.345500 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1462/2902] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:52:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:53:03.273347 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=45 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:53:03.341289 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=33 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:53:29.954344 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9142f97b-7606-43ae-9903-e356486a1ada None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:53:29.955742 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-9142f97b-7606-43ae-9903-e356486a1ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:53:29.982081 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9142f97b-7606-43ae-9903-e356486a1ada None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:53:29.987321 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691ebc90-87bc-47c4-96f0-35e05c05eab4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e042f9d4a9345bb947e6a30f64a59ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:53:29.988014 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ebc90-87bc-47c4-96f0-35e05c05eab4 service placement] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:53:29.988308 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ebc90-87bc-47c4-96f0-35e05c05eab4 service placement] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:53:29.988594 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ebc90-87bc-47c4-96f0-35e05c05eab4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:53:29.990434 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-691ebc90-87bc-47c4-96f0-35e05c05eab4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:53:30.002429 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691ebc90-87bc-47c4-96f0-35e05c05eab4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:53:30.004781 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691ebc90-87bc-47c4-96f0-35e05c05eab4 service placement] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:53:30.014418 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1441/2903] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:53:29 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:53:30.098981 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e15303d-231d-462a-ae17-ea6dcdf2bbf0 service nova] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:53:30.110054 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e15303d-231d-462a-ae17-ea6dcdf2bbf0 service nova] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:53:30.114935 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc7f25b-882c-4c8b-b919-33ffda250bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:53:30.115781 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc7f25b-882c-4c8b-b919-33ffda250bbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:53:30.116076 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc7f25b-882c-4c8b-b919-33ffda250bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:53:30.116354 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc7f25b-882c-4c8b-b919-33ffda250bbf admin admin] PATH_INFO: `/v3/users/fa7a4ce9cc594d4fba4aa933e5353c68` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:53:30.117554 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc7f25b-882c-4c8b-b919-33ffda250bbf admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa7a4ce9cc594d4fba4aa933e5353c68)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:53:30.119569 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc7f25b-882c-4c8b-b919-33ffda250bbf admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:53:30.294996 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-abc7f25b-882c-4c8b-b919-33ffda250bbf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa7a4ce9cc594d4fba4aa933e5353c68'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:53:30.295648 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-abc7f25b-882c-4c8b-b919-33ffda250bbf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa7a4ce9cc594d4fba4aa933e5353c68'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:53:30.302455 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-abc7f25b-882c-4c8b-b919-33ffda250bbf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa7a4ce9cc594d4fba4aa933e5353c68'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:53:30.313984 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-abc7f25b-882c-4c8b-b919-33ffda250bbf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa7a4ce9cc594d4fba4aa933e5353c68'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:53:30.314632 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-abc7f25b-882c-4c8b-b919-33ffda250bbf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa7a4ce9cc594d4fba4aa933e5353c68'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:53:30.410176 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1463/2904] 10.222.0.86 () {58 vars in 1223 bytes} [Tue Jun 7 14:53:30 2022] DELETE /identity/v3/users/fa7a4ce9cc594d4fba4aa933e5353c68 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:53:30.648805 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691ebc90-87bc-47c4-96f0-35e05c05eab4 service placement] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:53:30.659565 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691ebc90-87bc-47c4-96f0-35e05c05eab4 service placement] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:53:30.716089 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd40a2c1-ef25-4fd3-aad9-40d02b120506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:53:30.716941 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd40a2c1-ef25-4fd3-aad9-40d02b120506 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:53:30.717224 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd40a2c1-ef25-4fd3-aad9-40d02b120506 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:53:30.717500 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd40a2c1-ef25-4fd3-aad9-40d02b120506 admin admin] PATH_INFO: `/v3/projects/5e0f4a797ae74b8a85e14ea8984dd0b9` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:53:30.718652 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd40a2c1-ef25-4fd3-aad9-40d02b120506 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e0f4a797ae74b8a85e14ea8984dd0b9)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:53:30.720558 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd40a2c1-ef25-4fd3-aad9-40d02b120506 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:53:30.838668 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-cd40a2c1-ef25-4fd3-aad9-40d02b120506 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e0f4a797ae74b8a85e14ea8984dd0b9', 'request_id': 'req-cd40a2c1-ef25-4fd3-aad9-40d02b120506'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:53:30.845055 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-cd40a2c1-ef25-4fd3-aad9-40d02b120506 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e0f4a797ae74b8a85e14ea8984dd0b9', 'request_id': 'req-cd40a2c1-ef25-4fd3-aad9-40d02b120506'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:53:30.918474 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-cd40a2c1-ef25-4fd3-aad9-40d02b120506 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e0f4a797ae74b8a85e14ea8984dd0b9', 'request_id': 'req-cd40a2c1-ef25-4fd3-aad9-40d02b120506'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:53:30.929283 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-cd40a2c1-ef25-4fd3-aad9-40d02b120506 admin admin] The token cache is being invalidate because project 5e0f4a797ae74b8a85e14ea8984dd0b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:53:30.929588 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-cd40a2c1-ef25-4fd3-aad9-40d02b120506 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:53:30.930210 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-cd40a2c1-ef25-4fd3-aad9-40d02b120506 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:53:30.931746 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1442/2905] 10.222.0.86 () {58 vars in 1232 bytes} [Tue Jun 7 14:53:30 2022] DELETE /identity/v3/projects/5e0f4a797ae74b8a85e14ea8984dd0b9 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:53:40.406551 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:53:40.925818 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=61,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:54:17.236761 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc7f25b-882c-4c8b-b919-33ffda250bbf admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:54:17.236761 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-abc7f25b-882c-4c8b-b919-33ffda250bbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:54:17.325069 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc7f25b-882c-4c8b-b919-33ffda250bbf admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:54:17.381841 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fcec80-0ce6-45ec-8803-a08e08d4ce75 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e042f9d4a9345bb947e6a30f64a59ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:54:17.382486 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fcec80-0ce6-45ec-8803-a08e08d4ce75 service placement] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:54:17.382774 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fcec80-0ce6-45ec-8803-a08e08d4ce75 service placement] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:54:17.383058 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fcec80-0ce6-45ec-8803-a08e08d4ce75 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:54:17.384904 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-51fcec80-0ce6-45ec-8803-a08e08d4ce75 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:54:17.395860 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fcec80-0ce6-45ec-8803-a08e08d4ce75 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:54:17.397418 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fcec80-0ce6-45ec-8803-a08e08d4ce75 service placement] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:54:17.407063 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1464/2906] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:54:17 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:54:18.648192 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd40a2c1-ef25-4fd3-aad9-40d02b120506 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:54:18.651570 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-cd40a2c1-ef25-4fd3-aad9-40d02b120506 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:54:18.731908 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd40a2c1-ef25-4fd3-aad9-40d02b120506 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:54:18.735483 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab33d9c-7476-4351-8090-0a1610288ce1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dda603ec5517460a83c333db2af804d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:54:18.736166 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab33d9c-7476-4351-8090-0a1610288ce1 service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:54:18.736454 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab33d9c-7476-4351-8090-0a1610288ce1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:54:18.736731 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab33d9c-7476-4351-8090-0a1610288ce1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:54:18.738581 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-4ab33d9c-7476-4351-8090-0a1610288ce1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:54:18.748002 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab33d9c-7476-4351-8090-0a1610288ce1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:54:18.749449 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab33d9c-7476-4351-8090-0a1610288ce1 service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:54:18.757686 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1443/2907] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:54:18 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:54:18.844751 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fcec80-0ce6-45ec-8803-a08e08d4ce75 service placement] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:54:18.854517 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fcec80-0ce6-45ec-8803-a08e08d4ce75 service placement] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:54:18.858152 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac7aff7-fc78-4328-b275-d93f2b241f12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dda603ec5517460a83c333db2af804d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:54:18.858783 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac7aff7-fc78-4328-b275-d93f2b241f12 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:54:18.859070 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac7aff7-fc78-4328-b275-d93f2b241f12 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:54:18.859351 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac7aff7-fc78-4328-b275-d93f2b241f12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:54:18.861148 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-cac7aff7-fc78-4328-b275-d93f2b241f12 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:54:18.930889 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:54:18.953762 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac7aff7-fc78-4328-b275-d93f2b241f12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:54:18.955363 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac7aff7-fc78-4328-b275-d93f2b241f12 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:54:18.978078 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1465/2908] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:54:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:54:28.754186 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=35 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:54:28.975396 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=13 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:56:15.017014 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab33d9c-7476-4351-8090-0a1610288ce1 service neutron] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:56:15.018459 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-4ab33d9c-7476-4351-8090-0a1610288ce1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:56:15.031332 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab33d9c-7476-4351-8090-0a1610288ce1 service neutron] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:56:15.035034 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f35adbf-98e8-48c8-90e0-98012a7499fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dda603ec5517460a83c333db2af804d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:56:15.035673 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f35adbf-98e8-48c8-90e0-98012a7499fe service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:56:15.035983 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f35adbf-98e8-48c8-90e0-98012a7499fe service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:56:15.036260 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f35adbf-98e8-48c8-90e0-98012a7499fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:56:15.038016 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-3f35adbf-98e8-48c8-90e0-98012a7499fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:56:15.096980 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f35adbf-98e8-48c8-90e0-98012a7499fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:56:15.098436 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f35adbf-98e8-48c8-90e0-98012a7499fe service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:56:15.107351 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1444/2909] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:56:15 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:56:16.105430 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac7aff7-fc78-4328-b275-d93f2b241f12 service neutron] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:56:16.114595 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac7aff7-fc78-4328-b275-d93f2b241f12 service neutron] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:56:16.118663 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da7dfec-fe92-4a35-8123-937b85ebbd9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dda603ec5517460a83c333db2af804d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:56:16.119560 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da7dfec-fe92-4a35-8123-937b85ebbd9c service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:56:16.119946 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da7dfec-fe92-4a35-8123-937b85ebbd9c service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:56:16.120230 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da7dfec-fe92-4a35-8123-937b85ebbd9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:56:16.122131 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-0da7dfec-fe92-4a35-8123-937b85ebbd9c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:56:16.132792 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da7dfec-fe92-4a35-8123-937b85ebbd9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:56:16.134222 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da7dfec-fe92-4a35-8123-937b85ebbd9c service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:56:16.142685 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1466/2910] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:56:16 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:56:17.495122 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f35adbf-98e8-48c8-90e0-98012a7499fe service neutron] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:56:17.504263 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f35adbf-98e8-48c8-90e0-98012a7499fe service neutron] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:56:17.508132 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4560e81-50f1-4230-817b-42ee8733824a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dda603ec5517460a83c333db2af804d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:56:17.509269 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4560e81-50f1-4230-817b-42ee8733824a service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:56:17.509557 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4560e81-50f1-4230-817b-42ee8733824a service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:56:17.509831 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4560e81-50f1-4230-817b-42ee8733824a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:56:17.511666 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-f4560e81-50f1-4230-817b-42ee8733824a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:56:17.525836 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4560e81-50f1-4230-817b-42ee8733824a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:56:17.527330 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4560e81-50f1-4230-817b-42ee8733824a service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:56:17.538152 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1445/2911] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:56:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:56:18.709758 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da7dfec-fe92-4a35-8123-937b85ebbd9c service neutron] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:56:18.718482 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da7dfec-fe92-4a35-8123-937b85ebbd9c service neutron] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:56:18.722153 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31af3867-233f-4f79-9b9c-d2a608d17731 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dda603ec5517460a83c333db2af804d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:56:18.722818 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31af3867-233f-4f79-9b9c-d2a608d17731 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:56:18.723236 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31af3867-233f-4f79-9b9c-d2a608d17731 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:56:18.723551 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31af3867-233f-4f79-9b9c-d2a608d17731 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:56:18.725404 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-31af3867-233f-4f79-9b9c-d2a608d17731 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:56:18.739128 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31af3867-233f-4f79-9b9c-d2a608d17731 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:56:18.740642 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31af3867-233f-4f79-9b9c-d2a608d17731 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:56:18.752372 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1467/2912] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:56:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:56:22.506302 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4560e81-50f1-4230-817b-42ee8733824a service neutron] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:56:22.516004 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4560e81-50f1-4230-817b-42ee8733824a service neutron] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:56:22.519727 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de89f2c-577c-42b8-9172-fc816ca07272 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dda603ec5517460a83c333db2af804d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:56:22.520408 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de89f2c-577c-42b8-9172-fc816ca07272 service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:56:22.520695 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de89f2c-577c-42b8-9172-fc816ca07272 service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:56:22.520979 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de89f2c-577c-42b8-9172-fc816ca07272 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:56:22.522792 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-2de89f2c-577c-42b8-9172-fc816ca07272 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:56:22.585255 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de89f2c-577c-42b8-9172-fc816ca07272 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:56:22.586695 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de89f2c-577c-42b8-9172-fc816ca07272 service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:56:22.596375 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1446/2913] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:56:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:56:26.176811 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31af3867-233f-4f79-9b9c-d2a608d17731 service neutron] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:56:26.178740 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-31af3867-233f-4f79-9b9c-d2a608d17731 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:56:26.193317 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31af3867-233f-4f79-9b9c-d2a608d17731 service neutron] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:56:26.199233 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d63f648-c7ed-4ad1-91da-11f854aa1a24 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e042f9d4a9345bb947e6a30f64a59ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:56:26.200039 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d63f648-c7ed-4ad1-91da-11f854aa1a24 service placement] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:56:26.200326 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d63f648-c7ed-4ad1-91da-11f854aa1a24 service placement] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:56:26.200604 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d63f648-c7ed-4ad1-91da-11f854aa1a24 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:56:26.203656 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-9d63f648-c7ed-4ad1-91da-11f854aa1a24 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:56:26.216643 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d63f648-c7ed-4ad1-91da-11f854aa1a24 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:56:26.218317 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d63f648-c7ed-4ad1-91da-11f854aa1a24 service placement] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:56:26.228831 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1468/2914] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:56:26 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:56:29.948919 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de89f2c-577c-42b8-9172-fc816ca07272 service neutron] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:56:29.950389 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-2de89f2c-577c-42b8-9172-fc816ca07272 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:56:29.964010 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de89f2c-577c-42b8-9172-fc816ca07272 service neutron] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:56:29.968782 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54100fec-c3eb-40bc-aafb-50d65a18e77b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:56:29.969705 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54100fec-c3eb-40bc-aafb-50d65a18e77b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:56:29.969994 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54100fec-c3eb-40bc-aafb-50d65a18e77b admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:56:29.970272 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54100fec-c3eb-40bc-aafb-50d65a18e77b admin admin] PATH_INFO: `/v3/users/c0f8e619568545a3a33dfcb02a872dec` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:56:29.971513 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54100fec-c3eb-40bc-aafb-50d65a18e77b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0f8e619568545a3a33dfcb02a872dec)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:56:29.973578 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54100fec-c3eb-40bc-aafb-50d65a18e77b admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:56:30.218708 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-54100fec-c3eb-40bc-aafb-50d65a18e77b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0f8e619568545a3a33dfcb02a872dec'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:56:30.225882 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-54100fec-c3eb-40bc-aafb-50d65a18e77b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0f8e619568545a3a33dfcb02a872dec'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:56:30.226683 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-54100fec-c3eb-40bc-aafb-50d65a18e77b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0f8e619568545a3a33dfcb02a872dec'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:56:30.239158 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-54100fec-c3eb-40bc-aafb-50d65a18e77b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0f8e619568545a3a33dfcb02a872dec'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:56:30.239850 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-54100fec-c3eb-40bc-aafb-50d65a18e77b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0f8e619568545a3a33dfcb02a872dec'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:56:30.241547 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:56:30.324504 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1447/2915] 10.222.0.86 () {58 vars in 1223 bytes} [Tue Jun 7 14:56:29 2022] DELETE /identity/v3/users/c0f8e619568545a3a33dfcb02a872dec => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:56:30.583632 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d63f648-c7ed-4ad1-91da-11f854aa1a24 service placement] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:56:30.596108 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d63f648-c7ed-4ad1-91da-11f854aa1a24 service placement] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:56:30.655536 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51391e64-7eca-433e-bc8c-278cef16db66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:56:30.656422 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51391e64-7eca-433e-bc8c-278cef16db66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:56:30.656703 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51391e64-7eca-433e-bc8c-278cef16db66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:56:30.656982 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51391e64-7eca-433e-bc8c-278cef16db66 admin admin] PATH_INFO: `/v3/projects/094d37c9569b4fa59a777a9e55bb1824` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:56:30.658142 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51391e64-7eca-433e-bc8c-278cef16db66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=094d37c9569b4fa59a777a9e55bb1824)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:56:30.660038 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51391e64-7eca-433e-bc8c-278cef16db66 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:56:30.828518 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-51391e64-7eca-433e-bc8c-278cef16db66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '094d37c9569b4fa59a777a9e55bb1824', 'request_id': 'req-51391e64-7eca-433e-bc8c-278cef16db66'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:56:30.834579 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-51391e64-7eca-433e-bc8c-278cef16db66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '094d37c9569b4fa59a777a9e55bb1824', 'request_id': 'req-51391e64-7eca-433e-bc8c-278cef16db66'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:56:30.910923 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-51391e64-7eca-433e-bc8c-278cef16db66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '094d37c9569b4fa59a777a9e55bb1824', 'request_id': 'req-51391e64-7eca-433e-bc8c-278cef16db66'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:56:30.921356 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-51391e64-7eca-433e-bc8c-278cef16db66 admin admin] The token cache is being invalidate because project 094d37c9569b4fa59a777a9e55bb1824 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:56:30.921717 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-51391e64-7eca-433e-bc8c-278cef16db66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:56:30.922318 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-51391e64-7eca-433e-bc8c-278cef16db66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:56:30.932634 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1469/2916] 10.222.0.86 () {58 vars in 1232 bytes} [Tue Jun 7 14:56:30 2022] DELETE /identity/v3/projects/094d37c9569b4fa59a777a9e55bb1824 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:56:30.932846 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54100fec-c3eb-40bc-aafb-50d65a18e77b admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:56:30.932846 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-54100fec-c3eb-40bc-aafb-50d65a18e77b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:56:30.942861 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54100fec-c3eb-40bc-aafb-50d65a18e77b admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:56:30.998997 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9536a381-10e6-493f-952b-3a3597228915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:56:30.999898 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9536a381-10e6-493f-952b-3a3597228915 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:56:31.000188 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9536a381-10e6-493f-952b-3a3597228915 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:56:31.000468 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9536a381-10e6-493f-952b-3a3597228915 admin admin] PATH_INFO: `/v3/users/44ea222fe037496db64aaa5050065eb1` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:56:31.001690 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9536a381-10e6-493f-952b-3a3597228915 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44ea222fe037496db64aaa5050065eb1)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:56:31.003615 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9536a381-10e6-493f-952b-3a3597228915 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:56:31.207679 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-9536a381-10e6-493f-952b-3a3597228915 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44ea222fe037496db64aaa5050065eb1'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:56:31.214448 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-9536a381-10e6-493f-952b-3a3597228915 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44ea222fe037496db64aaa5050065eb1'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:56:31.215105 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-9536a381-10e6-493f-952b-3a3597228915 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44ea222fe037496db64aaa5050065eb1'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:56:31.226965 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-9536a381-10e6-493f-952b-3a3597228915 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44ea222fe037496db64aaa5050065eb1'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:56:31.227627 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-9536a381-10e6-493f-952b-3a3597228915 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44ea222fe037496db64aaa5050065eb1'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:56:31.290873 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1448/2917] 10.222.0.86 () {58 vars in 1223 bytes} [Tue Jun 7 14:56:30 2022] DELETE /identity/v3/users/44ea222fe037496db64aaa5050065eb1 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:56:31.572258 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51391e64-7eca-433e-bc8c-278cef16db66 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:56:31.573725 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-51391e64-7eca-433e-bc8c-278cef16db66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:56:31.587394 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51391e64-7eca-433e-bc8c-278cef16db66 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:56:31.636971 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:56:31.646539 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61080c8-0bad-499a-b991-348a085c90d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e52b7dc1f3e460b87cf6e04ac06baf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce15f4da81a4a5c8d99aabf417988bf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:56:31.647400 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61080c8-0bad-499a-b991-348a085c90d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:56:31.647684 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61080c8-0bad-499a-b991-348a085c90d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:56:31.650013 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61080c8-0bad-499a-b991-348a085c90d1 admin admin] PATH_INFO: `/v3/projects/a79bc60c2b48441cb65d297603ff37b6` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:56:31.650013 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61080c8-0bad-499a-b991-348a085c90d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a79bc60c2b48441cb65d297603ff37b6)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:56:31.651151 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61080c8-0bad-499a-b991-348a085c90d1 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:56:31.730478 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-e61080c8-0bad-499a-b991-348a085c90d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a79bc60c2b48441cb65d297603ff37b6', 'request_id': 'req-e61080c8-0bad-499a-b991-348a085c90d1'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:56:31.736951 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-e61080c8-0bad-499a-b991-348a085c90d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a79bc60c2b48441cb65d297603ff37b6', 'request_id': 'req-e61080c8-0bad-499a-b991-348a085c90d1'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:56:31.793899 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-e61080c8-0bad-499a-b991-348a085c90d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a79bc60c2b48441cb65d297603ff37b6', 'request_id': 'req-e61080c8-0bad-499a-b991-348a085c90d1'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:56:31.804427 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-e61080c8-0bad-499a-b991-348a085c90d1 admin admin] The token cache is being invalidate because project a79bc60c2b48441cb65d297603ff37b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:56:31.804724 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-e61080c8-0bad-499a-b991-348a085c90d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:56:31.805390 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-e61080c8-0bad-499a-b991-348a085c90d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:56:31.806938 dv-cinder-844974-1-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1470/2918] 10.222.0.86 () {58 vars in 1232 bytes} [Tue Jun 7 14:56:31 2022] DELETE /identity/v3/projects/a79bc60c2b48441cb65d297603ff37b6 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:56:41.287298 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=55 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:56:41.801172 dv-cinder-844974-1-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=28,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:59:36.396239 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9536a381-10e6-493f-952b-3a3597228915 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:59:36.397821 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-9536a381-10e6-493f-952b-3a3597228915 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:59:36.467273 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9536a381-10e6-493f-952b-3a3597228915 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:59:36.525739 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93a39b2-018e-4e83-b72c-5df70e4d7d40 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e042f9d4a9345bb947e6a30f64a59ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e429537b190c4c5ea7e1332ab044ca7a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:59:36.526388 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93a39b2-018e-4e83-b72c-5df70e4d7d40 service placement] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:59:36.526676 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93a39b2-018e-4e83-b72c-5df70e4d7d40 service placement] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:59:36.526955 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93a39b2-018e-4e83-b72c-5df70e4d7d40 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:59:36.528764 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-e93a39b2-018e-4e83-b72c-5df70e4d7d40 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:59:36.539874 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93a39b2-018e-4e83-b72c-5df70e4d7d40 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:59:36.541460 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93a39b2-018e-4e83-b72c-5df70e4d7d40 service placement] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:59:36.551675 dv-cinder-844974-1-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1449/2919] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jun 7 14:59:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:59:46.546910 dv-cinder-844974-1-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=58 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}